00000001:02000400:3.0F:1788263033.220798:0:3294:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788263042.229462:0:3496:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1788263043.132785:0:3558:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1323 MB/s 00000001:01000000:1.0:1788263043.382714:0:3558:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1623 MB/s 00000001:01000000:1.0:1788263043.632636:0:3558:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10447 MB/s 00000020:02000000:1.0:1788263043.904950:0:3587:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_103_ga9ee299 00000400:02000000:2.0F:1788263044.261422:0:3602:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.126@tcp [8/256/0/180] 00008000:02000000:2.0:1788263047.717451:0:3752:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788263093.778821:0:5718:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788263103.961997:0:6468:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788263103.962003:0:6468:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788263103.962004:0:6468:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788263103.962137:0:6468:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000007878465d 00000080:02000400:1.0:1788263103.962146:0:6468:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788263103.964744:0:6468:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788263103.964756:0:6468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788263103.965429:0:6468:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000036e6cf58) 00000020:00000080:1.0:1788263103.965508:0:6468:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788263104.023042:0:6468:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788263104.023106:0:6468:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1788263104.045910:0:6468:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788263104.046119:0:6468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788263104.046127:0:6468:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788263104.046137:0:6468:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b1103cba666ee7e 00000020:01000004:1.0:1788263104.046143:0:6468:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788263104.046148:0:6468:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788263104.046151:0:6468:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007878465d from MGS 00000020:01000004:1.0:1788263104.046156:0:6468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788263104.046166:0:6468:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000006f8a8d0b) 00000020:00000080:1.0:1788263104.046176:0:6468:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788263104.046296:0:6468:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007878465d from MGS, refs=2 00080000:01000000:1.0:1788263104.046302:0:6468:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788263104.046307:0:6468:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b1103cba666ee8c 00000100:00100000:1.0:1788263104.046398:0:6468:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788263104.047442:0:6468:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788263104.047449:0:6468:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788263104.047889:0:6468:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788263104.047896:0:6468:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788263104.048810:0:6468:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788263104.048961:0:6468:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788263104.048966:0:6468:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788263104.050001:0:6468:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788263104.050009:0:6468:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788263104.051784:0:6468:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788263104.051794:0:6468:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788263104.053573:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263104.053747:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263104.053750:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263104.054184:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263104.054187:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263104.054189:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263104.055200:0:6468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788263104.057647:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788263104.304959:0:6468:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3851 MB/s 00000001:01000000:3.0:1788263104.555388:0:6468:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4247 MB/s 00000001:01000000:2.0:1788263104.807313:0:6468:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 805 MB/s 00000001:01000000:2.0:1788263105.056859:0:6468:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 843 MB/s 00080000:10000000:1.0:1788263105.062136:0:6468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:3.0:1788263105.071750:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788263105.074881:0:6468:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788263105.077350:0:6482:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788263105.085343:0:6468:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788263105.085391:0:6468:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788263105.085609:0:6468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788263105.085636:0:6468:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788263105.086001:0:6468:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788263105.086489:0:6468:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788263105.086496:0:6468:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788263105.089046:0:6468:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788263105.089068:0:6468:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788263105.089513:0:6468:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788263105.089520:0:6468:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788263105.092286:0:6468:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788263105.092308:0:6468:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.126@tcp' 00000020:01000004:2.0:1788263105.092310:0:6468:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788263105.092356:0:6468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.126@tcp (typ=mgc) 00000020:00000080:2.0:1788263105.092373:0:6468:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.126@tcp (00000000ef38e9a7) 00000020:00000080:2.0:1788263105.092388:0:6468:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788263105.092510:0:6468:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b7caaead@MGC192.168.203.126@tcp: add connection 192.168.203.126@tcp at head 00010000:00010000:2.0:1788263105.092686:0:6468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.126@tcp-0 is initialized 00000040:01000000:2.0:1788263105.092693:0:6468:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788263105.094725:0:6487:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788263105.098396:0:6489:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788263105.098462:0:6468:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.126@tcp (uuid 15f48257-b19e-4792-92d2-a48eb49d0ad1) 00000020:00000080:0.0:1788263105.098482:0:6468:0:(genops.c:1385:class_connect()) connect: client 15f48257-b19e-4792-92d2-a48eb49d0ad1, cookie 0x4b1103cba666ee9a 00000100:00080000:0.0:1788263105.098493:0:6468:0:(import.c:510:import_select_connection()) MGC192.168.203.126@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788263105.098498:0:6468:0:(import.c:624:import_select_connection()) MGC192.168.203.126@tcp: import 00000000b7caaead using connection 192.168.203.126@tcp/0@lo 00000100:00100000:0.0:1788263105.098540:0:6468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000af5e48ab x1875129709625472/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788263105.098558:0:6468:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 15f48257-b19e-4792-92d2-a48eb49d0ad1->MGS 00000020:01000004:0.0:1788263105.098575:0:6468:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788263105.098598:0:6468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788263105.098619:0:6468:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000109c3981) 00000020:00000080:0.0:1788263105.098631:0:6468:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788263105.099090:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000af5e48ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:15f48257-b19e-4792-92d2-a48eb49d0ad1:3617:1875129709625472:0@lo:250: 00000100:00100000:3.0:1788263105.099175:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263105.099340:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709625472 00000100:00100000:0.0:1788263105.099347:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709625472 00000100:00100000:0.0:1788263105.099377:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788263105.099383:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037384c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3617:x1875129709625472:12345-0@lo:250: 00010000:00080000:0.0:1788263105.099401:0:6484:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 15f48257-b19e-4792-92d2-a48eb49d0ad1@0@lo t0 exp 0000000000000000 cur 114 last 0 00000020:00000080:0.0:1788263105.099428:0:6484:0:(genops.c:1385:class_connect()) connect: client 15f48257-b19e-4792-92d2-a48eb49d0ad1, cookie 0x4b1103cba666eea8 00000100:00080000:0.0:1788263105.099537:0:6484:0:(import.c:65:import_set_state_nolock()) 000000009939b653 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263105.099617:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037384c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+5:3617:x1875129709625472:12345-0@lo:250: Request processed in 233us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263105.099624:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788263105.099817:0:3617:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.126@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788263105.099824:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.126@tcp: connect to target with instance 0 00000100:00080000:3.0:1788263105.099831:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.126@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788263105.099835:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788263105.099838:0:3617:0:(import.c:65:import_set_state_nolock()) 00000000b7caaead MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788263105.099840:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788263105.099851:0:3617:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788263105.099856:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000af5e48ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:15f48257-b19e-4792-92d2-a48eb49d0ad1:3617:1875129709625472:0@lo:250: 00000100:00100000:1.0:1788263105.110393:0:6468:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788263105.110622:0:6468:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788263105.110641:0:6468:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788263105.112620:0:6468:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788263105.112630:0:6468:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788263105.113648:0:6468:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788263105.113770:0:6468:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788263105.114529:0:6468:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788263105.114794:0:6468:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788263105.114799:0:6468:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788263105.116836:0:6468:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788263105.116857:0:6468:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788263105.145416:0:6468:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788263105.145735:0:6468:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788263105.145741:0:6468:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788263105.146991:0:6468:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788263105.146999:0:6468:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788263105.147751:0:6468:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788263105.148017:0:6468:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788263105.148023:0:6468:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788263105.149016:0:6468:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788263105.149025:0:6468:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788263105.152181:0:6468:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788263105.152367:0:6468:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788263105.152379:0:6468:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788263105.153167:0:6468:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788263105.153175:0:6468:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788263105.153740:0:6468:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788263105.153902:0:6468:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788263105.153907:0:6468:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788263105.154425:0:6468:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788263105.154432:0:6468:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788263105.170858:0:6468:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788263105.171039:0:6468:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788263105.171044:0:6468:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788263105.176306:0:6468:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788263105.176320:0:6468:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788263105.177287:0:6468:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788263105.177297:0:6468:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788263105.178141:0:6468:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788263105.178169:0:6468:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788263105.178175:0:6468:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.126@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788263105.178257:0:6468:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788263105.178293:0:6468:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.126@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788263105.178297:0:6468:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788263105.178299:0:6468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788263105.178300:0:6468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788263105.178301:0:6468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788263105.178303:0:6468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788263105.178304:0:6468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788263105.178305:0:6468:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788263105.178307:0:6468:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788263105.178308:0:6468:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788263105.178310:0:6468:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788263105.178311:0:6468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788263105.178312:0:6468:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788263105.178314:0:6468:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788263105.178316:0:6468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788263105.178318:0:6468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788263105.178319:0:6468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788263105.178320:0:6468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788263105.178321:0:6468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788263105.178322:0:6468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788263105.178323:0:6468:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788263105.178324:0:6468:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788263105.178330:0:6468:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788263105.178331:0:6468:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788263105.178331:0:6468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788263105.178332:0:6468:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788263105.178364:0:6468:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788263105.178379:0:6468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aacdb336 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709625600:0@lo:253: 00000100:00100000:1.0:1788263105.178457:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263105.178506:0:6468:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e7db59f8 going to sleep for 11 seconds 00000100:00100000:2.0:1788263105.178559:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709625600 00000100:00100000:2.0:1788263105.178566:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709625600 00000100:00100000:2.0:1788263105.178640:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788263105.178648:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a7131fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+5:6468:x1875129709625600:12345-0@lo:253: 20000000:01000000:2.0:1788263105.178697:0:6486:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788263105.178700:0:6486:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788263105.179498:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788263105.179985:0:6486:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788263105.180346:0:6486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788263105.183829:0:6508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788263105.184071:0:6486:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788263105.184075:0:6486:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788263105.184081:0:6486:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788263105.184084:0:6486:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788263105.184094:0:6486:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788263105.184346:0:6486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788263105.184514:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788263105.184528:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788263105.184544:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788263105.184558:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788263105.184568:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788263105.184764:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788263105.184773:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788263105.184788:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788263105.184793:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788263105.184803:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788263105.184807:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788263105.184816:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788263105.184846:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788263105.184875:0:6486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788263105.184880:0:6486:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788263105.184886:0:6486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788263105.184982:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788263105.184992:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788263105.185006:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788263105.185021:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788263105.185045:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788263105.185054:0:6486:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788263105.185077:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788263105.185084:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788263105.185105:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788263105.185119:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788263105.185132:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788263105.185139:0:6486:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788263105.185160:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788263105.185167:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788263105.185179:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788263105.185270:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788263105.185331:0:6486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788263105.185351:0:6486:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788263105.185358:0:6486:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788263105.185788:0:6509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788263105.185933:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788263105.185950:0:6486:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.126@tcp for mdt 20000000:01000000:2.0:1788263105.185952:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:2.0:1788263105.185965:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788263105.185971:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788263105.185982:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788263105.185985:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:2.0:1788263105.185996:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788263105.186003:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788263105.186032:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788263105.186048:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788263105.186074:0:6486:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788263105.186077:0:6486:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788263105.186080:0:6486:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788263105.186128:0:6486:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788263105.186130:0:6486:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788263105.186496:0:6510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1788263105.186749:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788263105.186781:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1788263105.186795:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1788263105.186803:0:6486:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788263105.186805:0:6486:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788263105.187044:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788263105.187252:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788263105.187275:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788263105.187291:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1788263105.187303:0:6486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788263105.187305:0:6486:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1788263105.187309:0:6486:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788263105.187312:0:6486:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788263105.187316:0:6486:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788263105.187323:0:6486:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788263105.187939:0:6512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1788263105.188055:0:6486:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788263105.195412:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1788263105.195445:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1788263105.195460:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1788263105.195479:0:6486:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788263105.195501:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000069f34a1f/0x4b1103cba666eeaf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263105.195518:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000069f34a1f/0x4b1103cba666eeaf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263105.195527:0:6486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000069f34a1f/0x4b1103cba666eeaf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263105.195534:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000069f34a1f/0x4b1103cba666eeaf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263105.195555:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000069f34a1f/0x4b1103cba666eeaf lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263105.195561:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000069f34a1f/0x4b1103cba666eeaf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263105.195567:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000069f34a1f already unused, calling callback (00000000c597375e) 00010000:00010000:2.0:1788263105.195571:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000069f34a1f/0x4b1103cba666eeaf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263105.195785:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000069f34a1f/0x4b1103cba666eeaf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263105.195800:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000069f34a1f/0x4b1103cba666eeaf lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263105.195808:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000069f34a1f/0x4b1103cba666eeaf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263105.195814:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000069f34a1f/0x4b1103cba666eeaf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788263105.195832:0:6486:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788263105.207927:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a7131fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+5:6468:x1875129709625600:12345-0@lo:253: Request processed in 29271us (29462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263105.207946:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788263105.211412:0:6468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aacdb336 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709625600:0@lo:253: 10000000:01000000:2.0:1788263105.211435:0:6468:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788263105.211437:0:6468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788263105.211439:0:6468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788263105.211440:0:6468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263105.211441:0:6468:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788263105.211443:0:6468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263105.211460:0:6468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263105.211461:0:6468:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788263105.211463:0:6468:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788263105.211464:0:6468:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788263105.211465:0:6468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263105.211467:0:6468:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788263105.211486:0:6468:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007878465d from lustre-MDT0000 10000000:01000000:2.0:1788263105.211517:0:6468:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788263105.211519:0:6468:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788263105.211523:0:6468:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ff3b0028000 10000000:01000000:2.0:1788263105.211527:0:6468:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788263105.211535:0:6468:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ff3b0028000 from 1 10000000:01000000:2.0:1788263105.211538:0:6468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788263105.211650:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 000000006b8de930/0x4b1103cba666eeb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263105.211660:0:6468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 000000006b8de930/0x4b1103cba666eeb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263105.211669:0:6468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 000000006b8de930/0x4b1103cba666eeb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263105.211687:0:6468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004380598c pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709625728:0@lo:101: 00000100:00100000:2.0:1788263105.211768:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263105.211868:0:6468:0:(client.c:2715:ptlrpc_set_wait()) set 0000000044e59772 going to sleep for 11 seconds 00000100:00100000:1.0:1788263105.220493:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709625728 00000100:00100000:1.0:1788263105.220510:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709625728 00000100:00100000:1.0:1788263105.220569:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788263105.220592:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053c43e50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+5:6468:x1875129709625728:12345-0@lo:101: 00010000:00010000:1.0:1788263105.220607:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263105.220637:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000061b05237/0x4b1103cba666eebd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666eeb6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.220662:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000061b05237/0x4b1103cba666eebd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666eeb6 expref: 6 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.220672:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000061b05237/0x4b1103cba666eebd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666eeb6 expref: 6 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.220679:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000061b05237, rc 0) 00000100:00100000:1.0:1788263105.220779:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053c43e50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+6:6468:x1875129709625728:12345-0@lo:101: Request processed in 203us (9011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263105.220786:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788263105.221007:0:6468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004380598c pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709625728:0@lo:101: 00010000:00010000:2.0:1788263105.221028:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 000000006b8de930/0x4b1103cba666eeb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666eebd expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263105.221037:0:6468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 000000006b8de930/0x4b1103cba666eeb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666eebd expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263105.221112:0:6468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004380598c pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709625856:0@lo:501: 00000100:00100000:2.0:1788263105.221144:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263105.221203:0:6468:0:(client.c:2715:ptlrpc_set_wait()) set 0000000044e59772 going to sleep for 11 seconds 00000100:00100000:1.0:1788263105.221263:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709625856 00000100:00100000:1.0:1788263105.221268:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709625856 00000100:00100000:1.0:1788263105.221309:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788263105.221317:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000501d1cff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+6:6468:x1875129709625856:12345-0@lo:501: 00000100:00100000:1.0:1788263105.221399:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000501d1cff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+6:6468:x1875129709625856:12345-0@lo:501: Request processed in 84us (255us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788263105.221406:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788263105.221456:0:6468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004380598c pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709625856:0@lo:501: 10000000:01000000:3.0:1788263105.221488:0:6468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788263105.221504:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 000000006b8de930/0x4b1103cba666eeb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666eebd expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263105.221514:0:6468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 000000006b8de930/0x4b1103cba666eeb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666eebd expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263105.221523:0:6468:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ff3888e6000 10000000:01000000:3.0:1788263105.221528:0:6468:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788263105.221537:0:6468:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ff3888e6000 10000000:01000000:3.0:1788263105.221539:0:6468:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788263105.221542:0:6468:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ff3888e6000 from 1 10000000:01000000:3.0:1788263105.221544:0:6468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788263105.221722:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 0000000022645927/0x4b1103cba666eec4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263105.221731:0:6468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 0000000022645927/0x4b1103cba666eec4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263105.221739:0:6468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 0000000022645927/0x4b1103cba666eec4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263105.221751:0:6468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c4b1b29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709625984:0@lo:101: 00000100:00100000:3.0:1788263105.221794:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263105.221869:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709625984 00000100:00100000:1.0:1788263105.221874:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709625984 00000100:00100000:1.0:1788263105.221905:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788263105.221914:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f60f4b6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+6:6468:x1875129709625984:12345-0@lo:101: 00010000:00010000:1.0:1788263105.221921:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263105.221931:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a71405e1/0x4b1103cba666eecb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666eec4 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.221946:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a71405e1/0x4b1103cba666eecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666eec4 expref: 7 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.221955:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a71405e1/0x4b1103cba666eecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666eec4 expref: 7 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.221961:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a71405e1, rc 0) 00000100:00100000:1.0:1788263105.221985:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f60f4b6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+7:6468:x1875129709625984:12345-0@lo:101: Request processed in 75us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263105.221993:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788263105.221999:0:6468:0:(client.c:2715:ptlrpc_set_wait()) set 0000000038ba147b going to sleep for 11 seconds 00000100:00100000:3.0:1788263105.222017:0:6468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c4b1b29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709625984:0@lo:101: 00010000:00010000:3.0:1788263105.222028:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 0000000022645927/0x4b1103cba666eec4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666eecb expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263105.222035:0:6468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 0000000022645927/0x4b1103cba666eec4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666eecb expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263105.222048:0:6468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788263105.222063:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 0000000022645927/0x4b1103cba666eec4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666eecb expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263105.222069:0:6468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 0000000022645927/0x4b1103cba666eec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666eecb expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263105.222074:0:6468:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788263105.222078:0:6468:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788263105.222082:0:6468:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ff3888e6000 10000000:01000000:3.0:1788263105.222084:0:6468:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788263105.222094:0:6468:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788263105.222096:0:6468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788263105.222110:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666eed2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263105.222117:0:6468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666eed2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263105.222123:0:6468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666eed2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263105.222235:0:6468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c4b1b29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709626112:0@lo:101: 00000100:00100000:2.0:1788263105.237380:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263105.238246:0:6468:0:(client.c:2715:ptlrpc_set_wait()) set 0000000038ba147b going to sleep for 11 seconds 00000100:00100000:1.0:1788263105.247807:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709626112 00000100:00100000:1.0:1788263105.247823:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709626112 00000100:00100000:0.0:1788263105.253292:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788263105.253305:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb16ac55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+7:6468:x1875129709626112:12345-0@lo:101: 00010000:00010000:0.0:1788263105.253325:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263105.253344:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000037967562/0x4b1103cba666eed9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666eed2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263105.253370:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000037967562/0x4b1103cba666eed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666eed2 expref: 8 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263105.253380:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000037967562/0x4b1103cba666eed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666eed2 expref: 8 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263105.253389:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000037967562, rc 0) 00000100:00100000:0.0:1788263105.253481:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb16ac55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+8:6468:x1875129709626112:12345-0@lo:101: Request processed in 179us (16107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263105.253488:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788263105.253602:0:6468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c4b1b29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709626112:0@lo:101: 00010000:00010000:3.0:1788263105.253619:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666eed2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666eed9 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263105.253628:0:6468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666eed2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666eed9 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263105.253721:0:6468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c4b1b29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709626240:0@lo:501: 00000100:00100000:3.0:1788263105.253770:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263105.254033:0:6468:0:(client.c:2715:ptlrpc_set_wait()) set 0000000038ba147b going to sleep for 11 seconds 00000100:00100000:2.0:1788263105.254084:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709626240 00000100:00100000:2.0:1788263105.254090:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709626240 00000100:00100000:2.0:1788263105.254122:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788263105.254130:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b430865c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+8:6468:x1875129709626240:12345-0@lo:501: 00000100:00100000:2.0:1788263105.254277:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b430865c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+9:6468:x1875129709626240:12345-0@lo:501: Request processed in 148us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263105.254284:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788263105.254341:0:6468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c4b1b29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709626240:0@lo:501: 00000100:00100000:3.0:1788263105.254367:0:6468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c4b1b29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709626368:0@lo:503: 00000100:00100000:3.0:1788263105.254406:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263105.254426:0:6468:0:(client.c:2715:ptlrpc_set_wait()) set 0000000038ba147b going to sleep for 11 seconds 00000100:00100000:0.0:1788263105.254477:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709626368 00000100:00100000:0.0:1788263105.254482:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709626368 00000100:00100000:0.0:1788263105.254543:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788263105.254550:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa45dbd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+9:6468:x1875129709626368:12345-0@lo:503: 00000100:00100000:0.0:1788263105.254724:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa45dbd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+9:6468:x1875129709626368:12345-0@lo:503: Request processed in 175us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263105.254730:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788263105.254808:0:6468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c4b1b29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709626368:0@lo:503: 00000100:00100000:3.0:1788263105.255220:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c4b1b29 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:6513:1875129709626496:0@lo:502: 00000100:00100000:3.0:1788263105.255257:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263105.255388:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 0000000073f0858f going to sleep for 11 seconds 00000100:00100000:2.0:1788263105.255419:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709626496 00000100:00100000:2.0:1788263105.255424:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709626496 00000100:00100000:2.0:1788263105.255445:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788263105.255450:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000692571c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+9:6513:x1875129709626496:12345-0@lo:502: 00000100:00100000:3.0:1788263105.255853:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c4b1b29 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:6513:1875129709626496:0@lo:502: 00000020:01000000:3.0:1788263105.255875:0:6513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788263105.255885:0:6513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263105.255887:0:6513:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788263105.255891:0:6513:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788263105.255894:0:6513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788263105.255914:0:6513:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000630493d3) 00000020:00000080:3.0:1788263105.255930:0:6513:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788263105.255936:0:6513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788263105.256022:0:6513:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788263105.256030:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b1103cba666eee7 00000020:00000080:3.0:1788263105.256231:0:6513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788263105.256235:0:6513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788263105.256238:0:6513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263105.256239:0:6513:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788263105.256242:0:6513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788263105.256245:0:6513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263105.256246:0:6513:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788263105.256249:0:6513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788263105.256255:0:6513:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000009c56b678) 00000020:00000080:3.0:1788263105.256275:0:6513:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788263105.256279:0:6513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788263105.256281:0:6513:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788263105.256283:0:6513:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788263105.256289:0:6513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788263105.256329:0:6513:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007878465d from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788263105.256340:0:6513:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000da7c7a01) 00000020:00000080:3.0:1788263105.256348:0:6513:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788263105.256412:0:6513:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788263105.256425:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b1103cba666eefc 00000020:00000080:3.0:1788263105.256531:0:6513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788263105.256537:0:6513:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788263105.256542:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4b1103cba666ef03 00080000:01000000:3.0:1788263105.256547:0:6513:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788263105.256550:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b1103cba666ef0a 00000100:00100000:2.0:1788263105.256687:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000692571c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+9:6513:x1875129709626496:12345-0@lo:502: Request processed in 1235us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263105.256696:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00080000:10000000:3.0:1788263105.257467:0:6513:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788263105.259299:0:6513:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788263105.264616:0:6513:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788263105.335293:0:6513:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788263105.335887:0:6513:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788263105.338974:0:6513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788263105.339285:0:6513:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788263105.344895:0:6513:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000003fd3dcd5) 00000020:00000080:3.0:1788263105.344919:0:6513:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788263105.344997:0:6513:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788263105.345005:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b1103cba666ef18 00000020:00000080:2.0:1788263105.352548:0:6513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788263105.354867:0:6513:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1788263105.361270:0:6513:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1788263105.365296:0:6513:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1788263105.371223:0:6513:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1788263105.374959:0:6513:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1788263105.377973:0:6513:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1788263105.386136:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4b1103cba666ef1f 00000020:00000080:2.0:1788263105.386538:0:6513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788263105.386549:0:6513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263105.386561:0:6513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263105.386563:0:6513:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788263105.386568:0:6513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263105.386572:0:6513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263105.386573:0:6513:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788263105.386575:0:6513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788263105.386608:0:6513:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788263105.386611:0:6513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263105.386614:0:6513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263105.386615:0:6513:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788263105.386617:0:6513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263105.386621:0:6513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263105.386622:0:6513:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788263105.386626:0:6513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788263105.386677:0:6513:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788263105.386742:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000843186aa pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:6513:1875129709626624:0@lo:502: 00000100:00100000:2.0:1788263105.386823:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263105.386888:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709626624 00000100:00100000:2.0:1788263105.386891:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 00000000da5bab6b going to sleep for 11 seconds 00000100:00100000:1.0:1788263105.386896:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709626624 00000100:00100000:1.0:1788263105.386942:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788263105.386950:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085730580 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+9:6513:x1875129709626624:12345-0@lo:502: 00000100:00100000:1.0:1788263105.387079:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085730580 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+9:6513:x1875129709626624:12345-0@lo:502: Request processed in 129us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263105.387087:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788263105.387166:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000843186aa pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:6513:1875129709626624:0@lo:502: 00000020:01000000:2.0:1788263105.387191:0:6513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263105.387196:0:6513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263105.387197:0:6513:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788263105.387201:0:6513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788263105.387320:0:6468:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788263105.387350:0:6468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788263105.387362:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666eed2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666eed9 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.387373:0:6468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666eed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666eed9 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263105.387381:0:6468:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ff3888e6000 from 1 10000000:01000000:1.0:1788263105.387384:0:6468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788263105.387409:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000c623b44b/0x4b1103cba666ef26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.387416:0:6468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000c623b44b/0x4b1103cba666ef26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.387424:0:6468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000c623b44b/0x4b1103cba666ef26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263105.387438:0:6468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dddea87e pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709626752:0@lo:101: 00000100:00100000:1.0:1788263105.387467:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263105.387488:0:6468:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b11ef904 going to sleep for 11 seconds 00000100:00100000:0.0:1788263105.387664:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709626752 00000100:00100000:0.0:1788263105.387669:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709626752 00000100:00100000:0.0:1788263105.387802:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788263105.387811:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000535f943a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+9:6468:x1875129709626752:12345-0@lo:101: 00010000:00010000:0.0:1788263105.387828:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263105.387840:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cb03a0c9/0x4b1103cba666ef2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666ef26 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263105.387860:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cb03a0c9/0x4b1103cba666ef2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666ef26 expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263105.387870:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cb03a0c9/0x4b1103cba666ef2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666ef26 expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263105.387879:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cb03a0c9, rc 0) 00000100:00100000:0.0:1788263105.387921:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000535f943a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+10:6468:x1875129709626752:12345-0@lo:101: Request processed in 112us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263105.387928:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788263105.387956:0:6468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dddea87e pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709626752:0@lo:101: 00010000:00010000:1.0:1788263105.387969:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000c623b44b/0x4b1103cba666ef26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666ef2d expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.387988:0:6468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000c623b44b/0x4b1103cba666ef26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666ef2d expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263105.388535:0:6468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dddea87e pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709626880:0@lo:256: 00000100:00100000:1.0:1788263105.388569:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263105.389058:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709626880 00000100:00100000:2.0:1788263105.389065:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709626880 00000100:00100000:2.0:1788263105.389092:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788263105.389098:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000096b199a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+10:6468:x1875129709626880:12345-0@lo:256: 00000100:00100000:1.0:1788263105.389113:0:6468:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b11ef904 going to sleep for 11 seconds 20000000:01000000:2.0:1788263105.389114:0:6484:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788263105.389121:0:6484:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788263105.389187:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000096b199a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+10:6468:x1875129709626880:12345-0@lo:256: Request processed in 89us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263105.389204:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788263105.389702:0:6468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dddea87e pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709626880:0@lo:256: 10000000:01000000:1.0:1788263105.390899:0:6468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788263105.390921:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000c623b44b/0x4b1103cba666ef26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666ef2d expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.390933:0:6468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000c623b44b/0x4b1103cba666ef26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666ef2d expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263105.390941:0:6468:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff3888e6000 from 1 10000000:01000000:1.0:1788263105.390944:0:6468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788263105.390975:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 0000000063857390/0x4b1103cba666ef34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.390982:0:6468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 0000000063857390/0x4b1103cba666ef34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.390991:0:6468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 0000000063857390/0x4b1103cba666ef34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263105.391010:0:6468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dddea87e pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709627008:0@lo:101: 00000100:00100000:1.0:1788263105.391726:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263105.391785:0:6468:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b11ef904 going to sleep for 11 seconds 00000100:00100000:2.0:1788263105.391823:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709627008 00000100:00100000:2.0:1788263105.391831:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709627008 00000100:00100000:2.0:1788263105.391879:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788263105.391887:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a737eab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+10:6468:x1875129709627008:12345-0@lo:101: 00010000:00010000:2.0:1788263105.391898:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263105.391912:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001d212f4c/0x4b1103cba666ef3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666ef34 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263105.391935:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001d212f4c/0x4b1103cba666ef3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666ef34 expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263105.391945:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001d212f4c/0x4b1103cba666ef3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666ef34 expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263105.391953:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001d212f4c, rc 0) 00000100:00100000:2.0:1788263105.392000:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a737eab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+11:6468:x1875129709627008:12345-0@lo:101: Request processed in 114us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263105.392006:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788263105.392072:0:6468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dddea87e pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709627008:0@lo:101: 00010000:00010000:1.0:1788263105.392085:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 0000000063857390/0x4b1103cba666ef34 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666ef3b expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.392095:0:6468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 0000000063857390/0x4b1103cba666ef34 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666ef3b expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263105.392153:0:6468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dddea87e pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709627136:0@lo:501: 00000100:00100000:1.0:1788263105.392181:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263105.392238:0:6468:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b11ef904 going to sleep for 11 seconds 00000100:00100000:3.0:1788263105.392270:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709627136 00000100:00100000:3.0:1788263105.392275:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709627136 00000100:00100000:3.0:1788263105.392344:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788263105.392353:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0730615 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+11:6468:x1875129709627136:12345-0@lo:501: 00000100:00100000:3.0:1788263105.392512:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0730615 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+11:6468:x1875129709627136:12345-0@lo:501: Request processed in 161us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263105.392519:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788263105.392574:0:6468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dddea87e pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709627136:0@lo:501: 00000100:00100000:1.0:1788263105.392670:0:6468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dddea87e pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709627264:0@lo:503: 00000100:00100000:1.0:1788263105.392714:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263105.395048:0:6468:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b11ef904 going to sleep for 11 seconds 00000100:00100000:2.0:1788263105.397872:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709627264 00000100:00100000:2.0:1788263105.397886:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709627264 00000100:00100000:2.0:1788263105.397991:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788263105.398001:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000793d550e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+11:6468:x1875129709627264:12345-0@lo:503: 00000040:00080000:2.0:1788263105.398054:0:6484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788263105.398137:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000793d550e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+11:6468:x1875129709627264:12345-0@lo:503: Request processed in 138us (5423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263105.398145:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788263105.398233:0:6468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dddea87e pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709627264:0@lo:503: 00000040:00080000:1.0:1788263105.399286:0:6517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788263105.404928:0:6468:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788263105.404962:0:6468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788263105.404989:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 0000000063857390/0x4b1103cba666ef34 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666ef3b expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263105.405001:0:6468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 0000000063857390/0x4b1103cba666ef34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666ef3b expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263105.405072:0:6468:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788263105.405074:0:6468:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ff3888e6000 10000000:01000000:3.0:1788263105.405077:0:6468:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ff3888e6000 10000000:01000000:3.0:1788263105.405080:0:6468:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788263105.405085:0:6468:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ff3888e6000 from 1 10000000:01000000:3.0:1788263105.405087:0:6468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788263105.405119:0:6468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000b9c30f41/0x4b1103cba666ef42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263105.405126:0:6468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000b9c30f41/0x4b1103cba666ef42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263105.405136:0:6468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000b9c30f41/0x4b1103cba666ef42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263105.405156:0:6468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c4b1b29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709627392:0@lo:101: 00000100:00100000:3.0:1788263105.405211:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263105.405285:0:6468:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e35e4fc4 going to sleep for 11 seconds 00000100:00100000:2.0:1788263105.405498:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709627392 00000100:00100000:2.0:1788263105.405510:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709627392 00000100:00100000:2.0:1788263105.405575:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788263105.405636:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033d26ceb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+11:6468:x1875129709627392:12345-0@lo:101: 00010000:00010000:2.0:1788263105.405655:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263105.405664:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000017fad4d8/0x4b1103cba666ef49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666ef42 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263105.405684:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000017fad4d8/0x4b1103cba666ef49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666ef42 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263105.405692:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000017fad4d8/0x4b1103cba666ef49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666ef42 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263105.405701:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000017fad4d8, rc 0) 00000100:00100000:2.0:1788263105.405736:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033d26ceb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:6468:x1875129709627392:12345-0@lo:101: Request processed in 101us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263105.405742:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788263105.405888:0:6468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c4b1b29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709627392:0@lo:101: 00010000:00010000:1.0:1788263105.405902:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000b9c30f41/0x4b1103cba666ef42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666ef49 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.405910:0:6468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000b9c30f41/0x4b1103cba666ef42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666ef49 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263105.405958:0:6468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dddea87e pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709627520:0@lo:501: 00000100:00100000:1.0:1788263105.405982:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263105.408204:0:6468:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f4a8fac6 going to sleep for 11 seconds 00000100:00100000:3.0:1788263105.408294:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709627520 00000100:00100000:3.0:1788263105.408303:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709627520 00000100:00100000:3.0:1788263105.408347:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788263105.408354:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057c4e9b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:6468:x1875129709627520:12345-0@lo:501: 00000100:00100000:3.0:1788263105.408944:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057c4e9b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:6468:x1875129709627520:12345-0@lo:501: Request processed in 589us (2960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263105.408970:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788263105.409101:0:6468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dddea87e pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709627520:0@lo:501: 00000100:00100000:1.0:1788263105.409148:0:6468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dddea87e pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709627648:0@lo:503: 00000100:00100000:1.0:1788263105.409191:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263105.409220:0:6468:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f4a8fac6 going to sleep for 11 seconds 00000100:00100000:2.0:1788263105.409261:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709627648 00000100:00100000:2.0:1788263105.409266:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709627648 00000100:00100000:2.0:1788263105.409297:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788263105.409304:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000832f527 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:6468:x1875129709627648:12345-0@lo:503: 00000100:00100000:2.0:1788263105.409392:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000832f527 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:6468:x1875129709627648:12345-0@lo:503: Request processed in 89us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263105.409399:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788263105.409462:0:6468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dddea87e pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709627648:0@lo:503: 00000100:00100000:1.0:1788263105.409982:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dddea87e pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:6518:1875129709627776:0@lo:502: 00000100:00100000:1.0:1788263105.410020:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263105.410050:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set 0000000037f2a074 going to sleep for 11 seconds 00000100:00100000:0.0:1788263105.410092:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709627776 00000100:00100000:0.0:1788263105.410097:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709627776 00000100:00100000:0.0:1788263105.410124:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788263105.410130:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db2a6456 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:6518:x1875129709627776:12345-0@lo:502: 00000100:00100000:0.0:1788263105.410214:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db2a6456 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:6518:x1875129709627776:12345-0@lo:502: Request processed in 84us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263105.410220:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788263105.410289:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dddea87e pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:6518:1875129709627776:0@lo:502: 00000020:01000004:1.0:1788263105.410340:0:6518:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788263105.410355:0:6518:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000fa0ac51a) 00000020:00000080:1.0:1788263105.410373:0:6518:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788263105.410462:0:6518:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007878465d from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788263105.410467:0:6518:0:(tgt_mount.c:187:server_put_mount()) put mount 000000007878465d from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788263105.410469:0:6518:0:(obd_mount.c:710:lustre_put_lsi()) put 000000007878465d 4 00010000:00080000:1.0:1788263105.410504:0:6518:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009771331d@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.126@tcp at head 00010000:00010000:1.0:1788263105.416993:0:6518:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788263105.417238:0:6518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788263105.417279:0:6518:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788263105.417292:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4b1103cba666ef57 00000100:00080000:1.0:1788263105.417304:0:6518:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788263105.417309:0:6518:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009771331d using connection 192.168.203.126@tcp/0@lo 00000100:00100000:1.0:1788263105.417347:0:6518:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dddea87e x1875129709627904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788263105.417373:0:6518:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788263105.418816:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dddea87e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875129709627904:0@lo:38: 00000100:00100000:3.0:1788263105.418891:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263105.419132:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709627904 00000100:00100000:2.0:1788263105.419141:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709627904 00000100:00100000:2.0:1788263105.419179:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788263105.419186:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075f3fe84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875129709627904:12345-0@lo:38: 00000100:00100000:2.0:1788263105.419288:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075f3fe84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875129709627904:12345-0@lo:38: Request processed in 102us (397us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788263105.419308:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788263105.419401:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788263105.419408:0:3617:0:(import.c:65:import_set_state_nolock()) 000000009771331d lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788263105.419412:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788263105.419415:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dddea87e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875129709627904:0@lo:38: 00000100:00100000:1.0:1788263105.422973:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003bdea1db pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:6518:1875129709628032:0@lo:502: 00000100:00100000:1.0:1788263105.423053:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263105.423874:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b11ef904 going to sleep for 11 seconds 00000100:00100000:2.0:1788263105.424521:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709628032 00000100:00100000:2.0:1788263105.424531:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709628032 00000100:00100000:0.0:1788263105.424702:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788263105.424716:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009895d297 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:6518:x1875129709628032:12345-0@lo:502: 00000100:00100000:0.0:1788263105.425121:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009895d297 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:6518:x1875129709628032:12345-0@lo:502: Request processed in 410us (2068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263105.425129:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788263105.425246:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003bdea1db pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:6518:1875129709628032:0@lo:502: 00000040:00080000:1.0:1788263105.425282:0:6518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788263105.425442:0:6468:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788263105.425464:0:6468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788263105.425486:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000b9c30f41/0x4b1103cba666ef42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666ef49 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263105.425497:0:6468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000b9c30f41/0x4b1103cba666ef42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666ef49 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788263105.425549:0:6468:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788263105.425551:0:6468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788263105.425552:0:6468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263105.425553:0:6468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263105.425554:0:6468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263105.425555:0:6468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263105.425557:0:6468:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788263105.425558:0:6468:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788263105.425559:0:6468:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788263105.425561:0:6468:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788263105.425562:0:6468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263105.425563:0:6468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788263105.425567:0:6468:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788263105.425570:0:6468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788263105.425571:0:6468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788263105.425572:0:6468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263105.425573:0:6468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263105.425574:0:6468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263105.425575:0:6468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263105.425576:0:6468:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788263105.425724:0:6468:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788263105.425725:0:6468:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788263105.425726:0:6468:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788263105.425727:0:6468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263105.425728:0:6468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788263105.425763:0:6468:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788263105.425777:0:6468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000843186aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709628160:0@lo:253: 00000100:00100000:2.0:1788263105.425818:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263105.425886:0:6468:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c6707a19 going to sleep for 11 seconds 00000100:00100000:1.0:1788263105.427783:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709628160 00000100:00100000:1.0:1788263105.427795:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709628160 00000100:00100000:1.0:1788263105.428782:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788263105.428795:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000650adf24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:6468:x1875129709628160:12345-0@lo:253: 20000000:01000000:1.0:1788263105.428828:0:6485:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788263105.428841:0:6485:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788263105.440344:0:6485:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788263105.441057:0:6485:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788263105.441312:0:6507:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788263105.441317:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788263105.441356:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c395bf09/0x4b1103cba666ef5e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263105.441374:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cb03a0c9/0x4b1103cba666ef2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666ef26 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263105.441382:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c395bf09/0x4b1103cba666ef5e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263105.442085:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cb03a0c9/0x4b1103cba666ef2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666ef26 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263105.442102:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cb03a0c9/0x4b1103cba666ef2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666ef26 expref: 12 pid: 6485 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263105.442116:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000021a0cde3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6507:1875129709628288:0@lo:104: 00000100:00100000:0.0:1788263105.442178:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263105.442232:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f9801710 going to sleep for 11 seconds 00000100:00100000:1.0:1788263105.442727:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000650adf24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:6468:x1875129709628160:12345-0@lo:253: Request processed in 13935us (16908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263105.442738:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788263105.443299:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709628288 00000100:00100000:3.0:1788263105.443307:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709628288 00000100:00100000:3.0:1788263105.443341:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788263105.443347:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001889d8f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:6507:x1875129709628288:12345-0@lo:104: 00010000:00010000:3.0:1788263105.443359:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: 00000000c623b44b/0x4b1103cba666ef26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666ef2d expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263105.444047:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000021a0cde3 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6507:1875129709628288:0@lo:104: 00010000:00010000:2.0:1788263105.444070:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c395bf09/0x4b1103cba666ef5e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263105.444268:0:6468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000843186aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:6468:1875129709628160:0@lo:253: 10000000:01000000:0.0:1788263105.444279:0:6468:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788263105.444282:0:6468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788263105.444284:0:6468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788263105.444285:0:6468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788263105.444286:0:6468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788263105.444287:0:6468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788263105.444288:0:6468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788263105.444289:0:6468:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788263105.444291:0:6468:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788263105.444292:0:6468:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788263105.444293:0:6468:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788263105.444295:0:6468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788263105.444296:0:6468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788263105.444306:0:6468:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788263105.444866:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788263105.444874:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001889d8f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:6507:x1875129709628288:12345-0@lo:104: Request processed in 1526us (2696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263105.444891:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788263105.445196:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263105.445203:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 00000000c623b44b/0x4b1103cba666ef26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666ef2d expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.445211:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c623b44b already unused, calling callback (00000000403adcdd) 10000000:00010000:1.0:1788263105.445214:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 00000000c623b44b/0x4b1103cba666ef26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666ef2d expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.445221:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 00000000c623b44b/0x4b1103cba666ef26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666ef2d expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263105.445227:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 00000000c623b44b/0x4b1103cba666ef26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666ef2d expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263105.445250:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788263105.445292:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 00000000c623b44b/0x4b1103cba666ef26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666ef2d expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.445298:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263105.445314:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 00000000c623b44b/0x4b1103cba666ef26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666ef2d expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.445319:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 00000000c623b44b/0x4b1103cba666ef26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666ef2d expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.445344:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263105.445346:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263105.445348:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263105.445543:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263105.445556:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003bdea1db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709628416:0@lo:103: 00000100:00100000:2.0:1788263105.445643:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263105.445844:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709628416 00000100:00100000:1.0:1788263105.445852:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709628416 00010000:00010000:1.0:1788263105.445874:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cb03a0c9/0x4b1103cba666ef2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666ef26 expref: 12 pid: 6485 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263105.445914:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263105.445921:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001eb77073 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:3618:x1875129709628416:12345-0@lo:103: 00010000:00010000:1.0:1788263105.445933:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263105.445937:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cb03a0c9/0x4b1103cba666ef2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666ef26 expref: 12 pid: 6485 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.445947:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cb03a0c9/0x4b1103cba666ef2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666ef26 expref: 12 pid: 6485 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.445961:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cb03a0c9/0x4b1103cba666ef2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666ef26 expref: 12 pid: 6485 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.446731:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c395bf09/0x4b1103cba666ef5e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.446738:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c395bf09/0x4b1103cba666ef5e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788263105.446763:0:6476:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005446702s 00010000:00010000:1.0:1788263105.446767:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c395bf09/0x4b1103cba666ef5e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.446773:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c395bf09/0x4b1103cba666ef5e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.446778:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c395bf09/0x4b1103cba666ef5e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.446784:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c395bf09/0x4b1103cba666ef5e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.446789:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c395bf09 already unused, calling callback (00000000c597375e) 00010000:00010000:1.0:1788263105.446793:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c395bf09/0x4b1103cba666ef5e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.446799:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c395bf09/0x4b1103cba666ef5e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.446816:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c395bf09/0x4b1103cba666ef5e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263105.446825:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263105.446900:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001eb77073 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+11:3618:x1875129709628416:12345-0@lo:103: Request processed in 979us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263105.446909:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788263105.447193:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003bdea1db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709628416:0@lo:103: 00010000:00010000:2.0:1788263105.447224:0:6507:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c395bf09/0x4b1103cba666ef5e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263105.447232:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c395bf09/0x4b1103cba666ef5e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263105.447238:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c395bf09/0x4b1103cba666ef5e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1788263105.453689:0:6468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1788263105.453890:0:6468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788263105.454107:0:6468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1788263105.454267:0:6468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788263105.454451:0:6468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1788263105.454617:0:6468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1788263105.463159:0:6468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1788263105.463337:0:6468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788263105.464195:0:6468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1788263105.464375:0:6468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1788263105.465210:0:6468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1788263105.466041:0:6468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1788263105.478468:0:6468:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788263105.490412:0:6468:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788263105.490733:0:6524:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:2.0:1788263105.491565:0:6523:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788263105.491571:0:6523:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788263105.492813:0:6468:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788263105.492992:0:6468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788263105.494161:0:6468:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788263105.494174:0:6468:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788263105.494360:0:6468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788263105.495333:0:6468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788263105.496545:0:6468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788263105.496690:0:6468:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788263105.497272:0:6468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788263105.498292:0:6524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788263105.498830:0:6468:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:1.0:1788263105.501676:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788263105.501849:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788263105.502142:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788263105.502273:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788263105.502400:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788263105.502535:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788263105.502709:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788263105.503087:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788263105.503231:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788263105.503377:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788263105.503538:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788263105.503692:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788263105.504067:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788263105.504202:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788263105.504357:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788263105.509315:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788263105.510108:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788263105.510272:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788263105.510402:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788263105.510563:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788263105.512208:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788263105.512381:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00000040:00080000:0.0:1788263105.513252:0:6524:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788263105.513330:0:6524:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788263105.513334:0:6524:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:1.0:1788263105.514045:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788263105.514201:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788263105.514333:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788263105.514862:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788263105.515071:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788263105.515223:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788263105.515355:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788263105.516177:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788263105.516335:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788263105.516545:0:6468:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788263105.517076:0:6468:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1788263105.520974:0:6468:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788263105.521012:0:6468:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffad45c1c8f988 00100000:10000000:1.0:1788263105.521020:0:6468:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788263105.522065:0:6468:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788263105.522081:0:6468:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.126@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788263105.522099:0:6468:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1788263105.522119:0:6468:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788263105.525132:0:6468:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788263105.525321:0:6468:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788263106.095872:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263107.119874:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263108.143850:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263109.171149:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788263109.790102:0:6769:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788263110.193433:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788263110.627974:0:6821:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788263110.628186:0:6821:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:2.0:1788263110.704689:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788263110.704700:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788263110.704703:0:37:0:(import.c:65:import_set_state_nolock()) 000000009771331d lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788263110.704722:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009771331d using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263110.704749:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ca493564 x1875129709628672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788263110.704787:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca493564 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875129709628672:0@lo:38: 00000100:00100000:2.0:1788263110.704854:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263110.705079:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5459e9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709628544:0@lo:400: 00000100:00100000:0.0:1788263110.705114:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263110.705214:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709628544 00000100:00100000:2.0:1788263110.705222:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709628544 00000100:00100000:2.0:1788263110.705267:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788263110.705275:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003362b0dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+11:3620:x1875129709628544:12345-0@lo:400: 00000100:00100000:2.0:1788263110.705328:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003362b0dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+11:3620:x1875129709628544:12345-0@lo:400: Request processed in 53us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263110.705334:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788263110.705406:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5459e9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709628544:0@lo:400: 00000100:00100000:1.0:1788263110.705763:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709628672 00000100:00100000:1.0:1788263110.705768:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709628672 00000100:00100000:1.0:1788263110.705797:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788263110.705802:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b6a4ecd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875129709628672:12345-0@lo:38: 00010000:00080000:1.0:1788263110.705823:0:6493:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 119 last 0 00000020:00000080:1.0:1788263110.705856:0:6493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4b1103cba666ef65 00000004:00100000:1.0:1788263110.706027:0:6493:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788263110.706132:0:6493:0:(import.c:65:import_set_state_nolock()) 00000000bdcec4bd : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788263110.706220:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b6a4ecd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875129709628672:12345-0@lo:38: Request processed in 416us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263110.706226:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788263110.709377:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ca493564 x1875129709628672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788263120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788263110.709399:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788263110.709407:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788263110.709412:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788263110.709415:0:3617:0:(import.c:65:import_set_state_nolock()) 000000009771331d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788263110.709422:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca493564 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875129709628672:0@lo:38: 00010000:00010000:1.0:1788263111.217010:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263112.242376:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263113.271511:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788263113.341408:0:6922:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788263113.342010:0:6922:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1788263113.776216:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788263113.776225:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ff3888e6000 from 3 10000000:01000000:2.0:1788263113.776229:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788263113.776277:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 0000000063be67eb/0x4b1103cba666ef6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263113.776289:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 0000000063be67eb/0x4b1103cba666ef6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263113.776313:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 0000000063be67eb/0x4b1103cba666ef6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263113.776335:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca493564 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709628800:0@lo:101: 00000100:00100000:2.0:1788263113.776468:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263113.776612:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709628800 00000100:00100000:1.0:1788263113.776620:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709628800 00000100:00100000:1.0:1788263113.776663:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788263113.776671:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a51bc76e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+11:6489:x1875129709628800:12345-0@lo:101: 00010000:00010000:1.0:1788263113.776683:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263113.776710:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d06da7a5/0x4b1103cba666ef73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666ef6c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263113.776731:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d06da7a5/0x4b1103cba666ef73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666ef6c expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263113.776740:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d06da7a5/0x4b1103cba666ef73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666ef6c expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263113.776758:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d06da7a5, rc 0) 00000100:00100000:1.0:1788263113.776791:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a51bc76e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:6489:x1875129709628800:12345-0@lo:101: Request processed in 121us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263113.776798:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788263113.777053:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c7aea994 going to sleep for 11 seconds 00000100:00100000:2.0:1788263113.777074:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca493564 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709628800:0@lo:101: 00010000:00010000:2.0:1788263113.777087:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 0000000063be67eb/0x4b1103cba666ef6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666ef73 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263113.777094:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 0000000063be67eb/0x4b1103cba666ef6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666ef73 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263113.777137:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca493564 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709628928:0@lo:256: 00000100:00100000:2.0:1788263113.777166:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263113.778745:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709628928 00000100:00100000:0.0:1788263113.778758:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709628928 00000100:00100000:0.0:1788263113.779070:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788263113.779079:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000970af03e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:6489:x1875129709628928:12345-0@lo:256: 20000000:01000000:0.0:1788263113.779115:0:6484:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788263113.779131:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788263113.779134:0:6484:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788263113.779235:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000970af03e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:6489:x1875129709628928:12345-0@lo:256: Request processed in 157us (2068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263113.779242:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788263113.779276:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c7aea994 going to sleep for 11 seconds 00000100:00100000:2.0:1788263113.779298:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca493564 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709628928:0@lo:256: 10000000:01000000:2.0:1788263113.779354:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788263113.779363:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 0000000063be67eb/0x4b1103cba666ef6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666ef73 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263113.779372:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 0000000063be67eb/0x4b1103cba666ef6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666ef73 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263114.294725:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263115.311864:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263115.823773:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000615bd7c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709629184:0@lo:400: 00000100:00100000:0.0:1788263115.823788:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000db19e025 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709629056:0@lo:400: 00000100:00100000:0.0:1788263115.823906:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263115.823910:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263115.824036:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709629184 00000100:00100000:3.0:1788263115.824044:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709629184 00000100:00100000:3.0:1788263115.824086:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788263115.824096:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca493564 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709629184:12345-0@lo:400: 00000100:00100000:3.0:1788263115.824161:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca493564 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709629184:12345-0@lo:400: Request processed in 67us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263115.824179:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788263115.824356:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000615bd7c9 x1875129709629184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263115.824369:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000615bd7c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709629184:0@lo:400: 00000100:00100000:1.0:1788263115.824420:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709629056 00000100:00100000:1.0:1788263115.824425:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709629056 00000100:00100000:1.0:1788263115.824468:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788263115.824476:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000affe1c5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:3621:x1875129709629056:12345-0@lo:400: 00000100:00100000:0.0:1788263115.824634:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000db19e025 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709629056:0@lo:400: 00000100:00100000:1.0:1788263115.824941:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000affe1c5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:3621:x1875129709629056:12345-0@lo:400: Request processed in 466us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263115.824948:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788263116.341135:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263117.361723:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263118.386050:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263119.407882:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263120.434668:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263120.949800:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263120.949823:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004ce1a02b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709629312:0@lo:400: 00000100:00100000:0.0:1788263120.949890:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263120.949949:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709629312 00000100:00100000:0.0:1788263120.949956:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709629312 00000100:00100000:3.0:1788263120.951691:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ceb8ff30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709629440:0@lo:400: 00000100:00100000:3.0:1788263120.951747:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263120.951944:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709629440 00000100:00100000:3.0:1788263120.951951:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709629440 00000100:00100000:3.0:1788263120.951988:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788263120.951996:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007eecfc2e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709629440:12345-0@lo:400: 00000100:00100000:3.0:1788263120.952044:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007eecfc2e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709629440:12345-0@lo:400: Request processed in 49us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263120.952051:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788263120.952084:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ceb8ff30 x1875129709629440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263120.952098:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ceb8ff30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709629440:0@lo:400: 00000100:00100000:0.0:1788263120.960055:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788263120.960076:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044e76d2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:3618:x1875129709629312:12345-0@lo:400: 00000100:00100000:0.0:1788263120.960169:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044e76d2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:3618:x1875129709629312:12345-0@lo:400: Request processed in 102us (10279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263120.960176:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788263120.960256:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004ce1a02b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709629312:0@lo:400: 00010000:00010000:2.0:1788263121.458973:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263122.480987:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788263122.671273:0:7420:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788263122.671277:0:7420:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788263122.671278:0:7420:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788263122.671414:0:7420:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000055741a51 00000020:01000004:2.0:1788263122.671430:0:7420:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1788263122.671439:0:7420:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788263122.671452:0:7420:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000001ed78a3) 00000020:00000080:2.0:1788263122.671466:0:7420:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788263122.723086:0:7420:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1788263122.723160:0:7420:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1788263122.771439:0:7420:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788263122.772105:0:7420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788263122.772116:0:7420:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788263122.772127:0:7420:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b1103cba666ef81 00000020:01000004:2.0:1788263122.772133:0:7420:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788263122.772156:0:7420:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.126@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788263122.772159:0:7420:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788263122.772165:0:7420:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788263122.772191:0:7420:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788263122.772195:0:7420:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.126@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788263122.804990:0:7420:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788263122.805024:0:7420:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.126@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1788263122.805027:0:7420:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788263122.805029:0:7420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788263122.805030:0:7420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263122.805031:0:7420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263122.805032:0:7420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263122.805034:0:7420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263122.805035:0:7420:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788263122.805036:0:7420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788263122.805037:0:7420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788263122.805041:0:7420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263122.805043:0:7420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788263122.805045:0:7420:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1788263122.805047:0:7420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788263122.805048:0:7420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788263122.805049:0:7420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263122.805050:0:7420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263122.805051:0:7420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263122.805051:0:7420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263122.805052:0:7420:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788263122.805053:0:7420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788263122.805054:0:7420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788263122.805054:0:7420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263122.805055:0:7420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788263122.805077:0:7420:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788263122.805094:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005f20fef6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709629568:0@lo:253: 00000100:00100000:2.0:1788263122.805156:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263122.805208:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 0000000031915a75 going to sleep for 11 seconds 00000100:00100000:3.0:1788263122.805563:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709629568 00000100:00100000:3.0:1788263122.805572:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709629568 00000100:00100000:3.0:1788263122.805670:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788263122.805679:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc58c483 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:7420:x1875129709629568:12345-0@lo:253: 20000000:01000000:3.0:1788263122.805709:0:6486:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788263122.805714:0:6486:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1788263122.805718:0:6486:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1788263122.805722:0:6486:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1788263122.805754:0:6486:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1788263122.805973:0:6486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788263122.806100:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788263122.806112:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788263122.806128:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788263122.806144:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788263122.806159:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788263122.806207:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1788263122.806406:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1788263122.806425:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1788263122.806432:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1788263122.806444:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1788263122.806448:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1788263122.806459:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788263122.806606:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788263122.806721:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1788263122.806730:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:3.0:1788263122.806743:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1788263122.806749:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788263122.806821:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1788263122.806830:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:3.0:1788263122.806844:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1788263122.806851:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788263122.806864:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788263122.806935:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788263122.806950:0:6486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1788263122.807024:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1788263122.807033:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1788263122.807046:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1788263122.807061:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1788263122.807079:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1788263122.807085:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1788263122.807097:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788263122.807131:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788263122.807137:0:6486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1788263122.807159:0:6486:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788263122.807166:0:6486:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1788263122.808672:0:7426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1788263122.809108:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788263122.810303:0:6486:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.126@tcp for mdt 20000000:01000000:0.0:1788263122.810307:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:0.0:1788263122.810348:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788263122.810361:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788263122.810376:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788263122.810382:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:0.0:1788263122.810402:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788263122.810410:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1788263122.810422:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1788263122.810440:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1788263122.810524:0:6486:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1788263122.810534:0:6486:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1788263122.816010:0:7427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:1.0:1788263122.816253:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788263122.816280:0:6486:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.126@tcp for mdt 20000000:01000000:1.0:1788263122.816282:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:1.0:1788263122.816298:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788263122.816305:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788263122.816319:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788263122.816325:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:1.0:1788263122.816337:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788263122.816344:0:6486:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1788263122.816380:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788263122.816398:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1788263122.816421:0:6486:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788263122.816424:0:6486:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788263122.816427:0:6486:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788263122.816478:0:6486:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788263122.816481:0:6486:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788263122.822206:0:7428:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1788263122.822392:0:7428:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1788263122.822410:0:7428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788263122.822650:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788263122.822678:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788263122.822714:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788263122.822726:0:6486:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788263122.822729:0:6486:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788263122.826008:0:7429:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788263122.826053:0:7429:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788263122.826071:0:7429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788263122.826282:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1788263122.826306:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1788263122.826319:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1788263122.826329:0:6486:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788263122.826332:0:6486:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788263122.830288:0:7430:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788263122.830334:0:7430:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788263122.830349:0:7430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1788263122.830654:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1788263122.830679:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1788263122.830707:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1788263122.830722:0:6486:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788263122.830724:0:6486:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788263122.830729:0:6486:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788263122.830735:0:6486:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788263122.831949:0:7431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1788263122.834758:0:6486:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788263122.845254:0:6486:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788263122.845515:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ef29a3ed/0x4b1103cba666ef88 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263122.845536:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000061b05237/0x4b1103cba666eebd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666eeb6 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263122.845544:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000037967562/0x4b1103cba666eed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666eed2 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263122.845550:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000017fad4d8/0x4b1103cba666ef49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666ef42 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263122.845557:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ef29a3ed/0x4b1103cba666ef88 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263122.845642:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000017fad4d8/0x4b1103cba666ef49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666ef42 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263122.845667:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000017fad4d8/0x4b1103cba666ef49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666ef42 expref: 12 pid: 6485 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263122.845680:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c20ece8f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6486:1875129709629696:0@lo:104: 00000100:00100000:0.0:1788263122.845743:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263122.845909:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709629696 00000100:00100000:1.0:1788263122.845917:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709629696 00000100:00100000:1.0:1788263122.845968:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788263122.845976:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000533d165d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:6486:x1875129709629696:12345-0@lo:104: 00010000:00010000:1.0:1788263122.845988:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: 00000000b9c30f41/0x4b1103cba666ef42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666ef49 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263122.846042:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788263122.846046:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000533d165d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:6486:x1875129709629696:12345-0@lo:104: Request processed in 72us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263122.846053:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788263122.846058:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263122.846062:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 00000000b9c30f41/0x4b1103cba666ef42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666ef49 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263122.846069:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b9c30f41 already unused, calling callback (00000000403adcdd) 10000000:00010000:2.0:1788263122.846071:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 00000000b9c30f41/0x4b1103cba666ef42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666ef49 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263122.846084:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 00000000b9c30f41/0x4b1103cba666ef42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666ef49 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263122.846091:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 00000000b9c30f41/0x4b1103cba666ef42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666ef49 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263122.846096:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788263122.846096:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000037967562/0x4b1103cba666eed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666eed2 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263122.846104:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000037967562/0x4b1103cba666eed9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666eed2 expref: 12 pid: 6485 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263122.846113:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2896d54 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6486:1875129709629824:0@lo:104: 00010000:00010000:2.0:1788263122.846129:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 00000000b9c30f41/0x4b1103cba666ef42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666ef49 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263122.846135:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788263122.846137:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788263122.846149:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 00000000b9c30f41/0x4b1103cba666ef42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666ef49 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263122.846154:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 00000000b9c30f41/0x4b1103cba666ef42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666ef49 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263122.846165:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263122.846167:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263122.846168:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263122.846210:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005129fdfe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709629952:0@lo:103: 00000100:00100000:3.0:1788263122.846240:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263122.846282:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709629952 00000100:00100000:3.0:1788263122.846286:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709629952 00010000:00010000:3.0:1788263122.846302:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000017fad4d8/0x4b1103cba666ef49 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666ef42 expref: 13 pid: 6485 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263122.846323:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788263122.846329:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ceb8ff30 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+13:3621:x1875129709629952:12345-0@lo:103: 00010000:00010000:3.0:1788263122.846339:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263122.846343:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000017fad4d8/0x4b1103cba666ef49 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666ef42 expref: 13 pid: 6485 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.846352:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000017fad4d8/0x4b1103cba666ef49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666ef42 expref: 13 pid: 6485 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.846365:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263122.846405:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ceb8ff30 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+13:3621:x1875129709629952:12345-0@lo:103: Request processed in 76us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263122.846411:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788263122.846439:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005129fdfe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709629952:0@lo:103: 00010000:00010000:0.0:1788263122.846866:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000061b05237/0x4b1103cba666eebd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666eeb6 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263122.846875:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000061b05237/0x4b1103cba666eebd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666eeb6 expref: 12 pid: 6485 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263122.846883:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb7de28f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6486:1875129709630080:0@lo:104: 00000100:00100000:0.0:1788263122.846904:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263122.847101:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e21dc706 going to sleep for 11 seconds 00010000:00010000:0.0:1788263122.847114:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000017fad4d8/0x4b1103cba666ef49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666ef42 expref: 12 pid: 6485 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263122.847123:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c20ece8f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6486:1875129709629696:0@lo:104: 00000100:00100000:1.0:1788263122.847151:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709629824 00000100:00100000:1.0:1788263122.847155:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709629824 00000100:00100000:1.0:1788263122.847174:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709630080 00000100:00100000:1.0:1788263122.847177:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709630080 00000100:00100000:1.0:1788263122.847189:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788263122.847194:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029c29227 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:6486:x1875129709629824:12345-0@lo:104: 00010000:00010000:1.0:1788263122.847202:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666eed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666eed9 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263122.847345:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788263122.847349:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029c29227 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:6486:x1875129709629824:12345-0@lo:104: Request processed in 155us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263122.847355:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788263122.847368:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788263122.847373:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a313a05 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:6486:x1875129709630080:12345-0@lo:104: 00010000:00010000:1.0:1788263122.847379:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: 000000006b8de930/0x4b1103cba666eeb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666eebd expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263122.847414:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788263122.847418:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a313a05 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:6486:x1875129709630080:12345-0@lo:104: Request processed in 46us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263122.847423:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788263122.847448:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788263122.847453:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666eed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666eed9 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263122.847468:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2896d54 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6486:1875129709629824:0@lo:104: 00000100:00100000:0.0:1788263122.847476:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb7de28f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6486:1875129709630080:0@lo:104: 00010000:00010000:3.0:1788263122.847483:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000068edeed6 already unused, calling callback (00000000403adcdd) 10000000:00010000:3.0:1788263122.847486:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666eed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666eed9 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.847492:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666eed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666eed9 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263122.847495:0:6486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ef29a3ed/0x4b1103cba666ef88 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263122.847497:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666eed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666eed9 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263122.847502:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788263122.847530:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666eed2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666eed9 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.847537:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263122.847557:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666eed2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666eed9 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.847563:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666eed2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666eed9 expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.847573:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263122.847575:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 000000006b8de930/0x4b1103cba666eeb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666eebd expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.847603:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006b8de930 already unused, calling callback (00000000403adcdd) 10000000:00010000:3.0:1788263122.847605:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 000000006b8de930/0x4b1103cba666eeb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666eebd expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.847619:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 000000006b8de930/0x4b1103cba666eeb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666eebd expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263122.847624:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 000000006b8de930/0x4b1103cba666eeb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666eebd expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263122.847628:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788263122.847653:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 000000006b8de930/0x4b1103cba666eeb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666eebd expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.847658:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263122.847662:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 000000006b8de930/0x4b1103cba666eeb6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666eebd expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.847666:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 000000006b8de930/0x4b1103cba666eeb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666eebd expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.847678:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263122.847679:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263122.847681:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263122.847774:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b26849c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709630336:0@lo:103: 00000100:00100000:1.0:1788263122.847812:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788263122.847830:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263122.847838:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788263122.847843:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025267641 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709630208:0@lo:103: 00000100:00100000:3.0:1788263122.847862:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709630336 00000100:00100000:1.0:1788263122.847863:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263122.847866:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709630336 00010000:00010000:3.0:1788263122.847880:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000061b05237/0x4b1103cba666eebd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666eeb6 expref: 12 pid: 6485 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263122.847915:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709630208 00000100:00100000:3.0:1788263122.847919:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709630208 00010000:00010000:3.0:1788263122.847928:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000037967562/0x4b1103cba666eed9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666eed2 expref: 13 pid: 6485 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263122.847940:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788263122.847951:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c4884db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f48257-b19e-4792-92d2-a48eb49d0ad1+13:3619:x1875129709630336:12345-0@lo:103: 00010000:00010000:3.0:1788263122.847960:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263122.847964:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000061b05237/0x4b1103cba666eebd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666eeb6 expref: 13 pid: 6485 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.847972:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000061b05237/0x4b1103cba666eebd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666eeb6 expref: 13 pid: 6485 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.847981:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000061b05237/0x4b1103cba666eebd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666eeb6 expref: 13 pid: 6485 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.847992:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263122.848019:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c4884db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:3619:x1875129709630336:12345-0@lo:103: Request processed in 69us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263122.848024:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788263122.848036:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788263122.848042:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000049718fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f48257-b19e-4792-92d2-a48eb49d0ad1+11:3619:x1875129709630208:12345-0@lo:103: 00010000:00010000:3.0:1788263122.848048:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263122.848052:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000037967562/0x4b1103cba666eed9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666eed2 expref: 11 pid: 6485 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.848059:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000037967562/0x4b1103cba666eed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666eed2 expref: 11 pid: 6485 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.848068:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000037967562/0x4b1103cba666eed9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666eed2 expref: 11 pid: 6485 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.848079:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ef29a3ed/0x4b1103cba666ef88 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263122.848079:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b26849c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709630336:0@lo:103: 00010000:00010000:3.0:1788263122.848092:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ef29a3ed/0x4b1103cba666ef88 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.848103:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ef29a3ed/0x4b1103cba666ef88 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.848109:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ef29a3ed/0x4b1103cba666ef88 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.848115:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ef29a3ed/0x4b1103cba666ef88 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.848121:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ef29a3ed/0x4b1103cba666ef88 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.848125:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ef29a3ed already unused, calling callback (00000000c597375e) 00010000:00010000:3.0:1788263122.848128:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ef29a3ed/0x4b1103cba666ef88 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.848134:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ef29a3ed/0x4b1103cba666ef88 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.848145:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ef29a3ed/0x4b1103cba666ef88 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.848153:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788263122.848184:0:6486:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ef29a3ed/0x4b1103cba666ef88 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263122.848191:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ef29a3ed/0x4b1103cba666ef88 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263122.848197:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ef29a3ed/0x4b1103cba666ef88 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788263122.848212:0:6486:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788263122.848272:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000049718fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f48257-b19e-4792-92d2-a48eb49d0ad1+10:3619:x1875129709630208:12345-0@lo:103: Request processed in 230us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263122.848278:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788263122.848394:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025267641 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709630208:0@lo:103: 00000100:00100000:2.0:1788263122.850320:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc58c483 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+9:7420:x1875129709629568:12345-0@lo:253: Request processed in 44636us (45158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263122.850333:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788263122.850479:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005f20fef6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709629568:0@lo:253: 10000000:01000000:0.0:1788263122.850493:0:7420:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788263122.850496:0:7420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788263122.850497:0:7420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788263122.850498:0:7420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788263122.850499:0:7420:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1788263122.850500:0:7420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788263122.850502:0:7420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788263122.850503:0:7420:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788263122.850505:0:7420:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788263122.850506:0:7420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788263122.850507:0:7420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788263122.850525:0:7420:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000055741a51 from lustre-MDT0001 10000000:01000000:0.0:1788263122.850552:0:7420:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788263122.850555:0:7420:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788263122.850561:0:7420:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ff3b0028000 local copy 10000000:01000000:0.0:1788263122.850564:0:7420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788263122.850621:0:7420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000cb03a0c9/0x4b1103cba666ef8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263122.850656:0:7420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.126@tcp lock: 00000000cb03a0c9/0x4b1103cba666ef8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263122.850663:0:7420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000cb03a0c9/0x4b1103cba666ef8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263122.850679:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb7de28f pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709630464:0@lo:101: 00000100:00100000:0.0:1788263122.851059:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263122.851095:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 0000000077e70558 going to sleep for 11 seconds 00000100:00100000:1.0:1788263122.851096:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709630464 00000100:00100000:1.0:1788263122.851102:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709630464 00000100:00100000:1.0:1788263122.851148:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788263122.851156:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000806abf98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+9:7420:x1875129709630464:12345-0@lo:101: 00010000:00010000:1.0:1788263122.851167:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263122.851178:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002b35bc8e/0x4b1103cba666ef96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666ef8f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263122.851196:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002b35bc8e/0x4b1103cba666ef96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666ef8f expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263122.851204:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002b35bc8e/0x4b1103cba666ef96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666ef8f expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263122.851212:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002b35bc8e, rc 0) 00000100:00100000:1.0:1788263122.851267:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000806abf98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+10:7420:x1875129709630464:12345-0@lo:101: Request processed in 113us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263122.851273:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788263122.851314:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb7de28f pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709630464:0@lo:101: 00010000:00010000:2.0:1788263122.851326:0:7420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000cb03a0c9/0x4b1103cba666ef8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4b1103cba666ef96 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263122.851344:0:7420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000cb03a0c9/0x4b1103cba666ef8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4b1103cba666ef96 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263122.851502:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000086e15ecf pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709630592:0@lo:501: 00000100:00100000:2.0:1788263122.851527:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263122.851549:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 000000000f896c2e going to sleep for 11 seconds 00000100:00100000:0.0:1788263122.851719:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709630592 00000100:00100000:0.0:1788263122.851724:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709630592 00000100:00100000:0.0:1788263122.851756:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788263122.851762:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2591e9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+10:7420:x1875129709630592:12345-0@lo:501: 00000100:00100000:0.0:1788263122.852329:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2591e9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+10:7420:x1875129709630592:12345-0@lo:501: Request processed in 567us (801us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788263122.852336:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788263122.852640:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000086e15ecf pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709630592:0@lo:501: 10000000:01000000:2.0:1788263122.852654:0:7420:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788263122.852674:0:7420:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788263122.852679:0:7420:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000cb03a0c9/0x4b1103cba666ef8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4b1103cba666ef96 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263122.852686:0:7420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000cb03a0c9/0x4b1103cba666ef8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4b1103cba666ef96 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263122.852849:0:7420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: 00000000cb03a0c9/0x4b1103cba666ef8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4b1103cba666ef96 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263122.852875:0:7420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788263122.852957:0:7420:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ff38769d000 10000000:01000000:2.0:1788263122.852963:0:7420:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788263122.852967:0:7420:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ff3b0028000 10000000:01000000:2.0:1788263122.852969:0:7420:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788263122.852972:0:7420:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9ff3b0028000 from 1 10000000:01000000:2.0:1788263122.852974:0:7420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788263122.852995:0:7420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 000000000af84826/0x4b1103cba666ef9d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263122.853017:0:7420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 000000000af84826/0x4b1103cba666ef9d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263122.853026:0:7420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 000000000af84826/0x4b1103cba666ef9d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263122.853040:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000086e15ecf pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709630720:0@lo:101: 00000100:00100000:2.0:1788263122.853075:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263122.853139:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079cbbf9e going to sleep for 11 seconds 00000100:00100000:0.0:1788263122.853172:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709630720 00000100:00100000:0.0:1788263122.853177:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709630720 00010000:00010000:3.0:1788263122.853194:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263122.853205:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 00000000cb03a0c9/0x4b1103cba666ef8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x4b1103cba666ef96 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.853224:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cb03a0c9 already unused, calling callback (00000000403adcdd) 10000000:00010000:3.0:1788263122.853227:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 00000000cb03a0c9/0x4b1103cba666ef8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x4b1103cba666ef96 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.853235:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 00000000cb03a0c9/0x4b1103cba666ef8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x4b1103cba666ef96 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263122.853241:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 00000000cb03a0c9/0x4b1103cba666ef8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x4b1103cba666ef96 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263122.853246:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788263122.853261:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1788263122.853263:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 00000000cb03a0c9/0x4b1103cba666ef8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b1103cba666ef96 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263122.853268:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a98caf78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+10:7420:x1875129709630720:12345-0@lo:101: 00010000:00010000:3.0:1788263122.853269:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263122.853277:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263122.853286:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005816d236/0x4b1103cba666efa4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666ef9d expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.853293:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 00000000cb03a0c9/0x4b1103cba666ef8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b1103cba666ef96 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.853298:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 00000000cb03a0c9/0x4b1103cba666ef8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b1103cba666ef96 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263122.853302:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005816d236/0x4b1103cba666efa4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666ef9d expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263122.853310:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005816d236/0x4b1103cba666efa4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666ef9d expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263122.853311:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263122.853312:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263122.853314:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263122.853320:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1788263122.853322:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005816d236, rc 0) 00000100:00100000:3.0:1788263122.853330:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009bc8b850 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709630848:0@lo:103: 00000100:00100000:0.0:1788263122.853348:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a98caf78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+11:7420:x1875129709630720:12345-0@lo:101: Request processed in 82us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263122.853353:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263122.853354:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788263122.853415:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000086e15ecf pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709630720:0@lo:101: 00010000:00010000:2.0:1788263122.853424:0:7420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 000000000af84826/0x4b1103cba666ef9d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666efa4 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263122.853431:0:7420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 000000000af84826/0x4b1103cba666ef9d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666efa4 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263122.853444:0:7420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788263122.853460:0:7420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 000000000af84826/0x4b1103cba666ef9d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666efa4 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263122.853467:0:7420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 000000000af84826/0x4b1103cba666ef9d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666efa4 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263122.853474:0:7420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ff38769d000 10000000:01000000:2.0:1788263122.853477:0:7420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788263122.853479:0:7420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ff38769d000 from 1 10000000:01000000:2.0:1788263122.853481:0:7420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788263122.853492:0:7420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000906c98ca/0x4b1103cba666efab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263122.853504:0:7420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000906c98ca/0x4b1103cba666efab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263122.853510:0:7420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000906c98ca/0x4b1103cba666efab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263122.853520:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000086e15ecf pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709630976:0@lo:101: 00000100:00100000:2.0:1788263122.853542:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263122.853784:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079cbbf9e going to sleep for 11 seconds 00000100:00100000:1.0:1788263122.853957:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709630976 00000100:00100000:1.0:1788263122.853962:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709630976 00000100:00100000:1.0:1788263122.853984:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788263122.853990:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2baead0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+11:7420:x1875129709630976:12345-0@lo:101: 00010000:00010000:1.0:1788263122.853997:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263122.854005:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005551e0d3/0x4b1103cba666efb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666efab expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263122.854019:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005551e0d3/0x4b1103cba666efb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666efab expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263122.854039:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005551e0d3/0x4b1103cba666efb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666efab expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263122.854045:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005551e0d3, rc 0) 00000100:00100000:1.0:1788263122.854120:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2baead0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:7420:x1875129709630976:12345-0@lo:101: Request processed in 130us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263122.854127:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788263122.854153:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709630848 00000100:00100000:1.0:1788263122.854156:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709630848 00000100:00100000:1.0:1788263122.854184:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263122.854191:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000161fefe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:3621:x1875129709630848:12345-0@lo:103: 00010000:00010000:1.0:1788263122.854199:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263122.854209:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002b35bc8e/0x4b1103cba666ef96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b1103cba666ef8f expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263122.854284:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263122.854313:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000161fefe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+11:3621:x1875129709630848:12345-0@lo:103: Request processed in 123us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263122.854319:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263122.854348:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009bc8b850 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709630848:0@lo:103: 00000100:00100000:2.0:1788263122.854832:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000086e15ecf pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709630976:0@lo:101: 00010000:00010000:2.0:1788263122.854844:0:7420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000906c98ca/0x4b1103cba666efab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666efb2 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263122.854851:0:7420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000906c98ca/0x4b1103cba666efab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666efb2 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263122.854862:0:7420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788263122.854963:0:7420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000906c98ca/0x4b1103cba666efab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666efb2 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263122.854970:0:7420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000906c98ca/0x4b1103cba666efab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666efb2 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263122.854977:0:7420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788263122.854982:0:7420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788263122.854987:0:7420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ff38769d000 10000000:01000000:2.0:1788263122.854989:0:7420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788263122.854992:0:7420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788263122.855001:0:7420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788263122.855019:0:7420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 000000003d516730/0x4b1103cba666efb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263122.855025:0:7420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 000000003d516730/0x4b1103cba666efb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263122.855031:0:7420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 000000003d516730/0x4b1103cba666efb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263122.855044:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000086e15ecf pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709631104:0@lo:101: 00000100:00100000:2.0:1788263122.855074:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263122.855104:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079cbbf9e going to sleep for 11 seconds 00000100:00100000:0.0:1788263122.855153:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709631104 00000100:00100000:0.0:1788263122.855157:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709631104 00000100:00100000:0.0:1788263122.855189:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788263122.855195:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000277e5c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+11:7420:x1875129709631104:12345-0@lo:101: 00010000:00010000:0.0:1788263122.855203:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263122.855211:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ef29a3ed/0x4b1103cba666efc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666efb9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263122.855480:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ef29a3ed/0x4b1103cba666efc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666efb9 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263122.855489:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ef29a3ed/0x4b1103cba666efc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666efb9 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263122.855496:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ef29a3ed, rc 0) 00000100:00100000:0.0:1788263122.855524:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000277e5c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:7420:x1875129709631104:12345-0@lo:101: Request processed in 330us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263122.855530:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788263122.855616:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000086e15ecf pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709631104:0@lo:101: 00010000:00010000:2.0:1788263122.855625:0:7420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 000000003d516730/0x4b1103cba666efb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666efc0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263122.855646:0:7420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 000000003d516730/0x4b1103cba666efb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666efc0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263122.855734:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000086e15ecf pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709631232:0@lo:501: 00000100:00100000:2.0:1788263122.855757:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263122.855783:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079cbbf9e going to sleep for 11 seconds 00000100:00100000:0.0:1788263122.855880:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709631232 00000100:00100000:0.0:1788263122.855892:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709631232 00000100:00100000:0.0:1788263122.855917:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788263122.855923:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f374ec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:7420:x1875129709631232:12345-0@lo:501: 00000100:00100000:0.0:1788263122.856011:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f374ec2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:7420:x1875129709631232:12345-0@lo:501: Request processed in 88us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263122.856026:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788263122.856189:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000086e15ecf pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709631232:0@lo:501: 00000100:00100000:2.0:1788263122.856211:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000086e15ecf pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709631360:0@lo:503: 00000100:00100000:2.0:1788263122.856259:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263122.856284:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079cbbf9e going to sleep for 11 seconds 00000100:00100000:0.0:1788263122.856367:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709631360 00000100:00100000:0.0:1788263122.856433:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709631360 00000100:00100000:0.0:1788263122.856460:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788263122.856466:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2b0c78a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:7420:x1875129709631360:12345-0@lo:503: 00000100:00100000:0.0:1788263122.856533:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2b0c78a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:7420:x1875129709631360:12345-0@lo:503: Request processed in 67us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263122.856540:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788263122.856641:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000086e15ecf pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709631360:0@lo:503: 00000040:00080000:0.0:1788263122.857139:0:7420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788263122.857461:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2896d54 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709631488:0@lo:502: 00000100:00100000:0.0:1788263122.857505:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263122.857539:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 0000000008a7f5ea going to sleep for 11 seconds 00000100:00100000:3.0:1788263122.857545:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709631488 00000100:00100000:3.0:1788263122.857555:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709631488 00000100:00100000:3.0:1788263122.857602:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788263122.857608:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002de2f246 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:7420:x1875129709631488:12345-0@lo:502: 00000100:00100000:3.0:1788263122.857747:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002de2f246 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:7420:x1875129709631488:12345-0@lo:502: Request processed in 140us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263122.857755:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788263122.858087:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2896d54 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709631488:0@lo:502: 00000040:00080000:0.0:1788263122.858324:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788263122.858351:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1788263122.858364:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1788263122.858443:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1788263122.858459:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1788263122.858471:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1788263122.858484:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1788263122.858497:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1788263122.858510:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1788263122.858521:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1788263122.858537:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1788263122.858551:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1788263122.858564:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1788263122.860090:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1788263122.860139:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1788263122.860170:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1788263122.860186:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1788263122.860201:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1788263122.860490:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1788263122.860512:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1788263122.860527:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1788263122.860540:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1788263122.860553:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1788263122.861710:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2896d54 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709631616:0@lo:502: 00000100:00100000:0.0:1788263122.861809:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263122.861855:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 0000000008a7f5ea going to sleep for 11 seconds 00000100:00100000:3.0:1788263122.861979:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709631616 00000100:00100000:3.0:1788263122.861988:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709631616 00000100:00100000:3.0:1788263122.862040:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788263122.862048:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f3f568a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:7420:x1875129709631616:12345-0@lo:502: 00000100:00100000:3.0:1788263122.862167:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f3f568a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:7420:x1875129709631616:12345-0@lo:502: Request processed in 120us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263122.862174:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788263122.862333:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2896d54 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709631616:0@lo:502: 00000040:00080000:2.0:1788263122.862470:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1788263122.862483:0:7420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1788263122.863103:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263122.863114:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263122.863117:0:7432:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788263122.863124:0:7432:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788263122.863128:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788263122.863141:0:7432:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000006362a39a) 00000020:00000080:2.0:1788263122.863158:0:7432:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1788263122.863163:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788263122.863251:0:7432:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788263122.863258:0:7432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b1103cba666efce 00000020:00000080:2.0:1788263122.863520:0:7432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788263122.863525:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263122.863528:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263122.863530:0:7432:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788263122.863533:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263122.863536:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263122.863537:0:7432:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788263122.863539:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788263122.863545:0:7432:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000006bee7f44) 00000020:00000080:2.0:1788263122.863555:0:7432:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1788263122.863558:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788263122.863560:0:7432:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788263122.863562:0:7432:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788263122.863568:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788263122.863665:0:7432:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000055741a51 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788263122.863685:0:7432:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000072d249a7) 00000020:00000080:2.0:1788263122.864106:0:7432:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1788263122.864183:0:7432:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788263122.864192:0:7432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b1103cba666efe3 00000020:00000080:2.0:1788263122.864285:0:7432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788263122.864293:0:7432:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788263122.864297:0:7432:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x4b1103cba666efea 00080000:01000000:2.0:1788263122.864303:0:7432:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788263122.864306:0:7432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b1103cba666eff1 00080000:10000000:2.0:1788263122.865058:0:7432:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1788263122.865187:0:7432:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1788263122.983450:0:7432:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1788263122.984888:0:7432:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1788263122.987647:0:7432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788263122.987964:0:7432:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788263123.000326:0:7432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788263123.000340:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263123.000346:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263123.000348:0:7432:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788263123.000353:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263123.000359:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263123.000361:0:7432:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788263123.000365:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788263123.000370:0:7432:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:00000080:2.0:1788263123.000401:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788263123.000425:0:7432:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000060c970c0) 00000020:00000080:2.0:1788263123.000446:0:7432:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788263123.000452:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788263123.000555:0:7432:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788263123.000561:0:7432:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788263123.000568:0:7432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b1103cba666efff 00010000:00080000:2.0:1788263123.000641:0:7432:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000dca1189f@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.126@tcp at head 00010000:00010000:2.0:1788263123.002873:0:7432:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1788263123.015271:0:7432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788263123.015284:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788263123.015320:0:7432:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788263123.015340:0:7432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b1103cba666f006 00000100:00080000:2.0:1788263123.015352:0:7432:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788263123.015357:0:7432:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000dca1189f using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263123.015394:0:7432:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000086e15ecf x1875129709631744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788263123.015435:0:7432:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1788263123.015486:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263123.015490:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263123.015492:0:7432:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788263123.015495:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788263123.015497:0:7432:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788263123.015499:0:7432:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788263123.015501:0:7432:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788263123.015502:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788263123.015504:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263123.015505:0:7432:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788263123.015508:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263123.015512:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263123.015513:0:7432:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788263123.015516:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788263123.015545:0:7432:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788263123.015558:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263123.015560:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263123.015562:0:7432:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788263123.015564:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263123.015567:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263123.015568:0:7432:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788263123.015570:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788263123.015572:0:7432:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788263123.015623:0:7432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263123.015626:0:7432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263123.015628:0:7432:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788263123.016039:0:7432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:2.0:1788263123.016215:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788263123.016227:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef5fb044 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709631872:0@lo:400: 00000100:00100000:2.0:1788263123.016299:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263123.016352:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788263123.016360:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fe9b9618 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709632000:0@lo:400: 00000100:00100000:2.0:1788263123.016385:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263123.016416:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709631872 00000100:00100000:2.0:1788263123.016422:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709631872 00000100:00100000:2.0:1788263123.016456:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788263123.016464:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2da8922 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:3620:x1875129709631872:12345-0@lo:400: 00000100:00100000:2.0:1788263123.016505:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2da8922 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:3620:x1875129709631872:12345-0@lo:400: Request processed in 43us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263123.016512:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788263123.016538:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709632000 00000100:00100000:2.0:1788263123.016542:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709632000 00000100:00100000:2.0:1788263123.016566:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788263123.016572:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000110b4915 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709632000:12345-0@lo:400: 00000100:00100000:2.0:1788263123.016624:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000110b4915 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709632000:12345-0@lo:400: Request processed in 54us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263123.016644:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788263123.016683:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fe9b9618 x1875129709632000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263123.016706:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fe9b9618 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709632000:0@lo:400: 00000100:00100000:2.0:1788263123.016731:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef5fb044 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709631872:0@lo:400: 00000020:01000000:3.0:1788263123.016987:0:7420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1788263123.017015:0:7420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788263123.017036:0:7420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 000000003d516730/0x4b1103cba666efb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666efc0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263123.017046:0:7420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 000000003d516730/0x4b1103cba666efb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666efc0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263123.017054:0:7420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ff38769d000 from 1 10000000:01000000:3.0:1788263123.017057:0:7420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788263123.017080:0:7420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666f00d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263123.017094:0:7420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666f00d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263123.017103:0:7420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666f00d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263123.017118:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a65b6a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709632128:0@lo:101: 00000100:00100000:3.0:1788263123.017148:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263123.017168:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d6698210 going to sleep for 11 seconds 00000100:00100000:0.0:1788263123.017603:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000086e15ecf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709631744:0@lo:38: 00000100:00100000:0.0:1788263123.017680:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263123.017728:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709632128 00000100:00100000:0.0:1788263123.017733:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709632128 00000100:00100000:0.0:1788263123.017758:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788263123.017775:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000dba5d25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:7420:x1875129709632128:12345-0@lo:101: 00010000:00010000:0.0:1788263123.017785:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263123.017806:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009ac5d368/0x4b1103cba666f014 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f00d expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263123.017830:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009ac5d368/0x4b1103cba666f014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f00d expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263123.017839:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009ac5d368/0x4b1103cba666f014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f00d expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263123.017848:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009ac5d368, rc 0) 00000100:00100000:0.0:1788263123.017878:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000dba5d25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+13:7420:x1875129709632128:12345-0@lo:101: Request processed in 104us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263123.018132:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788263123.018211:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709631744 00000100:00100000:2.0:1788263123.018226:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709631744 00000100:00100000:2.0:1788263123.018253:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788263123.018257:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c20ece8f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875129709631744:12345-0@lo:38: 00010000:00080000:2.0:1788263123.018282:0:6496:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 132 last 0 00000020:00000080:2.0:1788263123.018313:0:6496:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b1103cba666f01b 00000004:00100000:2.0:1788263123.018325:0:6496:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788263123.018330:0:6496:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788263123.018542:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a65b6a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709632128:0@lo:101: 00010000:00010000:3.0:1788263123.018556:0:7420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666f00d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f014 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263123.018565:0:7420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666f00d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f014 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263123.019297:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a65b6a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709632256:0@lo:256: 00000100:00100000:3.0:1788263123.019344:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263123.019375:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d6698210 going to sleep for 11 seconds 00000100:00100000:3.0:1788263123.019395:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709632256 00000100:00100000:3.0:1788263123.019400:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709632256 00000100:00100000:3.0:1788263123.020116:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788263123.020126:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4ec131e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+13:7420:x1875129709632256:12345-0@lo:256: 20000000:01000000:3.0:1788263123.020146:0:6485:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788263123.020823:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788263123.020829:0:6485:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788263123.021386:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4ec131e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+13:7420:x1875129709632256:12345-0@lo:256: Request processed in 1259us (2039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263123.021473:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788263123.021732:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a65b6a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709632256:0@lo:256: 10000000:01000000:2.0:1788263123.022312:0:7420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788263123.022328:0:7420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666f00d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f014 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263123.022338:0:7420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666f00d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f014 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263123.022346:0:7420:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff38769d000 from 1 10000000:01000000:2.0:1788263123.022348:0:7420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788263123.022376:0:7420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 0000000086a7ad1e/0x4b1103cba666f022 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263123.022383:0:7420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 0000000086a7ad1e/0x4b1103cba666f022 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263123.022390:0:7420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 0000000086a7ad1e/0x4b1103cba666f022 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263123.022658:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef5fb044 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709632384:0@lo:101: 00000100:00100000:2.0:1788263123.022704:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263123.024159:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 00000000190c1138 going to sleep for 11 seconds 00000100:00100000:0.0:1788263123.024247:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709632384 00000100:00100000:0.0:1788263123.024256:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709632384 00000100:00100000:0.0:1788263123.024295:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788263123.024302:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003833e6d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+13:7420:x1875129709632384:12345-0@lo:101: 00010000:00010000:0.0:1788263123.024317:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263123.024332:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cb03a0c9/0x4b1103cba666f029 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f022 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263123.024357:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cb03a0c9/0x4b1103cba666f029 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f022 expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263123.024365:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cb03a0c9/0x4b1103cba666f029 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f022 expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263123.024373:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cb03a0c9, rc 0) 00000100:00100000:0.0:1788263123.024439:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003833e6d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:7420:x1875129709632384:12345-0@lo:101: Request processed in 137us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263123.024445:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788263123.024527:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef5fb044 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709632384:0@lo:101: 00010000:00010000:2.0:1788263123.024541:0:7420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 0000000086a7ad1e/0x4b1103cba666f022 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f029 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263123.024559:0:7420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 0000000086a7ad1e/0x4b1103cba666f022 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f029 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263123.024714:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef5fb044 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709632512:0@lo:501: 00000100:00100000:2.0:1788263123.024746:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263123.024773:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 00000000190c1138 going to sleep for 11 seconds 00000100:00100000:0.0:1788263123.025136:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709632512 00000100:00100000:0.0:1788263123.025141:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709632512 00000100:00100000:0.0:1788263123.025162:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788263123.025167:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdea7e5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:7420:x1875129709632512:12345-0@lo:501: 00000100:00100000:0.0:1788263123.025265:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdea7e5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:7420:x1875129709632512:12345-0@lo:501: Request processed in 98us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263123.025272:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788263123.025398:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef5fb044 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709632512:0@lo:501: 00000100:00100000:2.0:1788263123.025434:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef5fb044 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709632640:0@lo:503: 00000100:00100000:2.0:1788263123.025470:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263123.025492:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 00000000190c1138 going to sleep for 11 seconds 00000100:00100000:0.0:1788263123.025528:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709632640 00000100:00100000:0.0:1788263123.025533:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709632640 00000100:00100000:0.0:1788263123.025557:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788263123.025562:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f4f8ece pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:7420:x1875129709632640:12345-0@lo:503: 00000040:00080000:0.0:1788263123.025617:0:6484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788263123.025661:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f4f8ece pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:7420:x1875129709632640:12345-0@lo:503: Request processed in 100us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263123.025667:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788263123.026039:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef5fb044 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709632640:0@lo:503: 00000040:00080000:2.0:1788263123.026280:0:7420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788263123.026327:0:7420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1788263123.026390:0:7420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788263123.027232:0:7437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1788263123.027284:0:7420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788263123.027308:0:7420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788263123.027320:0:7420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 0000000086a7ad1e/0x4b1103cba666f022 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f029 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263123.027330:0:7420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 0000000086a7ad1e/0x4b1103cba666f022 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f029 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263123.027369:0:7420:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788263123.027372:0:7420:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ff38769d000 10000000:01000000:0.0:1788263123.027375:0:7420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ff38769d000 10000000:01000000:0.0:1788263123.027378:0:7420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788263123.027383:0:7420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ff38769d000 from 1 10000000:01000000:0.0:1788263123.027385:0:7420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788263123.027422:0:7420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 0000000037967562/0x4b1103cba666f030 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263123.027430:0:7420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 0000000037967562/0x4b1103cba666f030 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263123.027438:0:7420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 0000000037967562/0x4b1103cba666f030 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263123.027454:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001ad4e190 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709632768:0@lo:101: 00000100:00100000:0.0:1788263123.027508:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263123.027538:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d27047a1 going to sleep for 11 seconds 00000100:00100000:0.0:1788263123.027556:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709632768 00000100:00100000:0.0:1788263123.027561:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709632768 00000100:00100000:0.0:1788263123.027606:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788263123.027613:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee324b36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:7420:x1875129709632768:12345-0@lo:101: 00010000:00010000:0.0:1788263123.027624:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263123.027654:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f827e515/0x4b1103cba666f037 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f030 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263123.027675:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f827e515/0x4b1103cba666f037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f030 expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263123.027683:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f827e515/0x4b1103cba666f037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f030 expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263123.027691:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f827e515, rc 0) 00000100:00100000:0.0:1788263123.027723:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee324b36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:7420:x1875129709632768:12345-0@lo:101: Request processed in 111us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263123.027729:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788263123.027766:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001ad4e190 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709632768:0@lo:101: 00010000:00010000:0.0:1788263123.027777:0:7420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 0000000037967562/0x4b1103cba666f030 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f037 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263123.027784:0:7420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 0000000037967562/0x4b1103cba666f030 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f037 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263123.027847:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001ad4e190 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709632896:0@lo:501: 00000100:00100000:0.0:1788263123.027879:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263123.027891:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d27047a1 going to sleep for 11 seconds 00000100:00100000:0.0:1788263123.027902:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709632896 00000100:00100000:0.0:1788263123.027905:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709632896 00000100:00100000:0.0:1788263123.027920:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788263123.027924:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001782fedf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:7420:x1875129709632896:12345-0@lo:501: 00000100:00100000:0.0:1788263123.027997:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001782fedf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:7420:x1875129709632896:12345-0@lo:501: Request processed in 72us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263123.028002:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788263123.028026:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001ad4e190 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709632896:0@lo:501: 00000100:00100000:0.0:1788263123.028047:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001ad4e190 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709633024:0@lo:503: 00000100:00100000:0.0:1788263123.028078:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263123.028089:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 0000000063720046 going to sleep for 11 seconds 00000100:00100000:0.0:1788263123.028099:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709633024 00000100:00100000:0.0:1788263123.028102:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709633024 00000100:00100000:0.0:1788263123.028115:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788263123.028119:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009596d214 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:7420:x1875129709633024:12345-0@lo:503: 00000100:00100000:0.0:1788263123.028186:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009596d214 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:7420:x1875129709633024:12345-0@lo:503: Request processed in 66us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263123.028192:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788263123.028224:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001ad4e190 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709633024:0@lo:503: 00000040:00080000:0.0:1788263123.028428:0:7420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788263123.028472:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001ad4e190 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709633152:0@lo:502: 00000100:00100000:0.0:1788263123.028501:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263123.028513:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 0000000063720046 going to sleep for 11 seconds 00000100:00100000:0.0:1788263123.028525:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709633152 00000100:00100000:0.0:1788263123.028533:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709633152 00000100:00100000:0.0:1788263123.028549:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788263123.028554:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017e0987d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:7420:x1875129709633152:12345-0@lo:502: 00000100:00100000:0.0:1788263123.028668:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017e0987d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:7420:x1875129709633152:12345-0@lo:502: Request processed in 114us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263123.028673:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788263123.028708:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001ad4e190 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709633152:0@lo:502: 00000040:00080000:0.0:1788263123.028855:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788263123.028879:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788263123.028891:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788263123.028902:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788263123.028915:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788263123.028927:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788263123.028940:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788263123.028953:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788263123.028974:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788263123.028989:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788263123.029001:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788263123.029014:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788263123.029026:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788263123.029039:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788263123.029051:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788263123.029063:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788263123.029076:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788263123.029089:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788263123.029103:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788263123.029118:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788263123.029131:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788263123.029145:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788263123.029158:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788263123.029172:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788263123.029204:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788263123.029220:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788263123.029233:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788263123.029246:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1788263123.029265:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001ad4e190 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709633280:0@lo:502: 00000100:00100000:0.0:1788263123.029300:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263123.029316:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 00000000624a16d5 going to sleep for 11 seconds 00000100:00100000:0.0:1788263123.029331:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709633280 00000100:00100000:0.0:1788263123.029335:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709633280 00000100:00100000:0.0:1788263123.029353:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788263123.029359:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d7d1077 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:7420:x1875129709633280:12345-0@lo:502: 00000100:00100000:0.0:1788263123.029425:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d7d1077 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:7420:x1875129709633280:12345-0@lo:502: Request processed in 66us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263123.029432:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788263123.029468:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001ad4e190 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709633280:0@lo:502: 00000040:00080000:0.0:1788263123.029502:0:7420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788263123.029509:0:7420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788263123.031367:0:7438:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788263123.031381:0:7438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (0000000014934073) 00000020:00000080:1.0:1788263123.031401:0:7438:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788263123.031536:0:7438:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000055741a51 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788263123.031540:0:7438:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000055741a51 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788263123.031543:0:7438:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000055741a51 3 00010000:00080000:1.0:1788263123.031571:0:7438:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b27fac22@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.126@tcp at head 00000100:00080000:3.0:1788263123.033776:0:6496:0:(import.c:65:import_set_state_nolock()) 00000000bae85c6d : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788263123.034116:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c20ece8f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1875129709631744:12345-0@lo:38: Request processed in 15856us (16435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263123.034132:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788263123.034243:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788263123.034252:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788263123.034259:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788263123.034263:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788263123.034265:0:3617:0:(import.c:65:import_set_state_nolock()) 00000000dca1189f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788263123.034274:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000086e15ecf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709631744:0@lo:38: 00000100:00100000:2.0:1788263123.034438:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b31585f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709633408:0@lo:41: 00000100:00100000:2.0:1788263123.034484:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788263123.037667:0:7438:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1788263123.038046:0:7438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1788263123.038088:0:7438:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788263123.038099:0:7438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x4b1103cba666f045 00000100:00080000:0.0:1788263123.038106:0:7438:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788263123.038111:0:7438:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000b27fac22 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:0.0:1788263123.038145:0:7438:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001ad4e190 x1875129709633536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788263123.038186:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001ad4e190 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875129709633536:0@lo:38: 00000100:00100000:0.0:1788263123.038253:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263123.038326:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709633536 00000100:00100000:0.0:1788263123.038333:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709633536 00000100:00100000:0.0:1788263123.038363:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788263123.038370:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063c5b991 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875129709633536:12345-0@lo:38: 00010000:00080000:0.0:1788263123.038391:0:6491:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 132 last 0 00000020:00000080:0.0:1788263123.038978:0:6491:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x4b1103cba666f04c 00000004:00100000:0.0:1788263123.038994:0:6491:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788263123.039024:0:6491:0:(import.c:65:import_set_state_nolock()) 000000006c2de891 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263123.039088:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063c5b991 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875129709633536:12345-0@lo:38: Request processed in 717us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263123.039095:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788263123.039121:0:7438:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:0.0:1788263123.039327:0:7438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1788263123.039373:0:7420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788263123.039402:0:7420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00080000:3.0:1788263123.039716:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001ad4e190 x1875129709633536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788263133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263123.039727:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788263123.039734:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788263123.039740:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788263123.039745:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788263123.039747:0:3617:0:(import.c:65:import_set_state_nolock()) 00000000b27fac22 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788263123.039753:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001ad4e190 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875129709633536:0@lo:38: 00010000:00010000:0.0:1788263123.044594:0:7420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 0000000037967562/0x4b1103cba666f030 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f037 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263123.044609:0:7420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 0000000037967562/0x4b1103cba666f030 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f037 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788263123.044685:0:7420:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788263123.044687:0:7420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788263123.044688:0:7420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788263123.044690:0:7420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788263123.044691:0:7420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788263123.044694:0:7420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788263123.044696:0:7420:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788263123.044697:0:7420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788263123.044698:0:7420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788263123.044699:0:7420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788263123.044705:0:7420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788263123.044708:0:7420:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1788263123.044710:0:7420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788263123.044711:0:7420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788263123.044712:0:7420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788263123.044713:0:7420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788263123.044714:0:7420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788263123.044715:0:7420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788263123.044716:0:7420:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788263123.044716:0:7420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788263123.044717:0:7420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788263123.044718:0:7420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788263123.044719:0:7420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788263123.044742:0:7420:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788263123.044759:0:7420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ba73d93 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709633664:0@lo:253: 00000100:00100000:0.0:1788263123.045205:0:7420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263123.045245:0:7420:0:(client.c:2715:ptlrpc_set_wait()) set 000000006a2456f3 going to sleep for 11 seconds 40000000:00080000:0.0:1788263123.045367:0:7439:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:1.0:1788263123.046003:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709633664 00000100:00100000:1.0:1788263123.046011:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709633664 00000100:00100000:1.0:1788263123.046063:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788263123.046072:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093da5fb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:7420:x1875129709633664:12345-0@lo:253: 20000000:01000000:1.0:1788263123.047369:0:6484:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788263123.047385:0:6484:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788263123.050329:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709633408 00000100:00100000:0.0:1788263123.050342:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709633408 00000100:00100000:0.0:1788263123.050386:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788263123.050395:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086e15ecf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3619:x1875129709633408:12345-0@lo:41: 00000004:00000024:0.0:1788263123.051064:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788263123.051152:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086e15ecf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3619:x1875129709633408:12345-0@lo:41: Request processed in 757us (16667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263123.051160:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788263123.051556:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b31585f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709633408:0@lo:41: 00000001:00100000:3.0:1788263123.054666:0:6470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1788263123.054710:0:6484:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788263123.054734:0:6484:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1788263123.054842:0:6507:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788263123.054846:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788263123.054864:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001696bfd9/0x4b1103cba666f053 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263123.054950:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d06da7a5/0x4b1103cba666ef73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666ef6c expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263123.054959:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009ac5d368/0x4b1103cba666f014 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f00d expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263123.054965:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001696bfd9/0x4b1103cba666f053 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263123.055017:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009ac5d368/0x4b1103cba666f014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f00d expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263123.055030:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009ac5d368/0x4b1103cba666f014 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f00d expref: 15 pid: 6484 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263123.055043:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008bbee4e6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6507:1875129709633792:0@lo:104: 00000100:00100000:3.0:1788263123.055115:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788263123.055167:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d06da7a5/0x4b1103cba666ef73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666ef6c expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263123.055176:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d06da7a5/0x4b1103cba666ef73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666ef6c expref: 15 pid: 6485 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263123.055183:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000052aaac1a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6507:1875129709633920:0@lo:104: 00000100:00100000:3.0:1788263123.055205:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263123.055218:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set 00000000af1632c2 going to sleep for 11 seconds 00000100:00100000:1.0:1788263123.055423:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709633792 00000100:00100000:1.0:1788263123.055430:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709633792 00000100:00100000:1.0:1788263123.055460:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709633920 00000100:00100000:1.0:1788263123.055463:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709633920 00000100:00100000:1.0:1788263123.055476:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788263123.055483:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de51da15 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:6507:x1875129709633792:12345-0@lo:104: 00010000:00010000:1.0:1788263123.055493:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666f00d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f014 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263123.055553:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788263123.055559:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de51da15 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:6507:x1875129709633792:12345-0@lo:104: Request processed in 77us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263123.055566:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788263123.055615:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788263123.055622:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c21f4245 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:6507:x1875129709633920:12345-0@lo:104: 00010000:00010000:1.0:1788263123.055640:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: 0000000063be67eb/0x4b1103cba666ef6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666ef73 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263123.055708:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263123.055713:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666f00d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f014 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263123.055733:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000068edeed6 already unused, calling callback (00000000403adcdd) 10000000:00010000:1.0:1788263123.055736:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666f00d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f014 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263123.055743:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666f00d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f014 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263123.055749:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666f00d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f014 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263123.055754:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788263123.055809:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666f00d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f014 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263123.055816:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263123.055831:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666f00d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f014 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263123.055837:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 0000000068edeed6/0x4b1103cba666f00d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f014 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263123.055849:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263123.055851:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263123.055853:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263123.055859:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788263123.055868:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000063052b26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709634048:0@lo:103: 00000100:00100000:3.0:1788263123.056086:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008bbee4e6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6507:1875129709633792:0@lo:104: 00000100:00100000:3.0:1788263123.056109:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000052aaac1a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6507:1875129709633920:0@lo:104: 00010000:00010000:3.0:1788263123.056129:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001696bfd9/0x4b1103cba666f053 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263123.056564:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263123.056742:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093da5fb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:7420:x1875129709633664:12345-0@lo:253: Request processed in 10671us (11538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263123.056935:0:7420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ba73d93 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:7420:1875129709633664:0@lo:253: 10000000:01000000:2.0:1788263123.056955:0:7420:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788263123.056958:0:7420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788263123.056961:0:7420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788263123.056962:0:7420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263123.056964:0:7420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263123.056965:0:7420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263123.056966:0:7420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263123.056968:0:7420:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788263123.056969:0:7420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788263123.056971:0:7420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788263123.056972:0:7420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263123.056974:0:7420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788263123.056979:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709634048 00000020:02000000:2.0:1788263123.056984:0:7420:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788263123.056985:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709634048 00010000:00010000:3.0:1788263123.057005:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009ac5d368/0x4b1103cba666f014 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f00d expref: 16 pid: 6484 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263123.057030:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788263123.057042:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078344263 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:3621:x1875129709634048:12345-0@lo:103: 00010000:00010000:3.0:1788263123.057053:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263123.057057:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009ac5d368/0x4b1103cba666f014 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f00d expref: 16 pid: 6484 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263123.057066:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009ac5d368/0x4b1103cba666f014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f00d expref: 16 pid: 6484 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263123.057079:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009ac5d368/0x4b1103cba666f014 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f00d expref: 16 pid: 6484 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263123.057465:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:1.0:1788263123.057519:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788263123.057524:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c21f4245 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:6507:x1875129709633920:12345-0@lo:104: Request processed in 1905us (2319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263123.057531:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788263123.057545:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263123.057549:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 0000000063be67eb/0x4b1103cba666ef6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666ef73 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263123.057557:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000063be67eb already unused, calling callback (00000000403adcdd) 10000000:00010000:1.0:1788263123.057559:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 0000000063be67eb/0x4b1103cba666ef6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666ef73 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263123.057566:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 0000000063be67eb/0x4b1103cba666ef6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666ef73 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263123.057571:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 0000000063be67eb/0x4b1103cba666ef6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666ef73 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263123.057964:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263123.058005:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078344263 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:3621:x1875129709634048:12345-0@lo:103: Request processed in 963us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263123.058011:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 10000000:01000000:1.0:1788263123.058179:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788263123.058212:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 0000000063be67eb/0x4b1103cba666ef6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666ef73 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263123.058218:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263123.058229:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 0000000063be67eb/0x4b1103cba666ef6c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666ef73 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263123.058235:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 0000000063be67eb/0x4b1103cba666ef6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666ef73 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263123.058258:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263123.058260:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263123.058261:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263123.058283:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c91d83cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709634176:0@lo:103: 00000100:00100000:1.0:1788263123.058311:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263123.058339:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000063052b26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709634048:0@lo:103: 00000100:00100000:1.0:1788263123.058362:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709634176 00000100:00100000:1.0:1788263123.058365:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709634176 00010000:00010000:1.0:1788263123.058378:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d06da7a5/0x4b1103cba666ef73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666ef6c expref: 14 pid: 6485 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263123.058395:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788263123.058400:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056669007 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:3621:x1875129709634176:12345-0@lo:103: 00010000:00010000:1.0:1788263123.059487:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263123.059496:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d06da7a5/0x4b1103cba666ef73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666ef6c expref: 14 pid: 6485 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263123.059508:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d06da7a5/0x4b1103cba666ef73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666ef6c expref: 14 pid: 6485 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263123.059520:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d06da7a5/0x4b1103cba666ef73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666ef6c expref: 14 pid: 6485 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263123.059533:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001696bfd9/0x4b1103cba666f053 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263123.059540:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001696bfd9/0x4b1103cba666f053 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788263123.059559:0:6477:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005446702s 00010000:00010000:1.0:1788263123.059562:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001696bfd9/0x4b1103cba666f053 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263123.059568:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001696bfd9/0x4b1103cba666f053 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263123.059851:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001696bfd9/0x4b1103cba666f053 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263123.059857:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001696bfd9/0x4b1103cba666f053 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263123.059862:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001696bfd9 already unused, calling callback (00000000c597375e) 00010000:00010000:1.0:1788263123.059865:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001696bfd9/0x4b1103cba666f053 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263123.059872:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001696bfd9/0x4b1103cba666f053 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263123.060488:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001696bfd9/0x4b1103cba666f053 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263123.060502:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263123.060566:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056669007 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+13:3621:x1875129709634176:12345-0@lo:103: Request processed in 2165us (2254us total) trans 0 rc 0/0 00010000:00010000:3.0:1788263123.060670:0:6507:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001696bfd9/0x4b1103cba666f053 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263123.060679:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001696bfd9/0x4b1103cba666f053 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263123.060684:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001696bfd9/0x4b1103cba666f053 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263123.060996:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788263123.061067:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c91d83cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709634176:0@lo:103: 00080000:10000000:2.0:1788263123.065909:0:7420:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1788263123.066287:0:7420:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788263123.066908:0:7420:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788263123.067179:0:7420:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788263123.067364:0:7420:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788263123.067529:0:7420:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1788263123.069869:0:7420:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788263123.070076:0:7420:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788263123.070243:0:7420:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1788263123.070384:0:7420:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1788263123.070568:0:7420:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1788263123.070761:0:7420:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1788263123.071764:0:7420:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1788263123.071912:0:7443:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788263123.071916:0:7443:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788263123.071981:0:7444:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1788263123.072026:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007041e9e8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7444:1875129709634304:0@lo:700: 00000100:00100000:0.0:1788263123.072084:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263123.072117:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 000000009cadff98 going to sleep for 11 seconds 00000100:00100000:1.0:1788263123.072172:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709634304 00000100:00100000:1.0:1788263123.072183:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709634304 00000100:00100000:1.0:1788263123.072226:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263123.072233:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000baff601b pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7444:x1875129709634304:12345-0@lo:700: 00000040:01000000:2.0:1788263123.072365:0:7420:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1788263123.072655:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000081f1f776 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1875129709634432:0@lo:1000: 00000100:00100000:0.0:1788263123.072688:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263123.072716:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 000000000d77bc6a going to sleep for 11 seconds 00000100:00100000:1.0:1788263123.072776:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709634432 00000100:00100000:1.0:1788263123.072781:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709634432 00000100:00100000:1.0:1788263123.072816:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788263123.072822:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e39d608 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7445:x1875129709634432:12345-0@lo:1000: 00000100:00100000:1.0:1788263123.072886:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e39d608 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7445:x1875129709634432:12345-0@lo:1000: Request processed in 65us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263123.072893:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788263123.072934:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000081f1f776 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1875129709634432:0@lo:1000: 00000040:01000000:1.0:1788263123.072958:0:7445:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1788263123.072976:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c91d83cd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1875129709634560:0@lo:700: 00000100:00100000:1.0:1788263123.072998:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263123.073012:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000be5335e4 going to sleep for 11 seconds 00000100:00100000:3.0:1788263123.073248:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709634560 00000100:00100000:3.0:1788263123.073253:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709634560 00000100:00100000:3.0:1788263123.073287:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788263123.073294:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c4884db pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7445:x1875129709634560:12345-0@lo:700: 00000100:00100000:3.0:1788263123.073340:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c4884db pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7445:x1875129709634560:12345-0@lo:700: Request processed in 47us (341us total) trans 0 rc 0/0 00000040:01000000:2.0:1788263123.073347:0:7420:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:3.0:1788263123.073354:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:2.0:1788263123.073455:0:7420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788263123.073663:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c91d83cd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1875129709634560:0@lo:700: 00000100:00100000:1.0:1788263123.073698:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c91d83cd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7445:1875129709634688:0@lo:900: 00000100:00100000:1.0:1788263123.073739:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263123.073763:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000be5335e4 going to sleep for 11 seconds 00000100:00100000:3.0:1788263123.074009:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709634688 00000100:00100000:3.0:1788263123.074013:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709634688 00000100:00100000:3.0:1788263123.074064:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788263123.074089:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000049718fc pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7445:x1875129709634688:12345-0@lo:900: 00000100:00100000:3.0:1788263123.074136:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000049718fc pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7445:x1875129709634688:12345-0@lo:900: Request processed in 67us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263123.074142:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00000080:2.0:1788263123.074257:0:7420:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788263123.074264:0:7420:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788263123.074398:0:7420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:1.0:1788263123.074645:0:7445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c91d83cd x1875129709634688/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788263139 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263123.074656:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c91d83cd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7445:1875129709634688:0@lo:900: 00000100:00100000:1.0:1788263123.074730:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c91d83cd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1875129709634816:0@lo:1000: 00000100:00100000:1.0:1788263123.074760:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263123.074780:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000602665c3 going to sleep for 11 seconds 00000100:00100000:3.0:1788263123.075032:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709634816 00000100:00100000:3.0:1788263123.075037:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709634816 00000100:00100000:3.0:1788263123.075069:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788263123.075075:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078344263 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7445:x1875129709634816:12345-0@lo:1000: 00000100:00100000:3.0:1788263123.075136:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078344263 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7445:x1875129709634816:12345-0@lo:1000: Request processed in 62us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263123.075141:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788263123.075533:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c91d83cd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1875129709634816:0@lo:1000: 00000004:00080000:1.0:1788263123.075570:0:7445:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000be5335e4 with version 0 00000020:00100000:1.0:1788263123.075609:0:7445:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788263123.075614:0:7445:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000c91d83cd x1875129709635072/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788263123.075627:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c91d83cd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1875129709635072:0@lo:1000: 00000100:00100000:1.0:1788263123.075664:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263123.075681:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000602665c3 going to sleep for 11 seconds 00000100:00100000:3.0:1788263123.076004:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709635072 00000100:00100000:3.0:1788263123.076008:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709635072 00000100:00100000:3.0:1788263123.076040:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788263123.076045:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063052b26 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7445:x1875129709635072:12345-0@lo:1000: 00000040:00080000:2.0:1788263123.076876:0:7420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788263123.081532:0:7420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788263123.081746:0:7420:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788263123.083926:0:7420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788263123.084136:0:7420:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788263123.085182:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788263123.085306:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788263123.085425:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788263123.085550:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788263123.087026:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788263123.087250:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788263123.087387:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788263123.090285:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788263123.090529:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788263123.090694:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788263123.090820:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788263123.090955:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788263123.091113:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788263123.091242:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788263123.091382:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788263123.091503:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788263123.091836:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788263123.091967:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788263123.092128:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788263123.092273:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788263123.092408:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788263123.092534:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788263123.092715:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788263123.092870:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788263123.092999:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788263123.093127:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788263123.093259:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788263123.093389:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788263123.093541:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00000001:00080000:2.0:1788263123.100394:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00100000:10000000:3.0:1788263123.102899:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788263123.103125:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788263123.103297:0:7420:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788263123.103502:0:7420:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1788263123.108376:0:7420:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788263123.108415:0:7420:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffad45c1c8f988 00100000:10000000:3.0:1788263123.108423:0:7420:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000100:00100000:1.0:1788263123.111183:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063052b26 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7445:x1875129709635072:12345-0@lo:1000: Request processed in 35130us (35510us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788263123.111198:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:3.0:1788263123.111386:0:7445:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1788263123.111392:0:7445:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788263123.111405:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c91d83cd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1875129709635072:0@lo:1000: 00000100:00100000:3.0:1788263123.111496:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000052aaac1a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1875129709635200:0@lo:1000: 00000100:00100000:3.0:1788263123.111533:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263123.111600:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 000000001a6a6b77 going to sleep for 11 seconds 00000100:00100000:1.0:1788263123.111732:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709635200 00000100:00100000:1.0:1788263123.111740:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709635200 00000100:00100000:1.0:1788263123.111772:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788263123.111779:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008bbee4e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7445:x1875129709635200:12345-0@lo:1000: 00000100:00100000:1.0:1788263123.111850:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008bbee4e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7445:x1875129709635200:12345-0@lo:1000: Request processed in 72us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263123.111856:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788263123.111964:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000052aaac1a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1875129709635200:0@lo:1000: 00000040:00080000:3.0:1788263123.111981:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788263123.112008:0:7445:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000985b6460 with version 1 00000004:00080000:1.0:1788263123.116922:0:7435:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000cc0ac241 version 1 rpc_version 1 00000020:00100000:1.0:1788263123.116969:0:7435:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788263123.116979:0:7435:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000000718a0f8 x1875129709635456/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788263123.117001:0:7435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000718a0f8 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7435:1875129709635456:0@lo:1000: 00000100:00100000:1.0:1788263123.117067:0:7435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263123.117115:0:7435:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd9ceb2e going to sleep for 11 seconds 00000100:00100000:1.0:1788263123.117140:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709635456 00000100:00100000:1.0:1788263123.117146:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709635456 00000100:00100000:1.0:1788263123.117205:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788263123.117223:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000274b1410 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7435:x1875129709635456:12345-0@lo:1000: 40000000:02000000:0.0:1788263123.118176:0:6498:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000040:00080000:3.0:1788263123.124922:0:7445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788263123.124996:0:7445:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1788263123.125313:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000baff601b pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7444:x1875129709634304:12345-0@lo:700: Request processed in 53076us (53225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263123.125327:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788263123.125497:0:7444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007041e9e8 x1875129709634304/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788263139 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263123.125512:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007041e9e8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7444:1875129709634304:0@lo:700: 40000000:02000000:0.0:1788263123.125524:0:7444:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:2.0:1788263123.125591:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1788263123.125684:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000274b1410 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7435:x1875129709635456:12345-0@lo:1000: Request processed in 8471us (8616us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788263123.125758:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1788263123.125793:0:7435:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788263123.125797:0:7435:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788263123.125812:0:7435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000718a0f8 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7435:1875129709635456:0@lo:1000: 00000020:01000004:3.0:1788263123.126798:0:7420:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788263123.126829:0:7420:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.126@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788263123.126853:0:7420:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788263123.126873:0:7420:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788263123.127656:0:7420:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788263123.127863:0:7420:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:1.0:1788263123.173551:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788263123.181700:0:7444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788263123.181778:0:7444:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788263123.181783:0:7444:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1788263123.504051:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263124.532709:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263125.553360:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263126.575778:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788263127.215257:0:7690:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788263127.602380:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263128.111723:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef5fb044 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709635584:0@lo:41: 00000100:00100000:2.0:1788263128.111799:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263128.111946:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709635584 00000100:00100000:1.0:1788263128.111954:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709635584 00000100:00100000:1.0:1788263128.112004:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788263128.112012:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe9b9618 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709635584:12345-0@lo:41: 00000004:00000024:1.0:1788263128.112048:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1788263128.112092:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe9b9618 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709635584:12345-0@lo:41: Request processed in 82us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263128.112099:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788263128.112517:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef5fb044 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709635584:0@lo:41: 00000100:00100000:1.0:1788263128.112654:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000571d1e19 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709635840:0@lo:400: 00000100:00100000:1.0:1788263128.112691:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263128.112709:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263128.112713:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000780d51a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709635968:0@lo:400: 00000100:00100000:1.0:1788263128.112732:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263128.112765:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709635840 00000100:00100000:1.0:1788263128.112770:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709635840 00000100:00100000:1.0:1788263128.112796:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709635968 00000100:00100000:1.0:1788263128.112799:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709635968 00000100:00100000:1.0:1788263128.112813:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788263128.112818:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b4292d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709635840:12345-0@lo:400: 00000100:00100000:1.0:1788263128.112854:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b4292d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709635840:12345-0@lo:400: Request processed in 36us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263128.112860:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788263128.112871:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788263128.112876:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3be8834 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709635968:12345-0@lo:400: 00000100:00100000:1.0:1788263128.112901:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3be8834 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709635968:12345-0@lo:400: Request processed in 25us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263128.112906:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788263128.112932:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000780d51a0 x1875129709635968/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263128.112942:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000780d51a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709635968:0@lo:400: 00010000:00080000:1.0:1788263128.112950:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000571d1e19 x1875129709635840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263128.112957:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000571d1e19 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709635840:0@lo:400: 00000100:00100000:2.0:1788263128.113027:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000718a0f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709635712:0@lo:400: 00000100:00100000:2.0:1788263128.113057:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263128.113292:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709635712 00000100:00100000:1.0:1788263128.113296:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709635712 00000100:00100000:1.0:1788263128.113332:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788263128.113337:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002eb4d539 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+13:3619:x1875129709635712:12345-0@lo:400: 00000100:00100000:1.0:1788263128.113365:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002eb4d539 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+13:3619:x1875129709635712:12345-0@lo:400: Request processed in 29us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263128.113371:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788263128.113430:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000718a0f8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709635712:0@lo:400: 10000000:01000000:2.0:1788263128.114517:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788263128.114521:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ff38769d000 from 4 10000000:01000000:2.0:1788263128.114525:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788263128.114556:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000db67def0/0x4b1103cba666f05a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263128.114565:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000db67def0/0x4b1103cba666f05a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263128.114573:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000db67def0/0x4b1103cba666f05a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263128.114622:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef5fb044 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709636096:0@lo:101: 00000100:00100000:2.0:1788263128.114661:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263128.114687:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000983bc64f going to sleep for 11 seconds 00000100:00100000:2.0:1788263128.114703:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709636096 00000100:00100000:2.0:1788263128.114708:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709636096 00000100:00100000:2.0:1788263128.114739:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788263128.114746:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db135b0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+13:6489:x1875129709636096:12345-0@lo:101: 00010000:00010000:2.0:1788263128.114755:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263128.114765:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000039f17f55/0x4b1103cba666f061 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f05a expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263128.114785:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000039f17f55/0x4b1103cba666f061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f05a expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263128.114804:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000039f17f55/0x4b1103cba666f061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f05a expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263128.114813:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000039f17f55, rc 0) 00000100:00100000:2.0:1788263128.114842:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db135b0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:6489:x1875129709636096:12345-0@lo:101: Request processed in 98us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263128.114848:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788263128.114880:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef5fb044 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709636096:0@lo:101: 00010000:00010000:2.0:1788263128.114891:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000db67def0/0x4b1103cba666f05a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f061 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263128.114899:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000db67def0/0x4b1103cba666f05a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f061 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263128.114939:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef5fb044 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709636224:0@lo:256: 00000100:00100000:2.0:1788263128.114965:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263128.114978:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000983bc64f going to sleep for 11 seconds 00000100:00100000:2.0:1788263128.114989:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709636224 00000100:00100000:2.0:1788263128.114992:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709636224 00000100:00100000:2.0:1788263128.115015:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788263128.115021:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec08e9ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:6489:x1875129709636224:12345-0@lo:256: 20000000:01000000:2.0:1788263128.115033:0:6485:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788263128.115047:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788263128.115050:0:6485:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788263128.115117:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec08e9ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:6489:x1875129709636224:12345-0@lo:256: Request processed in 96us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263128.115125:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788263128.115158:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef5fb044 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709636224:0@lo:256: 10000000:01000000:2.0:1788263128.115192:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788263128.115196:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000db67def0/0x4b1103cba666f05a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f061 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263128.115204:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000db67def0/0x4b1103cba666f05a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f061 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263128.115211:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788263128.115213:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ff3888e6000 from 21 10000000:01000000:2.0:1788263128.115215:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788263128.115227:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 000000008f0e94c0/0x4b1103cba666f068 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263128.115233:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 000000008f0e94c0/0x4b1103cba666f068 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263128.115238:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 000000008f0e94c0/0x4b1103cba666f068 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263128.115248:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef5fb044 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709636352:0@lo:101: 00000100:00100000:2.0:1788263128.115271:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263128.115283:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000983bc64f going to sleep for 11 seconds 00000100:00100000:2.0:1788263128.115293:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709636352 00000100:00100000:2.0:1788263128.115296:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709636352 00000100:00100000:2.0:1788263128.115317:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788263128.115726:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000079e9ce8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:6489:x1875129709636352:12345-0@lo:101: 00010000:00010000:2.0:1788263128.115736:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263128.115745:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002fbcb647/0x4b1103cba666f06f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f068 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263128.115765:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002fbcb647/0x4b1103cba666f06f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f068 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263128.115773:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002fbcb647/0x4b1103cba666f06f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f068 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263128.115779:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002fbcb647, rc 0) 00000100:00100000:2.0:1788263128.115815:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000079e9ce8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:6489:x1875129709636352:12345-0@lo:101: Request processed in 493us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263128.115820:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788263128.124782:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef5fb044 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709636352:0@lo:101: 00010000:00010000:0.0:1788263128.124812:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 000000008f0e94c0/0x4b1103cba666f068 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f06f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263128.124824:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 000000008f0e94c0/0x4b1103cba666f068 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f06f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263128.124918:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007041e9e8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709636480:0@lo:501: 00000100:00100000:0.0:1788263128.124974:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263128.125019:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bb323ad3 going to sleep for 11 seconds 00000100:00100000:2.0:1788263128.125448:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709636480 00000100:00100000:2.0:1788263128.125456:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709636480 00000100:00100000:2.0:1788263128.125501:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788263128.125509:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db44407e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:6489:x1875129709636480:12345-0@lo:501: 00000100:00100000:2.0:1788263128.125650:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db44407e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:6489:x1875129709636480:12345-0@lo:501: Request processed in 142us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263128.125658:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788263128.125690:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007041e9e8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709636480:0@lo:501: 00000100:00100000:2.0:1788263128.125714:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061d26a85 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709636608:0@lo:503: 00000100:00100000:2.0:1788263128.125751:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263128.125769:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6c6c5b0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263128.125780:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709636608 00000100:00100000:2.0:1788263128.125783:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709636608 00000100:00100000:2.0:1788263128.125804:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788263128.125809:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc9cbf1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:6489:x1875129709636608:12345-0@lo:503: 00000100:00100000:2.0:1788263128.125878:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc9cbf1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:6489:x1875129709636608:12345-0@lo:503: Request processed in 68us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263128.125890:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788263128.125939:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061d26a85 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709636608:0@lo:503: 00000100:00100000:0.0:1788263128.128162:0:7736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000131b6ba6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:7736:1875129709636736:0@lo:502: 00000100:00100000:0.0:1788263128.128227:0:7736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263128.128275:0:7736:0:(client.c:2715:ptlrpc_set_wait()) set 0000000016855d7d going to sleep for 11 seconds 00000100:00100000:2.0:1788263128.129009:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709636736 00000100:00100000:2.0:1788263128.129018:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709636736 00000100:00100000:2.0:1788263128.129059:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788263128.129066:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9bc822c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:7736:x1875129709636736:12345-0@lo:502: 00000100:00100000:2.0:1788263128.129188:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9bc822c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:7736:x1875129709636736:12345-0@lo:502: Request processed in 122us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263128.129196:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788263128.129293:0:7736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000131b6ba6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:7736:1875129709636736:0@lo:502: 00000100:00100000:0.0:1788263128.129341:0:7736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000131b6ba6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:7736:1875129709636864:0@lo:502: 00000100:00100000:0.0:1788263128.129375:0:7736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263128.129402:0:7736:0:(client.c:2715:ptlrpc_set_wait()) set 0000000016855d7d going to sleep for 11 seconds 00000100:00100000:2.0:1788263128.130195:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709636864 00000100:00100000:2.0:1788263128.130203:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709636864 00000100:00100000:2.0:1788263128.130239:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788263128.130246:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002cfc4088 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:7736:x1875129709636864:12345-0@lo:502: 00000100:00100000:2.0:1788263128.130332:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002cfc4088 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:7736:x1875129709636864:12345-0@lo:502: Request processed in 86us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263128.130339:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788263128.130442:0:7736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000131b6ba6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:7736:1875129709636864:0@lo:502: 00000040:00080000:0.0:1788263128.130465:0:7736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788263128.135069:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788263128.135105:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788263128.135114:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 000000008f0e94c0/0x4b1103cba666f068 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f06f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263128.135126:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 000000008f0e94c0/0x4b1103cba666f068 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f06f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263128.135136:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788263128.135138:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ff3888e6000 from 4 10000000:01000000:2.0:1788263128.135141:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788263128.135181:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000ca2fb2a8/0x4b1103cba666f076 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263128.135188:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000ca2fb2a8/0x4b1103cba666f076 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263128.135197:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000ca2fb2a8/0x4b1103cba666f076 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263128.135219:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061d26a85 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709636992:0@lo:101: 00000100:00100000:2.0:1788263128.135278:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263128.135321:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000089186e6 going to sleep for 11 seconds 00000100:00100000:3.0:1788263128.135505:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709636992 00000100:00100000:3.0:1788263128.135512:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709636992 00000100:00100000:3.0:1788263128.135560:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788263128.135606:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ed39d13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:6489:x1875129709636992:12345-0@lo:101: 00010000:00010000:3.0:1788263128.135618:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263128.135629:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000009ec6b03/0x4b1103cba666f07d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f076 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263128.135651:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000009ec6b03/0x4b1103cba666f07d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f076 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263128.135659:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000009ec6b03/0x4b1103cba666f07d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f076 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263128.135667:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000009ec6b03, rc 0) 00000100:00100000:3.0:1788263128.135704:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ed39d13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:6489:x1875129709636992:12345-0@lo:101: Request processed in 130us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263128.135709:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788263128.135883:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061d26a85 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709636992:0@lo:101: 00010000:00010000:2.0:1788263128.135895:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000ca2fb2a8/0x4b1103cba666f076 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f07d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263128.135903:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000ca2fb2a8/0x4b1103cba666f076 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f07d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263128.135963:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061d26a85 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709637120:0@lo:256: 00000100:00100000:2.0:1788263128.135993:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263128.136018:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000089186e6 going to sleep for 11 seconds 00000100:00100000:3.0:1788263128.136120:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709637120 00000100:00100000:3.0:1788263128.136124:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709637120 00000100:00100000:3.0:1788263128.136154:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788263128.136160:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9309075 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:6489:x1875129709637120:12345-0@lo:256: 20000000:01000000:3.0:1788263128.136173:0:6486:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788263128.136187:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788263128.136190:0:6486:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788263128.136255:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9309075 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:6489:x1875129709637120:12345-0@lo:256: Request processed in 96us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263128.136262:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788263128.136629:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061d26a85 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709637120:0@lo:256: 10000000:01000000:2.0:1788263128.136668:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788263128.136672:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000ca2fb2a8/0x4b1103cba666f076 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f07d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263128.136681:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000ca2fb2a8/0x4b1103cba666f076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f07d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263128.136693:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788263128.136695:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788263128.136698:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788263128.136712:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000018f7ed0/0x4b1103cba666f084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263128.136719:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000018f7ed0/0x4b1103cba666f084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263128.136725:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000018f7ed0/0x4b1103cba666f084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263128.136736:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061d26a85 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709637248:0@lo:101: 00000100:00100000:2.0:1788263128.136761:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263128.136785:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000089186e6 going to sleep for 11 seconds 00000100:00100000:3.0:1788263128.138257:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709637248 00000100:00100000:3.0:1788263128.138266:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709637248 00000100:00100000:3.0:1788263128.138315:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788263128.138323:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006539bbac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:6489:x1875129709637248:12345-0@lo:101: 00010000:00010000:3.0:1788263128.138344:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263128.138357:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001696bfd9/0x4b1103cba666f08b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f084 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263128.138380:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001696bfd9/0x4b1103cba666f08b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f084 expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263128.138389:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001696bfd9/0x4b1103cba666f08b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f084 expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263128.138397:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001696bfd9, rc 0) 00000100:00100000:3.0:1788263128.138464:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006539bbac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709637248:12345-0@lo:101: Request processed in 142us (1702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263128.138471:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788263128.138517:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061d26a85 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709637248:0@lo:101: 00010000:00010000:3.0:1788263128.138530:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000018f7ed0/0x4b1103cba666f084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f08b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263128.138537:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000018f7ed0/0x4b1103cba666f084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f08b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263128.138637:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000052aaac1a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709637376:0@lo:501: 00000100:00100000:3.0:1788263128.138665:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263128.138690:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ccb4ad11 going to sleep for 11 seconds 00000100:00100000:3.0:1788263128.138702:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709637376 00000100:00100000:3.0:1788263128.138705:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709637376 00000100:00100000:3.0:1788263128.138727:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788263128.138732:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c65f86c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709637376:12345-0@lo:501: 00000100:00100000:3.0:1788263128.138848:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c65f86c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709637376:12345-0@lo:501: Request processed in 116us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263128.138855:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788263128.138884:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000052aaac1a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709637376:0@lo:501: 00000100:00100000:3.0:1788263128.138923:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000052aaac1a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709637504:0@lo:503: 00000100:00100000:3.0:1788263128.138960:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263128.138972:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ccb4ad11 going to sleep for 11 seconds 00000100:00100000:3.0:1788263128.138983:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709637504 00000100:00100000:3.0:1788263128.138985:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709637504 00000100:00100000:3.0:1788263128.139005:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788263128.139010:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d76d7da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709637504:12345-0@lo:503: 00000100:00100000:3.0:1788263128.139081:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d76d7da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709637504:12345-0@lo:503: Request processed in 71us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263128.139088:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788263128.139124:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000052aaac1a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709637504:0@lo:503: 00000100:00100000:3.0:1788263128.139294:0:7737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000052aaac1a pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:7737:1875129709637632:0@lo:502: 00000100:00100000:3.0:1788263128.139326:0:7737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263128.139345:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709637632 00000100:00100000:3.0:1788263128.139349:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709637632 00000100:00100000:3.0:1788263128.139371:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788263128.139378:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005414166a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:7737:x1875129709637632:12345-0@lo:502: 00000100:00100000:3.0:1788263128.139441:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005414166a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:7737:x1875129709637632:12345-0@lo:502: Request processed in 64us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263128.139448:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788263128.139485:0:7737:0:(client.c:2715:ptlrpc_set_wait()) set 00000000985b6460 going to sleep for 11 seconds 00000100:00100000:3.0:1788263128.139503:0:7737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000052aaac1a pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:7737:1875129709637632:0@lo:502: 00000020:01000000:3.0:1788263128.139523:0:7737:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788263128.139532:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263128.139535:0:7737:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788263128.139544:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788263128.139547:0:7737:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:00000080:3.0:1788263128.139567:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788263128.139618:0:7737:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000478fdefd) 00000020:00000080:3.0:1788263128.139638:0:7737:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1788263128.139645:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788263128.139724:0:7737:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788263128.139730:0:7737:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788263128.139738:0:7737:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b1103cba666f099 00010000:00080000:3.0:1788263128.139762:0:7737:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d9b470f2@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.126@tcp at head 00010000:00010000:2.0:1788263128.149078:0:7737:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1788263128.152302:0:7737:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788263128.152316:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788263128.152359:0:7737:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788263128.152379:0:7737:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b1103cba666f0a0 00000100:00080000:2.0:1788263128.152389:0:7737:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788263128.152394:0:7737:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000d9b470f2 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263128.152426:0:7737:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000298345c7 x1875129709637760/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788263128.152461:0:7737:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:2.0:1788263128.152502:0:7737:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1788263128.152707:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000298345c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709637760:0@lo:38: 00000100:00100000:0.0:1788263128.152772:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263128.152924:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709637760 00000100:00100000:1.0:1788263128.152932:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709637760 00000100:00100000:1.0:1788263128.152964:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788263128.152971:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000131b6ba6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875129709637760:12345-0@lo:38: 00010000:00080000:1.0:1788263128.152994:0:6497:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 137 last 0 00000020:00000080:1.0:1788263128.153023:0:6497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b1103cba666f0a7 00000004:00100000:1.0:1788263128.153037:0:6497:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788263128.153042:0:6497:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1788263128.153329:0:7743:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000d5056e3c x1875129709637888/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263128.153338:0:7743:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e74daa2 going to sleep for 0 seconds 00000020:01000000:2.0:1788263128.155832:0:7737:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263128.155842:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263128.155852:0:7737:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788263128.155856:0:7737:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263128.155860:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263128.155862:0:7737:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788263128.155864:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788263128.155866:0:7737:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788263128.155919:0:7737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033471941 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:7737:1875129709638016:0@lo:502: 00000100:00100000:2.0:1788263128.155996:0:7737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263128.156075:0:7737:0:(client.c:2715:ptlrpc_set_wait()) set 0000000088a03517 going to sleep for 11 seconds 00000100:00080000:1.0:1788263128.163104:0:6497:0:(import.c:65:import_set_state_nolock()) 0000000003af6507 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788263128.163206:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000131b6ba6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1875129709637760:12345-0@lo:38: Request processed in 10232us (10432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263128.163217:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788263128.163621:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788263128.163630:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788263128.163637:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788263128.163641:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788263128.163643:0:3617:0:(import.c:65:import_set_state_nolock()) 00000000d9b470f2 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788263128.163656:0:3617:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000003e74daa2): req@00000000d5056e3c x1875129709637888/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263128.163675:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000298345c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709637760:0@lo:38: 00000100:00100000:2.0:1788263128.163728:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000298345c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709638144:0@lo:41: 00000100:00100000:2.0:1788263128.163761:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263128.163799:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709638144 00000100:00100000:2.0:1788263128.163804:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709638144 00000100:00100000:2.0:1788263128.163834:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788263128.163841:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d994252b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3618:x1875129709638144:12345-0@lo:41: 00000004:00000024:2.0:1788263128.163862:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788263128.163895:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d994252b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3618:x1875129709638144:12345-0@lo:41: Request processed in 54us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263128.163901:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788263128.163930:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000298345c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709638144:0@lo:41: 00000100:00100000:0.0:1788263128.164089:0:7743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263128.164145:0:7743:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e74daa2 going to sleep for 11 seconds 00000100:00100000:3.0:1788263128.165824:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709638016 00000100:00100000:3.0:1788263128.165833:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709638016 00000100:00100000:3.0:1788263128.165912:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788263128.165920:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f124b17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:7737:x1875129709638016:12345-0@lo:502: 00000100:00100000:3.0:1788263128.166042:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f124b17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:7737:x1875129709638016:12345-0@lo:502: Request processed in 123us (10047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263128.166049:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788263128.166100:0:7737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033471941 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:7737:1875129709638016:0@lo:502: 00000020:01000000:3.0:1788263128.166126:0:7737:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788263128.166132:0:7737:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263128.166134:0:7737:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788263128.166138:0:7737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788263128.166219:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788263128.166236:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788263128.166243:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000018f7ed0/0x4b1103cba666f084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f08b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263128.166258:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000018f7ed0/0x4b1103cba666f084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f08b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263128.166267:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788263128.166269:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ff3b0028000 from 1 10000000:01000000:3.0:1788263128.166272:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788263128.166294:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000f94c011c/0x4b1103cba666f0ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263128.166300:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000f94c011c/0x4b1103cba666f0ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263128.166308:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000f94c011c/0x4b1103cba666f0ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263128.166322:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000052aaac1a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709638272:0@lo:101: 00000100:00100000:3.0:1788263128.166349:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263128.166372:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000985b6460 going to sleep for 11 seconds 00000100:00100000:3.0:1788263128.166389:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709638272 00000100:00100000:3.0:1788263128.166392:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709638272 00000100:00100000:3.0:1788263128.166413:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788263128.166419:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000feda913e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709638272:12345-0@lo:101: 00010000:00010000:3.0:1788263128.166426:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263128.166436:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000068edeed6/0x4b1103cba666f0b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f0ae expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263128.166454:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000068edeed6/0x4b1103cba666f0b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f0ae expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263128.166472:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000068edeed6/0x4b1103cba666f0b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f0ae expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263128.166480:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000068edeed6, rc 0) 00000100:00100000:3.0:1788263128.166504:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000feda913e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:6489:x1875129709638272:12345-0@lo:101: Request processed in 86us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263128.166509:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788263128.166533:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000052aaac1a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709638272:0@lo:101: 00010000:00010000:3.0:1788263128.166542:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000f94c011c/0x4b1103cba666f0ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f0b5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263128.166549:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000f94c011c/0x4b1103cba666f0ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f0b5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263128.166621:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000052aaac1a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709638400:0@lo:501: 00000100:00100000:3.0:1788263128.166642:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263128.166652:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000985b6460 going to sleep for 11 seconds 00000100:00100000:3.0:1788263128.166660:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709638400 00000100:00100000:3.0:1788263128.166663:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709638400 00000100:00100000:3.0:1788263128.166678:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788263128.166683:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037384c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:6489:x1875129709638400:12345-0@lo:501: 00000100:00100000:3.0:1788263128.166726:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037384c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:6489:x1875129709638400:12345-0@lo:501: Request processed in 44us (85us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788263128.166732:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788263128.166766:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000052aaac1a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709638400:0@lo:501: 10000000:01000000:3.0:1788263128.166784:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788263128.166791:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000f94c011c/0x4b1103cba666f0ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f0b5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263128.166798:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000f94c011c/0x4b1103cba666f0ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f0b5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263128.174713:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709637888 00000100:00100000:2.0:1788263128.174726:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709637888 00000100:00100000:2.0:1788263128.174784:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788263128.174794:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007041e9e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7743:x1875129709637888:12345-0@lo:1000: 00000100:00100000:2.0:1788263128.174924:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007041e9e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7743:x1875129709637888:12345-0@lo:1000: Request processed in 132us (10835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263128.174933:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788263128.178081:0:7743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d5056e3c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7743:1875129709637888:0@lo:1000: 00000040:01000000:0.0:1788263128.178121:0:7743:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788263128.178160:0:7743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d5056e3c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7743:1875129709638528:0@lo:1000: 00000100:00100000:0.0:1788263128.178217:0:7743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263128.178261:0:7743:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e74daa2 going to sleep for 11 seconds 00000100:00100000:2.0:1788263128.178379:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709638528 00000100:00100000:2.0:1788263128.178385:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709638528 00000100:00100000:2.0:1788263128.178430:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788263128.178438:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081f1f776 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7743:x1875129709638528:12345-0@lo:1000: 00000100:00100000:0.0:1788263128.181864:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081f1f776 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7743:x1875129709638528:12345-0@lo:1000: Request processed in 3421us (3641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263128.181879:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788263128.187013:0:7743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d5056e3c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7743:1875129709638528:0@lo:1000: 00000100:00100000:1.0:1788263128.187087:0:7743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000571d1e19 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7743:1875129709638656:0@lo:700: 00000100:00100000:1.0:1788263128.187138:0:7743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263128.187184:0:7743:0:(client.c:2715:ptlrpc_set_wait()) set 0000000054c0600c going to sleep for 11 seconds 00000100:00100000:0.0:1788263128.196920:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709638656 00000100:00100000:0.0:1788263128.196942:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709638656 00000100:00100000:0.0:1788263128.197008:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788263128.197019:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000780d51a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7743:x1875129709638656:12345-0@lo:700: 00000100:00100000:0.0:1788263128.197156:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000780d51a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7743:x1875129709638656:12345-0@lo:700: Request processed in 140us (10018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263128.197164:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:00000004:2.0:1788263128.198472:0:7747:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000100:00100000:1.0:1788263128.198684:0:7743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000571d1e19 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7743:1875129709638656:0@lo:700: 00000020:00000004:2.0:1788263128.198887:0:7747:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788263128.201200:0:7743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ba73d93 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7743:1875129709638784:0@lo:1000: 00000100:00100000:0.0:1788263128.201264:0:7743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263128.201309:0:7743:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a528674f going to sleep for 11 seconds 00000100:00100000:3.0:1788263128.201477:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709638784 00000100:00100000:3.0:1788263128.201485:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709638784 00000100:00100000:3.0:1788263128.201531:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788263128.201540:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ad4e190 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7743:x1875129709638784:12345-0@lo:1000: 00000100:00100000:3.0:1788263128.201650:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ad4e190 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7743:x1875129709638784:12345-0@lo:1000: Request processed in 112us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263128.201658:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788263128.204675:0:7743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ba73d93 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7743:1875129709638784:0@lo:1000: 00000004:00080000:0.0:1788263128.204749:0:7743:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000c1a3f4ca with version 0 00000020:00100000:0.0:1788263128.204775:0:7743:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788263128.204781:0:7743:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000002ba73d93 x1875129709639040/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788263128.204801:0:7743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ba73d93 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7743:1875129709639040:0@lo:1000: 00000100:00100000:0.0:1788263128.204854:0:7743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263128.204897:0:7743:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0b1042b going to sleep for 11 seconds 00000100:00100000:3.0:1788263128.205057:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709639040 00000100:00100000:3.0:1788263128.205064:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709639040 00000100:00100000:3.0:1788263128.205110:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788263128.205120:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2896d54 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7743:x1875129709639040:12345-0@lo:1000: 00000001:00080000:0.0:1788263128.208185:0:7422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1788263128.208196:0:7422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788263128.208426:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2896d54 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7743:x1875129709639040:12345-0@lo:1000: Request processed in 3306us (3570us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788263128.208438:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:0.0:1788263128.208607:0:7743:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788263128.208613:0:7743:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788263128.208627:0:7743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ba73d93 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7743:1875129709639040:0@lo:1000: 00000100:00100000:0.0:1788263128.208717:0:7743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ba73d93 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7743:1875129709639168:0@lo:1000: 00000100:00100000:0.0:1788263128.208752:0:7743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263128.208784:0:7743:0:(client.c:2715:ptlrpc_set_wait()) set 000000006dcbed2c going to sleep for 11 seconds 00000100:00100000:2.0:1788263128.209031:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709639168 00000100:00100000:2.0:1788263128.209040:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709639168 00000100:00100000:2.0:1788263128.209084:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788263128.209092:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb7de28f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7743:x1875129709639168:12345-0@lo:1000: 00000100:00100000:2.0:1788263128.209175:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb7de28f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7743:x1875129709639168:12345-0@lo:1000: Request processed in 84us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263128.209183:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788263128.209418:0:7743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ba73d93 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7743:1875129709639168:0@lo:1000: 00000040:00080000:0.0:1788263128.209441:0:7743:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788263128.209481:0:7743:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000c1a3f4ca with version 1 00000004:00080000:2.0:1788263128.210237:0:7741:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000092b58be8 version 1 rpc_version 1 00000020:00100000:2.0:1788263128.210259:0:7741:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788263128.210265:0:7741:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000298345c7 x1875129709639424/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788263128.210283:0:7741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000298345c7 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7741:1875129709639424:0@lo:1000: 00000100:00100000:2.0:1788263128.210320:0:7741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263128.210347:0:7741:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b661f7e going to sleep for 11 seconds 00000100:00100000:3.0:1788263128.210376:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709639424 00000100:00100000:3.0:1788263128.210382:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709639424 00000100:00100000:3.0:1788263128.210417:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788263128.210424:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1485094 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7741:x1875129709639424:12345-0@lo:1000: 00000001:00080000:2.0:1788263128.211718:0:7422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1788263128.211849:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1485094 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7741:x1875129709639424:12345-0@lo:1000: Request processed in 1424us (1527us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788263128.211859:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1788263128.212248:0:7741:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1788263128.212254:0:7741:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788263128.212267:0:7741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000298345c7 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7741:1875129709639424:0@lo:1000: 00000040:00080000:0.0:1788263128.214110:0:7743:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788263128.214334:0:7743:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788263128.214340:0:7743:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1788263128.630811:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263129.651548:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263130.672090:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788263131.144369:0:7849:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788263131.144795:0:7849:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788263131.696321:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788263132.303066:0:7897:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1c194f20 20000000:00000080:2.0:1788263132.303084:0:7897:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ff3ae6b2400 uarg=0000000000000000 20000000:01000000:2.0:1788263132.303123:0:7897:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788263132.303130:0:7897:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788263132.303135:0:7897:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788263132.303206:0:7897:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788263132.303217:0:7897:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788263132.314007:0:7897:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788263132.314248:0:7897:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788263132.314281:0:7897:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788263132.314297:0:7897:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788263132.314314:0:7897:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788263132.314330:0:7897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000017fad4d8/0x4b1103cba666f0bc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263132.314346:0:7897:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001d212f4c/0x4b1103cba666ef3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666ef34 expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263132.314352:0:7897:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cb03a0c9/0x4b1103cba666f029 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f022 expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263132.314357:0:7897:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000017fad4d8/0x4b1103cba666f0bc lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263132.314392:0:7897:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cb03a0c9/0x4b1103cba666f029 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f022 expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263132.315715:0:7897:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cb03a0c9/0x4b1103cba666f029 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f022 expref: 17 pid: 6484 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263132.315734:0:7897:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000298345c7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7897:1875129709639552:0@lo:104: 00000100:00100000:2.0:1788263132.315804:0:7897:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788263132.315865:0:7897:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001d212f4c/0x4b1103cba666ef3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666ef34 expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263132.315872:0:7897:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001d212f4c/0x4b1103cba666ef3b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666ef34 expref: 17 pid: 6484 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263132.315880:0:7897:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000047bf2b4c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7897:1875129709639680:0@lo:104: 00000100:00100000:2.0:1788263132.315897:0:7897:0:(client.c:2715:ptlrpc_set_wait()) set 00000000517d37bd going to sleep for 11 seconds 00000100:00100000:1.0:1788263132.315959:0:6474:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788263132.315978:0:6474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263132.316005:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709639552 00000100:00100000:1.0:1788263132.316013:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709639552 00000100:00100000:1.0:1788263132.316059:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709639680 00000100:00100000:1.0:1788263132.316063:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709639680 00000100:00100000:1.0:1788263132.316078:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788263132.316085:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c884c3a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:7897:x1875129709639552:12345-0@lo:104: 00010000:00010000:1.0:1788263132.316098:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: 0000000086a7ad1e/0x4b1103cba666f022 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f029 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263132.316146:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788263132.316151:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c884c3a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:7897:x1875129709639552:12345-0@lo:104: Request processed in 67us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263132.316157:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788263132.316192:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788263132.316198:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000571d1e19 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:7897:x1875129709639680:12345-0@lo:104: 00010000:00010000:1.0:1788263132.316205:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: 0000000063857390/0x4b1103cba666ef34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666ef3b expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263132.316238:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788263132.316243:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000571d1e19 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:7897:x1875129709639680:12345-0@lo:104: Request processed in 46us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263132.316248:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788263132.316523:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788263132.316529:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 0000000086a7ad1e/0x4b1103cba666f022 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f029 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263132.316535:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000086a7ad1e already unused, calling callback (00000000403adcdd) 10000000:00010000:0.0:1788263132.316538:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 0000000086a7ad1e/0x4b1103cba666f022 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f029 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263132.316545:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 0000000086a7ad1e/0x4b1103cba666f022 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f029 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263132.316551:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 0000000086a7ad1e/0x4b1103cba666f022 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f029 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263132.316556:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788263132.316623:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 0000000086a7ad1e/0x4b1103cba666f022 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f029 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263132.316631:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263132.316647:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 0000000086a7ad1e/0x4b1103cba666f022 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f029 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263132.316653:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 0000000086a7ad1e/0x4b1103cba666f022 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f029 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263132.316671:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263132.316673:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 0000000063857390/0x4b1103cba666ef34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666ef3b expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263132.316679:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000063857390 already unused, calling callback (00000000403adcdd) 10000000:00010000:0.0:1788263132.316681:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 0000000063857390/0x4b1103cba666ef34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666ef3b expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263132.316687:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 0000000063857390/0x4b1103cba666ef34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666ef3b expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263132.316692:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 0000000063857390/0x4b1103cba666ef34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666ef3b expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263132.316697:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788263132.316708:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 0000000063857390/0x4b1103cba666ef34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666ef3b expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263132.316713:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263132.316723:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 0000000063857390/0x4b1103cba666ef34 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666ef3b expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263132.316729:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 0000000063857390/0x4b1103cba666ef34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666ef3b expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263132.316741:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263132.316742:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263132.316744:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263132.316754:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ba73d93 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709639808:0@lo:103: 00000100:00100000:0.0:1788263132.316788:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263132.316834:0:7897:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000298345c7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7897:1875129709639552:0@lo:104: 00000100:00100000:0.0:1788263132.316843:0:7897:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000047bf2b4c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7897:1875129709639680:0@lo:104: 00010000:00010000:0.0:1788263132.316860:0:7897:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000017fad4d8/0x4b1103cba666f0bc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263132.316892:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263132.317110:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000021a0cde3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709639936:0@lo:103: 00000100:00100000:1.0:1788263132.317137:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263132.317184:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709639808 00000100:00100000:1.0:1788263132.317189:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709639808 00010000:00010000:1.0:1788263132.317205:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cb03a0c9/0x4b1103cba666f029 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f022 expref: 18 pid: 6484 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263132.317222:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709639936 00000100:00100000:1.0:1788263132.317225:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709639936 00010000:00010000:1.0:1788263132.317244:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001d212f4c/0x4b1103cba666ef3b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666ef34 expref: 19 pid: 6484 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263132.317256:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788263132.317262:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af5e48ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:3619:x1875129709639808:12345-0@lo:103: 00010000:00010000:1.0:1788263132.317271:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263132.317276:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cb03a0c9/0x4b1103cba666f029 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f022 expref: 19 pid: 6484 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263132.317285:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cb03a0c9/0x4b1103cba666f029 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f022 expref: 19 pid: 6484 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263132.317296:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cb03a0c9/0x4b1103cba666f029 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f022 expref: 19 pid: 6484 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263132.317309:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263132.317336:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af5e48ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:3619:x1875129709639808:12345-0@lo:103: Request processed in 75us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263132.317342:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788263132.317354:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788263132.317359:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070a06be1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:3620:x1875129709639936:12345-0@lo:103: 00010000:00010000:1.0:1788263132.317366:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263132.317369:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001d212f4c/0x4b1103cba666ef3b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666ef34 expref: 17 pid: 6484 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263132.317376:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001d212f4c/0x4b1103cba666ef3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666ef34 expref: 17 pid: 6484 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263132.317385:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001d212f4c/0x4b1103cba666ef3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666ef34 expref: 17 pid: 6484 timeout: 291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263132.317403:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000017fad4d8/0x4b1103cba666f0bc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263132.317410:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000017fad4d8/0x4b1103cba666f0bc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263132.317421:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000017fad4d8/0x4b1103cba666f0bc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263132.317427:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000017fad4d8/0x4b1103cba666f0bc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263132.317448:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000017fad4d8/0x4b1103cba666f0bc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263132.317454:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000017fad4d8/0x4b1103cba666f0bc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263132.317459:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000017fad4d8 already unused, calling callback (00000000c597375e) 00010000:00010000:1.0:1788263132.317462:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000017fad4d8/0x4b1103cba666f0bc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263132.317469:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000017fad4d8/0x4b1103cba666f0bc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263132.317479:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000017fad4d8/0x4b1103cba666f0bc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263132.317487:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263132.317513:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070a06be1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:3620:x1875129709639936:12345-0@lo:103: Request processed in 154us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263132.317528:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788263132.317556:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ba73d93 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709639808:0@lo:103: 00000100:00100000:1.0:1788263132.317614:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000021a0cde3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709639936:0@lo:103: 00010000:00010000:0.0:1788263132.322329:0:7897:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000017fad4d8/0x4b1103cba666f0bc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263132.322348:0:7897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000017fad4d8/0x4b1103cba666f0bc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263132.322354:0:7897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000017fad4d8/0x4b1103cba666f0bc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263132.719795:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263133.231997:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000860399ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709640192:0@lo:400: 00000100:00100000:3.0:1788263133.232061:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263133.232112:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788263133.232118:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de51da15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709640320:0@lo:400: 00000100:00100000:3.0:1788263133.232143:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263133.232225:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000052aaac1a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709640064:0@lo:400: 00000100:00100000:1.0:1788263133.232257:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263133.232285:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ceb8ff30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709640576:0@lo:400: 00000100:00100000:1.0:1788263133.232311:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263133.232327:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788263133.232332:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c21f4245 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875129709640448:0@lo:400: 00000100:00100000:1.0:1788263133.232352:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263133.232383:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709640192 00000100:00100000:1.0:1788263133.232389:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709640192 00000100:00100000:1.0:1788263133.232427:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709640448 00000100:00100000:1.0:1788263133.232430:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709640448 00000100:00100000:1.0:1788263133.232447:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788263133.232454:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000161fefe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709640192:12345-0@lo:400: 00000100:00100000:1.0:1788263133.232513:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000161fefe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709640192:12345-0@lo:400: Request processed in 59us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263133.232520:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788263133.232536:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788263133.232542:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdae738a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875129709640448:12345-0@lo:400: 00000100:00100000:1.0:1788263133.232601:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdae738a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875129709640448:12345-0@lo:400: Request processed in 60us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263133.232607:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788263133.232642:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000c21f4245 x1875129709640448/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263133.232663:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c21f4245 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875129709640448:0@lo:400: 00010000:00080000:1.0:1788263133.232690:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000860399ae x1875129709640192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263133.232699:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000860399ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709640192:0@lo:400: 00000100:00100000:3.0:1788263133.232814:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709640064 00000100:00100000:3.0:1788263133.232819:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709640064 00000100:00100000:3.0:1788263133.232853:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788263133.232859:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a7131fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:3621:x1875129709640064:12345-0@lo:400: 00000100:00100000:3.0:1788263133.232893:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a7131fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:3621:x1875129709640064:12345-0@lo:400: Request processed in 34us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263133.232898:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788263133.232925:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709640320 00000100:00100000:3.0:1788263133.232928:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709640320 00000100:00100000:3.0:1788263133.232943:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709640576 00000100:00100000:3.0:1788263133.232945:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709640576 00000100:00100000:3.0:1788263133.232957:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788263133.232962:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b31585f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709640320:12345-0@lo:400: 00000100:00100000:3.0:1788263133.232993:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b31585f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709640320:12345-0@lo:400: Request processed in 32us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263133.232999:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788263133.233011:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788263133.233016:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8f6defd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709640576:12345-0@lo:400: 00000100:00100000:3.0:1788263133.233046:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8f6defd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709640576:12345-0@lo:400: Request processed in 31us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263133.233061:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788263133.237779:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788263133.237802:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000047bf2b4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709640704:0@lo:41: 00000100:00100000:1.0:1788263133.237869:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263133.237945:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de51da15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709640320:0@lo:400: 00000100:00100000:1.0:1788263133.237975:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000052aaac1a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709640064:0@lo:400: 00000100:00100000:1.0:1788263133.237985:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ceb8ff30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709640576:0@lo:400: 00000100:00100000:2.0:1788263133.238289:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709640704 00000100:00100000:2.0:1788263133.238296:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709640704 00000100:00100000:2.0:1788263133.238346:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788263133.238355:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b904ff52 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709640704:12345-0@lo:41: 00000004:00000024:2.0:1788263133.238384:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1788263133.238425:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b904ff52 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709640704:12345-0@lo:41: Request processed in 72us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263133.238432:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788263133.241726:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a65b6a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709640832:0@lo:41: 00000100:00100000:1.0:1788263133.241799:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263133.241866:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000047bf2b4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709640704:0@lo:41: 00000100:00100000:3.0:1788263133.241984:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709640832 00000100:00100000:3.0:1788263133.241990:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709640832 00000100:00100000:3.0:1788263133.242024:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788263133.242031:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000718a0f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709640832:12345-0@lo:41: 00000004:00000024:3.0:1788263133.242059:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788263133.242111:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000718a0f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709640832:12345-0@lo:41: Request processed in 81us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263133.242118:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788263133.242187:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a65b6a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709640832:0@lo:41: 00010000:00010000:0.0:1788263133.752973:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263134.772167:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263135.792190:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788263136.305825:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788263136.305832:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff38769d000 from 1 10000000:01000000:2.0:1788263136.305837:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788263136.305879:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 000000001d212f4c/0x4b1103cba666f0c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263136.305890:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 000000001d212f4c/0x4b1103cba666f0c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263136.305912:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 000000001d212f4c/0x4b1103cba666f0c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263136.305934:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000298345c7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709640960:0@lo:101: 00000100:00100000:2.0:1788263136.305994:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263136.306047:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 0000000076a33d7e going to sleep for 11 seconds 00000100:00100000:1.0:1788263136.306105:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709640960 00000100:00100000:1.0:1788263136.306112:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709640960 00000100:00100000:1.0:1788263136.306159:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788263136.306167:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053c43e50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:6489:x1875129709640960:12345-0@lo:101: 00010000:00010000:1.0:1788263136.306178:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263136.306189:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f2f1bf78/0x4b1103cba666f0ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f0c3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263136.306228:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f2f1bf78/0x4b1103cba666f0ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f0c3 expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263136.306237:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f2f1bf78/0x4b1103cba666f0ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f0c3 expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263136.306245:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f2f1bf78, rc 0) 00000100:00100000:1.0:1788263136.306324:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053c43e50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709640960:12345-0@lo:101: Request processed in 157us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263136.306330:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788263136.306474:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000298345c7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709640960:0@lo:101: 00010000:00010000:0.0:1788263136.306487:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 000000001d212f4c/0x4b1103cba666f0c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f0ca expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263136.306495:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 000000001d212f4c/0x4b1103cba666f0c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f0ca expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263136.306561:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000021a0cde3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709641088:0@lo:501: 00000100:00100000:0.0:1788263136.306606:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263136.306673:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aff09fc8 going to sleep for 11 seconds 00000100:00100000:1.0:1788263136.306714:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709641088 00000100:00100000:1.0:1788263136.306718:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709641088 00000100:00100000:1.0:1788263136.306775:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788263136.306782:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000501d1cff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709641088:12345-0@lo:501: 00000100:00100000:1.0:1788263136.306890:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000501d1cff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709641088:12345-0@lo:501: Request processed in 109us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263136.306898:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788263136.306954:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000021a0cde3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709641088:0@lo:501: 00000100:00100000:2.0:1788263136.306980:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033471941 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709641216:0@lo:503: 00000100:00100000:2.0:1788263136.307017:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263136.307115:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set 00000000073d0410 going to sleep for 11 seconds 00000100:00100000:0.0:1788263136.307148:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709641216 00000100:00100000:0.0:1788263136.307152:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709641216 00000100:00100000:0.0:1788263136.307172:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788263136.307177:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f60f4b6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709641216:12345-0@lo:503: 00000100:00100000:0.0:1788263136.307261:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f60f4b6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709641216:12345-0@lo:503: Request processed in 84us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263136.307268:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788263136.307301:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033471941 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709641216:0@lo:503: 00000100:00100000:0.0:1788263136.307448:0:8058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ba73d93 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:8058:1875129709641344:0@lo:502: 00000100:00100000:0.0:1788263136.307482:0:8058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263136.307500:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709641344 00000100:00100000:0.0:1788263136.307504:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709641344 00000100:00100000:0.0:1788263136.307521:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788263136.307526:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb16ac55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:8058:x1875129709641344:12345-0@lo:502: 00000100:00100000:0.0:1788263136.307621:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb16ac55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:8058:x1875129709641344:12345-0@lo:502: Request processed in 95us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263136.307628:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788263136.307657:0:8058:0:(client.c:2715:ptlrpc_set_wait()) set 0000000030a18f06 going to sleep for 11 seconds 00000100:00100000:0.0:1788263136.307669:0:8058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ba73d93 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:8058:1875129709641344:0@lo:502: 00000020:01000000:0.0:1788263136.307688:0:8058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263136.307696:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263136.307698:0:8058:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788263136.307705:0:8058:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ff38769d000 00000020:00000080:0.0:1788263136.307707:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788263136.307741:0:8058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:8058:1875129709641472:0@lo:502: 00000100:00100000:0.0:1788263136.307775:0:8058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263136.307794:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709641472 00000100:00100000:0.0:1788263136.307801:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709641472 00000100:00100000:0.0:1788263136.307817:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788263136.307822:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:8058:x1875129709641472:12345-0@lo:502: 00000100:00100000:0.0:1788263136.307873:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:8058:x1875129709641472:12345-0@lo:502: Request processed in 50us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263136.307879:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788263136.307904:0:8058:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae468d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263136.307914:0:8058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:8058:1875129709641472:0@lo:502: 00000020:01000000:0.0:1788263136.307929:0:8058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263136.307933:0:8058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263136.307934:0:8058:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788263136.307938:0:8058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788263136.307983:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788263136.308000:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788263136.308007:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eede00/0x4b1103cba666f0c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f0ca expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263136.308016:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff398eede00/0x4b1103cba666f0c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f0ca expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263136.308024:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788263136.308027:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff3888e6000 from 1 10000000:01000000:0.0:1788263136.308029:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788263136.308045:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f0d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263136.308053:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f0d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263136.308060:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f0d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263136.308076:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709641600:0@lo:101: 00000100:00100000:0.0:1788263136.308098:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263136.308110:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae468d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263136.308120:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709641600 00000100:00100000:0.0:1788263136.308123:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709641600 00000100:00100000:0.0:1788263136.308138:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788263136.308143:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709641600:12345-0@lo:101: 00010000:00010000:0.0:1788263136.308150:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263136.308159:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3bd17e200/0x4b1103cba666f0d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f0d1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263136.308175:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3bd17e200/0x4b1103cba666f0d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f0d1 expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263136.308183:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3bd17e200/0x4b1103cba666f0d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f0d1 expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263136.308191:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17e200, rc 0) 00000100:00100000:0.0:1788263136.308215:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:6489:x1875129709641600:12345-0@lo:101: Request processed in 71us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263136.308220:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788263136.308246:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709641600:0@lo:101: 00010000:00010000:0.0:1788263136.308256:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f0d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f0d8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263136.308264:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f0d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f0d8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263136.308308:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709641728:0@lo:501: 00000100:00100000:0.0:1788263136.308332:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263136.308345:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae468d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263136.308356:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709641728 00000100:00100000:0.0:1788263136.308360:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709641728 00000100:00100000:0.0:1788263136.308376:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788263136.308382:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:6489:x1875129709641728:12345-0@lo:501: 00000100:00100000:0.0:1788263136.308447:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:6489:x1875129709641728:12345-0@lo:501: Request processed in 64us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263136.308453:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788263136.308479:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709641728:0@lo:501: 00000100:00100000:0.0:1788263136.308499:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709641856:0@lo:503: 00000100:00100000:0.0:1788263136.308530:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263136.308557:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae468d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263136.308569:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709641856 00000100:00100000:0.0:1788263136.308572:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709641856 00000100:00100000:0.0:1788263136.308607:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788263136.308613:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:6489:x1875129709641856:12345-0@lo:503: 00000100:00100000:0.0:1788263136.308671:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:6489:x1875129709641856:12345-0@lo:503: Request processed in 56us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263136.308676:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788263136.308710:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709641856:0@lo:503: 00000100:00100000:0.0:1788263136.308877:0:8059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:8059:1875129709641984:0@lo:502: 00000100:00100000:0.0:1788263136.308907:0:8059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263136.308929:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709641984 00000100:00100000:0.0:1788263136.308933:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709641984 00000100:00100000:0.0:1788263136.308948:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788263136.308953:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:8059:x1875129709641984:12345-0@lo:502: 00000100:00100000:0.0:1788263136.309006:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:8059:x1875129709641984:12345-0@lo:502: Request processed in 52us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263136.309012:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788263136.309042:0:8059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae4686c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263136.309052:0:8059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:8059:1875129709641984:0@lo:502: 00000020:01000000:0.0:1788263136.309068:0:8059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263136.309074:0:8059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263136.309076:0:8059:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788263136.309081:0:8059:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ff3888e6000 00000020:00000080:0.0:1788263136.309083:0:8059:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788263136.309099:0:8059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:8059:1875129709642112:0@lo:502: 00000100:00100000:0.0:1788263136.309128:0:8059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263136.309144:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709642112 00000100:00100000:0.0:1788263136.309148:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709642112 00000100:00100000:0.0:1788263136.309164:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788263136.309170:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:8059:x1875129709642112:12345-0@lo:502: 00000100:00100000:1.0:1788263136.309688:0:8059:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae4686c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263136.309705:0:8059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:8059:1875129709642112:0@lo:502: 00000020:01000000:1.0:1788263136.309725:0:8059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263136.309730:0:8059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263136.309732:0:8059:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788263136.309737:0:8059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788263136.309858:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788263136.309878:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788263136.309885:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f0d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f0d8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263136.309894:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f0d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f0d8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263136.310155:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:8059:x1875129709642112:12345-0@lo:502: Request processed in 984us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263136.310163:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1788263136.826659:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263137.840833:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263138.352765:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709642496:0@lo:400: 00000100:00100000:0.0:1788263138.352827:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263138.352877:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263138.352883:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709642624:0@lo:400: 00000100:00100000:0.0:1788263138.352916:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263138.352956:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709642496 00000100:00100000:0.0:1788263138.352962:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709642496 00000100:00100000:0.0:1788263138.353003:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788263138.353012:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709642496:12345-0@lo:400: 00000100:00100000:3.0:1788263138.353103:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875129709642368:0@lo:400: 00000100:00100000:3.0:1788263138.353138:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263138.353162:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788263138.353170:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709642240:0@lo:400: 00000100:00100000:3.0:1788263138.353202:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263138.353246:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709642752:0@lo:400: 00000100:00100000:3.0:1788263138.353278:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263138.353427:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709642496:12345-0@lo:400: Request processed in 415us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263138.353435:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788263138.353452:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709642752 00000100:00100000:0.0:1788263138.353456:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709642752 00000100:00100000:0.0:1788263138.353623:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788263138.353636:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709642752:12345-0@lo:400: 00000100:00100000:0.0:1788263138.353681:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709642752:12345-0@lo:400: Request processed in 48us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263138.353689:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788263138.353711:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709642624 00000100:00100000:0.0:1788263138.353715:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709642624 00000100:00100000:0.0:1788263138.353744:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709642368 00000100:00100000:0.0:1788263138.353747:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709642368 00000100:00100000:0.0:1788263138.353769:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788263138.353777:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709642624:12345-0@lo:400: 00000100:00100000:0.0:1788263138.353814:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709642624:12345-0@lo:400: Request processed in 39us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263138.353822:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788263138.353838:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788263138.353846:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875129709642368:12345-0@lo:400: 00000100:00100000:0.0:1788263138.353880:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875129709642368:12345-0@lo:400: Request processed in 36us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263138.353894:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788263138.353941:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709642752:0@lo:400: 00010000:00080000:0.0:1788263138.353956:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ff3a0f6df80 x1875129709642368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263138.353968:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875129709642368:0@lo:400: 00010000:00080000:3.0:1788263138.354119:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ff3a0f6e300 x1875129709642624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263138.354131:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709642624:0@lo:400: 00000100:00100000:3.0:1788263138.354146:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709642496:0@lo:400: 00000100:00100000:1.0:1788263138.355932:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709642240 00000100:00100000:1.0:1788263138.355943:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709642240 00000100:00100000:1.0:1788263138.355994:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788263138.356004:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:3621:x1875129709642240:12345-0@lo:400: 00000100:00100000:1.0:1788263138.356093:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:3621:x1875129709642240:12345-0@lo:400: Request processed in 91us (2891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263138.356102:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788263138.357323:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788263138.357339:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709642880:0@lo:41: 00000100:00100000:2.0:1788263138.357434:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263138.357457:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788263138.357480:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709643008:0@lo:41: 00000100:00100000:0.0:1788263138.357510:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263138.357554:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709642880 00000100:00100000:2.0:1788263138.357560:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709642880 00000100:00100000:0.0:1788263138.357571:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709642240:0@lo:400: 00000100:00100000:2.0:1788263138.357605:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709643008 00000100:00100000:2.0:1788263138.357609:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709643008 00000100:00100000:2.0:1788263138.357623:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788263138.357638:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38767b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709642880:12345-0@lo:41: 00000004:00000024:2.0:1788263138.357660:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788263138.357695:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38767b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709642880:12345-0@lo:41: Request processed in 60us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263138.357699:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788263138.357709:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788263138.357713:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709643008:12345-0@lo:41: 00000004:00000024:2.0:1788263138.357723:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1788263138.357740:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709643008:12345-0@lo:41: Request processed in 28us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263138.357744:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788263138.358949:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709643008:0@lo:41: 00000100:00100000:0.0:1788263138.358991:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709642880:0@lo:41: 00010000:00010000:0.0:1788263138.865732:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263139.887759:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263140.911921:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263141.935673:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788263142.014364:0:8397:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788263142.014368:0:8397:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788263142.014370:0:8397:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788263142.014510:0:8397:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ff3ae569800 00000020:01000004:2.0:1788263142.014523:0:8397:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788263142.014535:0:8397:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788263142.014547:0:8397:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ff3ad8e8000) 00000020:00000080:2.0:1788263142.014561:0:8397:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788263142.058742:0:8397:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788263142.058798:0:8397:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1788263142.084007:0:8397:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788263142.084218:0:8397:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788263142.084229:0:8397:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788263142.084244:0:8397:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4b1103cba666f0e6 00000020:01000004:3.0:1788263142.084250:0:8397:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788263142.084269:0:8397:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.126@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788263142.084272:0:8397:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788263142.084278:0:8397:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788263142.084283:0:8397:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788263142.084293:0:8397:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ff3bc6b4d28) 00000020:00000080:3.0:1788263142.084305:0:8397:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1788263142.094677:0:8397:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788263142.094884:0:8397:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788263142.094891:0:8397:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788263142.097857:0:8397:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788263142.097868:0:8397:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788263142.103926:0:8397:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788263142.103938:0:8397:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788263142.108272:0:8397:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788263142.108866:0:8397:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788263142.108873:0:8397:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788263142.109318:0:8397:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788263142.109325:0:8397:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788263142.148326:0:8397:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788263142.148713:0:8397:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788263142.148720:0:8397:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788263142.150212:0:8397:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788263142.150223:0:8397:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788263142.151781:0:8397:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788263142.151793:0:8397:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788263142.154352:0:8397:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788263142.154922:0:8397:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788263142.154928:0:8397:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788263142.155509:0:8397:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788263142.155516:0:8397:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788263142.195380:0:8397:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788263142.195828:0:8397:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788263142.195844:0:8397:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788263142.197015:0:8397:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788263142.197024:0:8397:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788263142.197416:0:8397:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788263142.197517:0:8397:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788263142.197524:0:8397:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.126@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788263142.221946:0:8397:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788263142.221984:0:8397:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.126@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788263142.221989:0:8397:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788263142.221991:0:8397:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788263142.221992:0:8397:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263142.221993:0:8397:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263142.221999:0:8397:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263142.222000:0:8397:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263142.222001:0:8397:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788263142.222002:0:8397:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788263142.222004:0:8397:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788263142.222005:0:8397:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263142.222007:0:8397:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788263142.222010:0:8397:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788263142.222012:0:8397:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788263142.222013:0:8397:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788263142.222014:0:8397:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263142.222015:0:8397:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263142.222016:0:8397:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263142.222017:0:8397:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263142.222018:0:8397:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788263142.222019:0:8397:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788263142.222019:0:8397:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788263142.222020:0:8397:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263142.222021:0:8397:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788263142.222055:0:8397:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788263142.222072:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff38767b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709643136:0@lo:253: 00000100:00100000:2.0:1788263142.222141:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263142.222192:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39064b540 going to sleep for 11 seconds 00000100:00100000:0.0:1788263142.222625:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709643136 00000100:00100000:0.0:1788263142.222633:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709643136 00000100:00100000:0.0:1788263142.222679:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788263142.222688:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:8397:x1875129709643136:12345-0@lo:253: 20000000:01000000:0.0:1788263142.222726:0:6485:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788263142.222730:0:6485:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788263142.222735:0:6485:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788263142.222738:0:6485:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788263142.222939:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788263142.223084:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788263142.223099:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788263142.223117:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788263142.223123:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788263142.223136:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788263142.223150:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788263142.223234:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788263142.223259:0:6485:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.126@tcp 20000000:01000000:0.0:1788263142.223261:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:0.0:1788263142.223275:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788263142.223281:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788263142.223294:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788263142.223299:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:0.0:1788263142.223309:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788263142.223315:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788263142.223324:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788263142.223358:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788263142.223424:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1788263142.223741:0:6485:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.126@tcp 20000000:01000000:0.0:1788263142.223743:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:0.0:1788263142.223763:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1788263142.223770:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788263142.223783:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1788263142.223789:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:0.0:1788263142.223819:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1788263142.223828:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788263142.223841:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1788263142.223854:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1788263142.224414:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1788263142.224429:0:6485:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.126@tcp 20000000:01000000:0.0:1788263142.224517:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:0.0:1788263142.224538:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1788263142.224545:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788263142.224558:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1788263142.224563:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:0.0:1788263142.224934:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1788263142.224947:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788263142.224976:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1788263142.224995:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1788263142.225008:0:6485:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788263142.225011:0:6485:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788263142.225014:0:6485:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788263142.225080:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788263142.225083:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788263142.225673:0:8416:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1788263142.225696:0:8416:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1788263142.225708:0:8416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788263142.226193:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788263142.226214:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788263142.226229:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788263142.226238:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788263142.226248:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788263142.230191:0:8417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788263142.232048:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788263142.232083:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788263142.232101:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788263142.232114:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788263142.232116:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788263142.232791:0:8418:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1788263142.232814:0:8418:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1788263142.232831:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788263142.233079:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1788263142.233101:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1788263142.233114:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1788263142.233122:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788263142.233124:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788263142.235081:0:8419:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1788263142.235122:0:8419:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1788263142.235136:0:8419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1788263142.235418:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1788263142.235441:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1788263142.235477:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:2.0:1788263142.235507:0:6485:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788263142.235532:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f0f4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263142.235549:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff380030800/0x4b1103cba666efc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666efb9 expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263142.235556:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff3bd17f200/0x4b1103cba666f037 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f030 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263142.235563:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f06f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f068 expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263142.235570:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff3829e9800/0x4b1103cba666f08b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f084 expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263142.235576:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff3829e9400/0x4b1103cba666f0b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f0ae expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263142.235689:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f0f4 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263142.235726:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff3829e9400/0x4b1103cba666f0b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f0ae expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263142.235741:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff3829e9400/0x4b1103cba666f0b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f0ae expref: 18 pid: 6486 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263142.235754:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff38767a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6485:1875129709643264:0@lo:104: 00000100:00100000:2.0:1788263142.235814:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788263142.235917:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff3829e9800/0x4b1103cba666f08b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f084 expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263142.235937:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff3829e9800/0x4b1103cba666f08b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f084 expref: 18 pid: 6485 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263142.235945:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff38767aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6485:1875129709643392:0@lo:104: 00000100:00100000:2.0:1788263142.235982:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788263142.236510:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f06f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f068 expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263142.236521:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f06f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f068 expref: 18 pid: 6486 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263142.236531:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff38767b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6485:1875129709643520:0@lo:104: 00000100:00100000:2.0:1788263142.236557:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263142.242919:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709643264 00000100:00100000:3.0:1788263142.242933:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709643264 00000100:00100000:3.0:1788263142.242990:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709643392 00000100:00100000:3.0:1788263142.242993:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709643392 00000100:00100000:3.0:1788263142.243010:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788263142.243029:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387679c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:6485:x1875129709643264:12345-0@lo:104: 00010000:00010000:3.0:1788263142.243047:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9000/0x4b1103cba666f0ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f0b5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.243131:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788263142.243137:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387679c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:6485:x1875129709643264:12345-0@lo:104: Request processed in 119us (7323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263142.243144:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788263142.243159:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788263142.243164:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387678a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:6485:x1875129709643392:12345-0@lo:104: 00010000:00010000:3.0:1788263142.243185:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff398eed000/0x4b1103cba666f084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f08b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.243223:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788263142.243228:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387678a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:6485:x1875129709643392:12345-0@lo:104: Request processed in 64us (7246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263142.243234:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1788263142.243270:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788263142.243276:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9000/0x4b1103cba666f0ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f0b5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.243284:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9000 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:3.0:1788263142.243288:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9000/0x4b1103cba666f0ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f0b5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.243295:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9000/0x4b1103cba666f0ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f0b5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263142.243302:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9000/0x4b1103cba666f0ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f0b5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263142.243308:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788263142.243341:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9000/0x4b1103cba666f0ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f0b5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.243349:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263142.243371:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9000/0x4b1103cba666f0ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f0b5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.243378:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9000/0x4b1103cba666f0ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f0b5 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.243398:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263142.243402:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff398eed000/0x4b1103cba666f084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f08b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.243408:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eed000 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:3.0:1788263142.243411:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eed000/0x4b1103cba666f084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f08b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.243417:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff398eed000/0x4b1103cba666f084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f08b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263142.243423:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eed000/0x4b1103cba666f084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f08b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263142.243428:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788263142.243443:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff398eed000/0x4b1103cba666f084 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f08b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.243449:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263142.243462:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff398eed000/0x4b1103cba666f084 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f08b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.243468:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff398eed000/0x4b1103cba666f084 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f08b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.243477:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263142.243479:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263142.243480:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263142.246774:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263142.246946:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff3bd17f200/0x4b1103cba666f037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f030 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263142.246961:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff3bd17f200/0x4b1103cba666f037 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f030 expref: 18 pid: 6484 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263142.246975:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387679500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6485:1875129709643904:0@lo:104: 00000100:00100000:2.0:1788263142.247090:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788263142.247115:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff380030800/0x4b1103cba666efc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666efb9 expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263142.247124:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff380030800/0x4b1103cba666efc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666efb9 expref: 18 pid: 6485 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263142.247133:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387678700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6485:1875129709644032:0@lo:104: 00000100:00100000:2.0:1788263142.247177:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263142.247192:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39064b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788263142.247215:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff38767a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6485:1875129709643264:0@lo:104: 00000100:00100000:2.0:1788263142.247224:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff38767aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6485:1875129709643392:0@lo:104: 00000100:00100000:3.0:1788263142.247330:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709643520 00000100:00100000:3.0:1788263142.247337:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709643520 00000100:00100000:3.0:1788263142.247372:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709643904 00000100:00100000:3.0:1788263142.247375:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709643904 00000100:00100000:3.0:1788263142.247384:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709644032 00000100:00100000:3.0:1788263142.247386:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709644032 00000100:00100000:3.0:1788263142.247398:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788263142.247406:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387679880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+5:6485:x1875129709643520:12345-0@lo:104: 00010000:00010000:3.0:1788263142.247417:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff398eec000/0x4b1103cba666f068 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f06f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.247466:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788263142.247472:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387679880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+5:6485:x1875129709643520:12345-0@lo:104: Request processed in 67us (10914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263142.247479:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788263142.247504:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788263142.247511:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38767bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:6485:x1875129709643904:12345-0@lo:104: 00010000:00010000:3.0:1788263142.247519:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff380031a00/0x4b1103cba666f030 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f037 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.247551:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788263142.247556:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38767bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:6485:x1875129709643904:12345-0@lo:104: Request processed in 46us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263142.247561:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788263142.247572:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788263142.247597:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:6485:x1875129709644032:12345-0@lo:104: 00010000:00010000:3.0:1788263142.247604:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff398eedc00/0x4b1103cba666efb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666efc0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.247723:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788263142.247728:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:6485:x1875129709644032:12345-0@lo:104: Request processed in 151us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263142.247733:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788263142.247749:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788263142.247754:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff398eec000/0x4b1103cba666f068 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f06f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.247761:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eec000 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:3.0:1788263142.247765:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eec000/0x4b1103cba666f068 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f06f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.247772:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff398eec000/0x4b1103cba666f068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f06f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263142.247779:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eec000/0x4b1103cba666f068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f06f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263142.247784:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788263142.247809:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff398eec000/0x4b1103cba666f068 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f06f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.247815:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263142.247824:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff398eec000/0x4b1103cba666f068 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f06f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.247830:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff398eec000/0x4b1103cba666f068 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f06f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.247851:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788263142.247854:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff380031a00/0x4b1103cba666f030 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f037 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.247860:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff380031a00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:3.0:1788263142.247863:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff380031a00/0x4b1103cba666f030 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f037 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.247869:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff380031a00/0x4b1103cba666f030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f037 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263142.247875:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff380031a00/0x4b1103cba666f030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f037 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263142.247881:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788263142.247894:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff380031a00/0x4b1103cba666f030 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f037 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.247899:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263142.247907:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff380031a00/0x4b1103cba666f030 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f037 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.247913:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff380031a00/0x4b1103cba666f030 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f037 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.247923:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263142.247926:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff398eedc00/0x4b1103cba666efb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666efc0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.247942:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eedc00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:3.0:1788263142.247945:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eedc00/0x4b1103cba666efb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666efc0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.247951:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff398eedc00/0x4b1103cba666efb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666efc0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263142.247957:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eedc00/0x4b1103cba666efb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666efc0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263142.247963:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788263142.247978:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff398eedc00/0x4b1103cba666efb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666efc0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.247983:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263142.247987:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff398eedc00/0x4b1103cba666efb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666efc0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.247993:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff398eedc00/0x4b1103cba666efb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666efc0 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.248006:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263142.248008:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263142.248010:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263142.248016:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263142.248130:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff38767b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6485:1875129709643520:0@lo:104: 00000100:00100000:2.0:1788263142.248139:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387679500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6485:1875129709643904:0@lo:104: 00000100:00100000:2.0:1788263142.248144:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387678700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6485:1875129709644032:0@lo:104: 00010000:00010000:2.0:1788263142.248168:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f0f4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263142.248562:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709644288:0@lo:103: 00000100:00100000:1.0:1788263142.248698:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263142.248733:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788263142.248740:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709643648:0@lo:103: 00000100:00100000:1.0:1788263142.248762:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263142.248778:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709644416:0@lo:103: 00000100:00100000:1.0:1788263142.248796:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263142.248821:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709644288 00000100:00100000:1.0:1788263142.248825:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709644288 00010000:00010000:1.0:1788263142.248845:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff3bd17f200/0x4b1103cba666f037 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f030 expref: 19 pid: 6484 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263142.248859:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709643648 00000100:00100000:1.0:1788263142.248862:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709643648 00010000:00010000:1.0:1788263142.248873:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff3829e9400/0x4b1103cba666f0b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f0ae expref: 20 pid: 6486 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263142.248883:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709644416 00000100:00100000:1.0:1788263142.248885:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709644416 00010000:00010000:1.0:1788263142.248895:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff380030800/0x4b1103cba666efc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666efb9 expref: 21 pid: 6485 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263142.248923:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788263142.248929:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387617800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:3618:x1875129709644288:12345-0@lo:103: 00010000:00010000:1.0:1788263142.248940:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263142.248945:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff3bd17f200/0x4b1103cba666f037 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f030 expref: 21 pid: 6484 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.248954:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff3bd17f200/0x4b1103cba666f037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f030 expref: 21 pid: 6484 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.248967:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3bd17f200/0x4b1103cba666f037 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f030 expref: 21 pid: 6484 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.248978:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263142.249007:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387617800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:3618:x1875129709644288:12345-0@lo:103: Request processed in 78us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263142.249014:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788263142.249377:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788263142.249384:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387616d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:3618:x1875129709643648:12345-0@lo:103: 00010000:00010000:1.0:1788263142.249393:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263142.249398:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff3829e9400/0x4b1103cba666f0b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f0ae expref: 19 pid: 6486 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.249408:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff3829e9400/0x4b1103cba666f0b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f0ae expref: 19 pid: 6486 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.249420:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3829e9400/0x4b1103cba666f0b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f0ae expref: 19 pid: 6486 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.249440:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263142.249466:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387616d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:3618:x1875129709643648:12345-0@lo:103: Request processed in 83us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263142.249472:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788263142.249485:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788263142.249491:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387614a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:3618:x1875129709644416:12345-0@lo:103: 00010000:00010000:1.0:1788263142.249508:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263142.249513:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff380030800/0x4b1103cba666efc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666efb9 expref: 17 pid: 6485 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.249522:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff380030800/0x4b1103cba666efc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666efb9 expref: 17 pid: 6485 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.249532:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff380030800/0x4b1103cba666efc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666efb9 expref: 17 pid: 6485 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.249541:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263142.249564:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387614a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:3618:x1875129709644416:12345-0@lo:103: Request processed in 73us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263142.249569:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788263142.250100:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709643648:0@lo:103: 00000100:00100000:1.0:1788263142.250112:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709644416:0@lo:103: 00000100:00100000:1.0:1788263142.250119:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709644288:0@lo:103: 00000100:00100000:1.0:1788263142.250801:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709644160:0@lo:103: 00000100:00100000:1.0:1788263142.250844:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263142.250897:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788263142.250904:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709643776:0@lo:103: 00000100:00100000:1.0:1788263142.250929:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263142.250973:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709644160 00000100:00100000:1.0:1788263142.250978:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709644160 00010000:00010000:1.0:1788263142.250998:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f06f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f068 expref: 16 pid: 6486 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263142.251013:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709643776 00000100:00100000:1.0:1788263142.251016:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709643776 00000100:00100000:2.0:1788263142.251283:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788263142.251293:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387616300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:3621:x1875129709644160:12345-0@lo:103: 00010000:00010000:2.0:1788263142.251305:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263142.251311:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f06f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f068 expref: 17 pid: 6486 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263142.251322:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f06f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f068 expref: 17 pid: 6486 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263142.251334:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f06f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f068 expref: 17 pid: 6486 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263142.251346:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263142.251381:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387616300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:3621:x1875129709644160:12345-0@lo:103: Request processed in 90us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263142.251388:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788263142.251417:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709644160:0@lo:103: 00010000:00010000:0.0:1788263142.252187:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff3829e9800/0x4b1103cba666f08b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f084 expref: 15 pid: 6485 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263142.252264:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788263142.252272:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a9661050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:3621:x1875129709643776:12345-0@lo:103: 00010000:00010000:0.0:1788263142.252281:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263142.252286:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff3829e9800/0x4b1103cba666f08b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f084 expref: 15 pid: 6485 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.252297:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff3829e9800/0x4b1103cba666f08b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f084 expref: 15 pid: 6485 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.252309:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3829e9800/0x4b1103cba666f08b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f084 expref: 15 pid: 6485 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.252321:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f0f4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.252329:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f0f4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.252344:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f0f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.252362:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f0f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.252369:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f0f4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.252375:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f0f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.252381:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eed200 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263142.252386:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f0f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.252394:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f0f4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.252419:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f0f4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.252430:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263142.252479:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a9661050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:3621:x1875129709643776:12345-0@lo:103: Request processed in 209us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263142.252486:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788263142.252559:0:6485:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f0f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.252568:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f0f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.252575:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f0f4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788263142.252618:0:6485:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788263142.255426:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709643776:0@lo:103: 00000100:00100000:1.0:1788263142.259047:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+13:8397:x1875129709643136:12345-0@lo:253: Request processed in 36351us (36898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263142.259060:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788263142.264045:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff38767b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709643136:0@lo:253: 10000000:01000000:2.0:1788263142.264063:0:8397:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788263142.264067:0:8397:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788263142.264068:0:8397:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788263142.264070:0:8397:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263142.264071:0:8397:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788263142.264072:0:8397:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263142.264074:0:8397:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263142.264076:0:8397:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788263142.264078:0:8397:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788263142.264079:0:8397:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263142.264080:0:8397:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788263142.264107:0:8397:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ff3ae569800 from lustre-OST0000 10000000:01000000:2.0:1788263142.264135:0:8397:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788263142.264138:0:8397:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788263142.264145:0:8397:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ff3b0028000 local copy 10000000:01000000:2.0:1788263142.264148:0:8397:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788263142.264183:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f0fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263142.264194:0:8397:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f0fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263142.264203:0:8397:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f0fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263142.264219:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709644544:0@lo:101: 00000100:00100000:2.0:1788263142.264288:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263142.264326:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39064bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788263142.264700:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709644544 00000100:00100000:1.0:1788263142.264707:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709644544 00000100:00100000:1.0:1788263142.264754:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788263142.264763:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+13:8397:x1875129709644544:12345-0@lo:101: 00010000:00010000:1.0:1788263142.264775:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263142.264788:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff381681600/0x4b1103cba666f102 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f0fb expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.264827:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff381681600/0x4b1103cba666f102 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f0fb expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.264838:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff381681600/0x4b1103cba666f102 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f0fb expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.264847:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381681600, rc 0) 00000100:00100000:1.0:1788263142.264897:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:8397:x1875129709644544:12345-0@lo:101: Request processed in 136us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263142.264904:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788263142.264937:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709644544:0@lo:101: 00010000:00010000:3.0:1788263142.264950:0:8397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f0fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4b1103cba666f102 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.264976:0:8397:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f0fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4b1103cba666f102 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263142.265068:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709644672:0@lo:501: 00000100:00100000:3.0:1788263142.265105:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263142.265133:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a051b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263142.265235:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709644672 00000100:00100000:1.0:1788263142.265239:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709644672 00000100:00100000:1.0:1788263142.265271:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788263142.265278:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:8397:x1875129709644672:12345-0@lo:501: 00000100:00100000:1.0:1788263142.265351:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:8397:x1875129709644672:12345-0@lo:501: Request processed in 73us (245us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788263142.265358:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788263142.265418:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709644672:0@lo:501: 10000000:01000000:3.0:1788263142.265439:0:8397:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788263142.265457:0:8397:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788263142.265462:0:8397:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f0fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4b1103cba666f102 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.265469:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f0fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4b1103cba666f102 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.265476:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f0fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4b1103cba666f102 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.265504:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788263142.265524:0:8397:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ff3ae569800 10000000:01000000:3.0:1788263142.265528:0:8397:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788263142.265533:0:8397:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788263142.265536:0:8397:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788263142.265539:0:8397:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788263142.265542:0:8397:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788263142.265557:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f109 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.265574:0:8397:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f109 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.265604:0:8397:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f109 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263142.265617:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709644800:0@lo:101: 00000100:00100000:3.0:1788263142.265642:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263142.265662:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff383968600 going to sleep for 11 seconds 00000100:00100000:0.0:1788263142.265663:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709644800 00000100:00100000:0.0:1788263142.265667:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709644800 00000100:00100000:0.0:1788263142.265700:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788263142.265708:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:8397:x1875129709644800:12345-0@lo:101: 00010000:00010000:0.0:1788263142.265715:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263142.265723:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3bd17fc00/0x4b1103cba666f110 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f109 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.265745:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3bd17fc00/0x4b1103cba666f110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f109 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.265753:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3bd17fc00/0x4b1103cba666f110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f109 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.265760:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17fc00, rc 0) 00010000:00010000:1.0:1788263142.265769:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263142.265775:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f0fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4b1103cba666f102 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.265782:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eeca00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:1.0:1788263142.265786:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f0fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4b1103cba666f102 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263142.265788:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:8397:x1875129709644800:12345-0@lo:101: Request processed in 82us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263142.265793:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00010000:1.0:1788263142.265795:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f0fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x4b1103cba666f102 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263142.265821:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f0fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x4b1103cba666f102 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263142.265827:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788263142.265845:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f0fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b1103cba666f102 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.265852:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263142.265889:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f0fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b1103cba666f102 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.265897:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f0fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b1103cba666f102 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263142.265901:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387615f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709644928:0@lo:103: 00010000:00010000:1.0:1788263142.265908:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263142.265910:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263142.265911:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263142.265929:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263142.266032:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709644928 00000100:00100000:1.0:1788263142.266036:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709644928 00000100:00100000:1.0:1788263142.266069:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788263142.266076:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:3620:x1875129709644928:12345-0@lo:103: 00010000:00010000:1.0:1788263142.266085:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263142.266095:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff381681600/0x4b1103cba666f102 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b1103cba666f0fb expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.266105:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263142.266140:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:3620:x1875129709644928:12345-0@lo:103: Request processed in 64us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263142.266147:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788263142.266197:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709644800:0@lo:101: 00010000:00010000:3.0:1788263142.266207:0:8397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f109 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f110 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.266215:0:8397:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f109 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f110 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263142.266267:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709645056:0@lo:501: 00000100:00100000:3.0:1788263142.266291:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263142.266292:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387615f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709644928:0@lo:103: 00000100:00100000:3.0:1788263142.266315:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff383968600 going to sleep for 11 seconds 00000100:00100000:1.0:1788263142.266409:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709645056 00000100:00100000:1.0:1788263142.266414:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709645056 00000100:00100000:1.0:1788263142.266449:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788263142.266456:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:8397:x1875129709645056:12345-0@lo:501: 00000100:00100000:1.0:1788263142.266558:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:8397:x1875129709645056:12345-0@lo:501: Request processed in 102us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263142.266565:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788263142.266749:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709645056:0@lo:501: 00000100:00100000:3.0:1788263142.266774:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709645184:0@lo:503: 00000100:00100000:3.0:1788263142.266813:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263142.266839:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff383968600 going to sleep for 11 seconds 00000100:00100000:2.0:1788263142.266854:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709645184 00000100:00100000:2.0:1788263142.266858:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709645184 00000100:00100000:2.0:1788263142.266888:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788263142.266903:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:8397:x1875129709645184:12345-0@lo:503: 00000100:00100000:2.0:1788263142.266987:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:8397:x1875129709645184:12345-0@lo:503: Request processed in 84us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263142.266993:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788263142.267153:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709645184:0@lo:503: 00000040:00080000:3.0:1788263142.267386:0:8397:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788263142.267458:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709645312:0@lo:502: 00000100:00100000:3.0:1788263142.267505:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263142.267525:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff383968600 going to sleep for 11 seconds 00000100:00100000:1.0:1788263142.268027:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709645312 00000100:00100000:1.0:1788263142.268033:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709645312 00000100:00100000:1.0:1788263142.268057:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788263142.268064:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:8397:x1875129709645312:12345-0@lo:502: 00000100:00100000:1.0:1788263142.270486:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:8397:x1875129709645312:12345-0@lo:502: Request processed in 2414us (2983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263142.270507:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788263142.270523:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709645312:0@lo:502: 00000040:00080000:3.0:1788263142.270758:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788263142.270788:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788263142.270800:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788263142.270811:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788263142.270840:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788263142.270854:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788263142.270885:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709645440:0@lo:502: 00000100:00100000:3.0:1788263142.270930:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263142.270958:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff383968600 going to sleep for 11 seconds 00000100:00100000:0.0:1788263142.271053:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709645440 00000100:00100000:0.0:1788263142.271059:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709645440 00000100:00100000:0.0:1788263142.271101:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788263142.271109:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:8397:x1875129709645440:12345-0@lo:502: 00000100:00100000:0.0:1788263142.271195:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:8397:x1875129709645440:12345-0@lo:502: Request processed in 87us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263142.271202:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788263142.271430:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709645440:0@lo:502: 00000040:00080000:3.0:1788263142.271467:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788263142.271475:0:8397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1788263142.275655:0:8420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788263142.275667:0:8420:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788263142.275673:0:8420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263142.275675:0:8420:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788263142.275683:0:8420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788263142.275699:0:8420:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ff3b0053370) 00000020:00000080:0.0:1788263142.275723:0:8420:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788263142.275743:0:8420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788263142.275809:0:8420:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ff3ae569800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788263142.275817:0:8420:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788263142.275824:0:8420:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4b1103cba666f11e 00010000:00010000:1.0:1788263142.281851:0:8420:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1788263142.282814:0:8420:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788263142.286711:0:8420:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788263142.287573:0:8420:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788263142.295667:0:8420:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1788263142.295944:0:8420:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1788263142.305509:0:8420:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788263142.311208:0:8420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788263142.311221:0:8420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263142.311227:0:8420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263142.311229:0:8420:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788263142.311232:0:8420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263142.311236:0:8420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263142.311237:0:8420:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788263142.311240:0:8420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788263142.311242:0:8420:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788263142.311265:0:8420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263142.311269:0:8420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263142.311270:0:8420:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788263142.311273:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788263142.316541:0:8397:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788263142.316604:0:8397:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788263142.316627:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f109 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f110 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.316638:0:8397:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f110 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263142.317632:0:8397:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff3ae569800 from 1 10000000:01000000:0.0:1788263142.317637:0:8397:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788263142.317672:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f125 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.317682:0:8397:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f125 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.317693:0:8397:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f125 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263142.317716:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709645568:0@lo:101: 00000100:00100000:0.0:1788263142.317779:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263142.317822:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a05bc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263142.318240:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709645568 00000100:00100000:1.0:1788263142.318254:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709645568 00000100:00100000:1.0:1788263142.318301:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788263142.318311:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:8397:x1875129709645568:12345-0@lo:101: 00010000:00010000:1.0:1788263142.318323:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263142.318345:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff381681600/0x4b1103cba666f12c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f125 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.318368:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff381681600/0x4b1103cba666f12c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f125 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.318379:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff381681600/0x4b1103cba666f12c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f125 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.318388:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381681600, rc 0) 00000100:00100000:0.0:1788263142.318599:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709645568:0@lo:101: 00010000:00010000:0.0:1788263142.318614:0:8397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f125 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f12c expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.318623:0:8397:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f125 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f12c expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263142.318709:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709645696:0@lo:501: 00000100:00100000:0.0:1788263142.318734:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263142.318760:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a05bc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263142.318817:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709645696 00000100:00100000:2.0:1788263142.318822:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709645696 00000100:00100000:2.0:1788263142.318853:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788263142.318943:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:8397:x1875129709645568:12345-0@lo:101: Request processed in 119us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263142.318980:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:8397:x1875129709645696:12345-0@lo:501: 00000100:00100000:2.0:1788263142.319068:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:8397:x1875129709645696:12345-0@lo:501: Request processed in 91us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263142.319114:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709645696:0@lo:501: 00000100:00100000:0.0:1788263142.319138:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709645824:0@lo:503: 00000100:00100000:0.0:1788263142.319190:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263142.319211:0:6486:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1788263142.319217:0:6486:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:0.0:1788263142.319293:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a05bc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263142.319918:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788263142.319946:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709645824 00000100:00100000:1.0:1788263142.319950:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709645824 00000100:00100000:1.0:1788263142.319980:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788263142.319987:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:8397:x1875129709645824:12345-0@lo:503: 00000100:00100000:1.0:1788263142.320113:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:8397:x1875129709645824:12345-0@lo:503: Request processed in 126us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263142.320121:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788263142.320327:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788263142.322632:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709645824:0@lo:503: 00000040:00080000:0.0:1788263142.322910:0:8397:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788263142.323293:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709645952:0@lo:502: 00000100:00100000:0.0:1788263142.323427:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263142.323535:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3c05e9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788263142.323617:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709645952 00000100:00100000:1.0:1788263142.323623:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709645952 00000100:00100000:1.0:1788263142.323661:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788263142.323670:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:8397:x1875129709645952:12345-0@lo:502: 00000100:00100000:1.0:1788263142.323771:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:8397:x1875129709645952:12345-0@lo:502: Request processed in 101us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263142.323784:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788263142.324556:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709645952:0@lo:502: 00000040:00080000:0.0:1788263142.324776:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788263142.324804:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788263142.324831:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709646080:0@lo:502: 00000100:00100000:0.0:1788263142.324872:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263142.324898:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a05bc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263142.324954:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709646080 00000100:00100000:1.0:1788263142.324968:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709646080 00000100:00100000:1.0:1788263142.324999:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788263142.325006:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:8397:x1875129709646080:12345-0@lo:502: 00000100:00100000:1.0:1788263142.325080:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:8397:x1875129709646080:12345-0@lo:502: Request processed in 73us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263142.325087:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788263142.325264:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709646080:0@lo:502: 00000040:00080000:0.0:1788263142.325299:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788263142.325306:0:8397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788263142.325936:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263142.325944:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263142.325947:0:8425:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788263142.325953:0:8425:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ff3ae569800 00000020:00000080:0.0:1788263142.326025:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788263142.326040:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263142.326043:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263142.326044:0:8425:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788263142.326047:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788263142.326412:0:8397:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788263142.326504:0:8397:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788263142.326550:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f125 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f12c expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.326561:0:8397:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f125 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f12c expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263142.326626:0:8397:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788263142.326629:0:8397:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ff3ae569800 10000000:01000000:1.0:1788263142.326632:0:8397:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ff3ae569800 10000000:01000000:1.0:1788263142.326635:0:8397:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788263142.326641:0:8397:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ff3ae569800 from 1 10000000:01000000:1.0:1788263142.326643:0:8397:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788263142.326668:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff381681800/0x4b1103cba666f133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.326676:0:8397:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff381681800/0x4b1103cba666f133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.326685:0:8397:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff381681800/0x4b1103cba666f133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263142.326707:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387617800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709646208:0@lo:101: 00000100:00100000:1.0:1788263142.326748:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263142.326774:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3853e29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263142.326860:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709646208 00000100:00100000:2.0:1788263142.326865:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709646208 00000100:00100000:2.0:1788263142.326899:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788263142.326907:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:8397:x1875129709646208:12345-0@lo:101: 00010000:00010000:2.0:1788263142.326916:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263142.326926:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f13a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f133 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263142.326946:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f13a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f133 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263142.326964:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f13a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f133 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263142.326972:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eed400, rc 0) 00000100:00100000:2.0:1788263142.327011:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:8397:x1875129709646208:12345-0@lo:101: Request processed in 105us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263142.327027:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788263142.327093:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387617800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709646208:0@lo:101: 00010000:00010000:3.0:1788263142.327106:0:8397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff381681800/0x4b1103cba666f133 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f13a expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.327115:0:8397:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff381681800/0x4b1103cba666f133 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f13a expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263142.327189:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709646336:0@lo:501: 00000100:00100000:3.0:1788263142.327212:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263142.327232:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384df6300 going to sleep for 11 seconds 00000100:00100000:2.0:1788263142.327450:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709646336 00000100:00100000:2.0:1788263142.327455:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709646336 00000100:00100000:2.0:1788263142.327480:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788263142.327486:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:8397:x1875129709646336:12345-0@lo:501: 00000100:00100000:2.0:1788263142.327603:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:8397:x1875129709646336:12345-0@lo:501: Request processed in 116us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263142.327610:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788263142.327641:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709646336:0@lo:501: 00000100:00100000:2.0:1788263142.327671:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709646464:0@lo:503: 00000100:00100000:2.0:1788263142.327705:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263142.327725:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709646464 00000100:00100000:2.0:1788263142.327728:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709646464 00000100:00100000:2.0:1788263142.327748:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788263142.327754:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:8397:x1875129709646464:12345-0@lo:503: 00000100:00100000:2.0:1788263142.327816:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:8397:x1875129709646464:12345-0@lo:503: Request processed in 62us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263142.327823:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788263142.327854:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39064b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263142.327865:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709646464:0@lo:503: 00000040:00080000:2.0:1788263142.328082:0:8397:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788263142.328132:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709646592:0@lo:502: 00000100:00100000:2.0:1788263142.328397:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263142.328421:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709646592 00000100:00100000:2.0:1788263142.328631:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709646592 00000100:00100000:2.0:1788263142.328677:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788263142.328685:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:8397:x1875129709646592:12345-0@lo:502: 00000100:00100000:2.0:1788263142.328759:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:8397:x1875129709646592:12345-0@lo:502: Request processed in 75us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263142.328766:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788263142.328795:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39064b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263142.328809:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709646592:0@lo:502: 00000040:00080000:2.0:1788263142.329243:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788263142.329269:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788263142.329283:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788263142.329295:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788263142.329309:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788263142.329323:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788263142.331717:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788263142.331764:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788263142.331776:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788263142.331786:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788263142.331799:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788263142.331810:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788263142.331820:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788263142.331832:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788263142.331845:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788263142.331856:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788263142.331892:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788263142.331908:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788263142.331919:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788263142.331931:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788263142.331944:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788263142.332712:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788263142.332740:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788263142.332755:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788263142.332782:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788263142.332797:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788263142.332809:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788263142.332821:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788263142.332834:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788263142.332848:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788263142.332863:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788263142.332877:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788263142.332905:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788263142.332920:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788263142.332933:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788263142.332945:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788263142.333254:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1788263142.333302:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709646720:0@lo:502: 00000100:00100000:2.0:1788263142.333513:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263142.333555:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39064b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263142.333844:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709646720 00000100:00100000:0.0:1788263142.333852:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709646720 00000100:00100000:0.0:1788263142.334251:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788263142.334262:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:8397:x1875129709646720:12345-0@lo:502: 00000100:00100000:0.0:1788263142.334399:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:8397:x1875129709646720:12345-0@lo:502: Request processed in 139us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263142.334406:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788263142.334630:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709646720:0@lo:502: 00000040:00080000:2.0:1788263142.334690:0:8397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788263142.334699:0:8397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788263142.335567:0:8426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788263142.335696:0:8426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ff3ad8ecd28) 00000020:00000080:2.0:1788263142.335717:0:8426:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788263142.336046:0:8426:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ff3ae569800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788263142.336051:0:8426:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ff3ae569800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788263142.336053:0:8426:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ff3ae569800 3 00010000:00080000:2.0:1788263142.336083:0:8426:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ff3bd5bf000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.126@tcp at head 00010000:00010000:2.0:1788263142.338746:0:8426:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1788263142.338943:0:8426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788263142.341791:0:8426:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788263142.341811:0:8426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4b1103cba666f148 00000100:00080000:2.0:1788263142.341830:0:8426:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788263142.341836:0:8426:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ff3bd5bf000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263142.341870:0:8426:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff28178dc00 x1875129709646848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788263142.341904:0:8426:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788263142.342243:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875129709646848:0@lo:38: 00000100:00100000:1.0:1788263142.342311:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263142.342894:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875129709646976:0@lo:400: 00000100:00100000:2.0:1788263142.342926:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263142.342948:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788263142.342954:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709647360:0@lo:400: 00000100:00100000:2.0:1788263142.343328:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263142.343413:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709647104:0@lo:400: 00000100:00100000:3.0:1788263142.345083:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709647232:0@lo:400: 00000100:00100000:3.0:1788263142.345130:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263142.345249:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709646848 00000100:00100000:3.0:1788263142.345257:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709646848 00000100:00100000:3.0:1788263142.345278:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709646976 00000100:00100000:3.0:1788263142.345281:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709646976 00000100:00100000:3.0:1788263142.345301:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709647232 00000100:00100000:3.0:1788263142.345304:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709647232 00000100:00100000:3.0:1788263142.345317:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788263142.345325:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875129709646976:12345-0@lo:400: 00000100:00100000:3.0:1788263142.345493:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875129709646976:12345-0@lo:400: Request processed in 107us (2505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263142.345510:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788263142.345527:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788263142.345534:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709647232:12345-0@lo:400: 00000100:00100000:3.0:1788263142.345570:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709647232:12345-0@lo:400: Request processed in 37us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263142.345575:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788263142.345603:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788263142.345608:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875129709646848:12345-0@lo:38: 00010000:00080000:3.0:1788263142.345628:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 151 last 0 00000020:00000080:3.0:1788263142.345673:0:6492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4b1103cba666f14f 00000004:00100000:3.0:1788263142.345687:0:6492:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788263142.345714:0:6492:0:(import.c:65:import_set_state_nolock()) ffff9ff3af75e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788263142.345755:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875129709646848:12345-0@lo:38: Request processed in 146us (3444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263142.345762:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788263142.345810:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ff28178dc00 x1875129709646848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788263152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263142.345820:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788263142.345827:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788263142.345834:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788263142.345838:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788263142.345839:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3bd5bf000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788263142.345844:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875129709646848:0@lo:38: 00010000:00080000:3.0:1788263142.345873:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ff28178f800 x1875129709647232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263142.345881:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709647232:0@lo:400: 00010000:00080000:2.0:1788263142.346260:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ff28178ea00 x1875129709646976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263142.346270:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875129709646976:0@lo:400: 00000100:00100000:2.0:1788263142.346307:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709647360 00000100:00100000:2.0:1788263142.346312:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709647360 00000100:00100000:2.0:1788263142.346352:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788263142.346360:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709647360:12345-0@lo:400: 00000100:00100000:2.0:1788263142.346399:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709647360:12345-0@lo:400: Request processed in 40us (3070us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263142.346405:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788263142.346426:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263142.347071:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709647104 00000100:00100000:2.0:1788263142.347076:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709647104 00000100:00100000:2.0:1788263142.347099:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788263142.347106:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709647104:12345-0@lo:400: 00000100:00100000:2.0:1788263142.347154:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709647104:12345-0@lo:400: Request processed in 37us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263142.347167:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788263142.347199:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709647104:0@lo:400: 00000100:00100000:2.0:1788263142.347223:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709647360:0@lo:400: 00000020:01000004:2.0:1788263142.347752:0:8426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788263142.347777:0:8426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9ff281fa3370) 00000020:00000080:2.0:1788263142.347796:0:8426:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1788263142.347878:0:8426:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ff3ae569800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788263142.347882:0:8426:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ff3ae569800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788263142.347885:0:8426:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ff3ae569800 3 00010000:00080000:2.0:1788263142.347920:0:8426:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ff281faf800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.126@tcp at head 00010000:00010000:2.0:1788263142.355733:0:8426:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1788263142.357211:0:8426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788263142.357414:0:8426:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788263142.357426:0:8426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x4b1103cba666f15d 00000100:00080000:2.0:1788263142.357509:0:8426:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788263142.357516:0:8426:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9ff281faf800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263142.357559:0:8426:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff28178ce00 x1875129709647488/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788263142.358063:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1875129709647488:0@lo:38: 00000100:00100000:1.0:1788263142.358138:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263142.358233:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709647488 00000100:00100000:0.0:1788263142.358241:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709647488 00000100:00100000:0.0:1788263142.358275:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788263142.358283:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875129709647488:12345-0@lo:38: 00010000:00080000:0.0:1788263142.358306:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 151 last 0 00000020:00000080:0.0:1788263142.358349:0:6492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x4b1103cba666f164 00000004:00100000:0.0:1788263142.358363:0:6492:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788263142.358392:0:6492:0:(import.c:65:import_set_state_nolock()) ffff9ff281e04000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788263142.358589:0:8426:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788263142.369101:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875129709647488:12345-0@lo:38: Request processed in 10810us (10956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263142.369122:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788263142.369666:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ff28178ce00 x1875129709647488/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788263152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263142.369678:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788263142.369687:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788263142.369696:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788263142.369701:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788263142.369703:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff281faf800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788263142.369721:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1875129709647488:0@lo:38: 00000040:00080000:0.0:1788263142.370270:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1788263142.371083:0:8397:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788263142.371114:0:8397:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788263142.371226:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff381681800/0x4b1103cba666f133 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f13a expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.371237:0:8397:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff381681800/0x4b1103cba666f133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f13a expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788263142.371293:0:8397:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788263142.371295:0:8397:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788263142.371297:0:8397:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263142.371298:0:8397:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263142.371299:0:8397:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263142.371300:0:8397:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263142.371302:0:8397:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788263142.371303:0:8397:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788263142.371304:0:8397:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788263142.371306:0:8397:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263142.371308:0:8397:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788263142.371315:0:8397:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788263142.371317:0:8397:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788263142.371318:0:8397:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788263142.371319:0:8397:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263142.371320:0:8397:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263142.371321:0:8397:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263142.371322:0:8397:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263142.371323:0:8397:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788263142.371324:0:8397:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788263142.371325:0:8397:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788263142.371326:0:8397:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263142.371327:0:8397:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788263142.371358:0:8397:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788263142.371376:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709647616:0@lo:253: 00000100:00100000:3.0:1788263142.371544:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263142.371614:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2820ff0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263142.371759:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709647616 00000100:00100000:2.0:1788263142.371767:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709647616 00000100:00100000:2.0:1788263142.371813:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788263142.371821:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:8397:x1875129709647616:12345-0@lo:253: 20000000:01000000:2.0:1788263142.371846:0:6485:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788263142.371859:0:6485:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788263142.377818:0:6485:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788263142.377830:0:6485:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788263142.378079:0:6507:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788263142.378084:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788263142.378105:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ff3829e9000/0x4b1103cba666f16b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.378121:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f061 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f05a expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.378127:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff3829e8600/0x4b1103cba666f07d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f076 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.378133:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ff3829e9000/0x4b1103cba666f16b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.378186:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff3829e8600/0x4b1103cba666f07d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f076 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.378200:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff3829e8600/0x4b1103cba666f07d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f076 expref: 16 pid: 6484 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263142.378234:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387685180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6507:1875129709647744:0@lo:104: 00000100:00100000:3.0:1788263142.378294:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788263142.378349:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f05a expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.378358:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f061 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f05a expref: 16 pid: 6484 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263142.378366:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387684e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6507:1875129709647872:0@lo:104: 00000100:00100000:3.0:1788263142.378385:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2820ffe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788263142.378707:0:6475:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788263142.378726:0:6475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263142.378902:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:8397:x1875129709647616:12345-0@lo:253: Request processed in 7080us (7356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263142.378911:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788263142.378978:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:8397:1875129709647616:0@lo:253: 10000000:01000000:3.0:1788263142.378993:0:8397:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788263142.378997:0:8397:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788263142.378999:0:8397:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788263142.379000:0:8397:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263142.379001:0:8397:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263142.379003:0:8397:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263142.379004:0:8397:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263142.379006:0:8397:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788263142.379007:0:8397:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788263142.379009:0:8397:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788263142.379011:0:8397:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263142.379012:0:8397:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788263142.379025:0:8397:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788263142.379345:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709647744 00000100:00100000:2.0:1788263142.379352:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709647744 00000100:00100000:1.0:1788263142.383505:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709647872 00000100:00100000:1.0:1788263142.383521:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709647872 00000100:00100000:1.0:1788263142.383566:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788263142.383575:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6afc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:6507:x1875129709647744:12345-0@lo:104: 00010000:00010000:1.0:1788263142.383619:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff398eed800/0x4b1103cba666f076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f07d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.383730:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788263142.383737:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6afc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:6507:x1875129709647744:12345-0@lo:104: Request processed in 163us (5443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263142.383759:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788263142.383795:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788263142.383802:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:6507:x1875129709647872:12345-0@lo:104: 00010000:00010000:1.0:1788263142.383810:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff398eec600/0x4b1103cba666f05a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f061 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.383846:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788263142.383851:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:6507:x1875129709647872:12345-0@lo:104: Request processed in 51us (5126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263142.383869:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1788263142.383892:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788263142.383897:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff398eed800/0x4b1103cba666f076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f07d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.383904:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eed800 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:1.0:1788263142.383908:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eed800/0x4b1103cba666f076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f07d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.383916:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff398eed800/0x4b1103cba666f076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f07d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263142.383923:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eed800/0x4b1103cba666f076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f07d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263142.383928:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1788263142.384155:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387685180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6507:1875129709647744:0@lo:104: 00000100:00100000:0.0:1788263142.384167:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387684e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6507:1875129709647872:0@lo:104: 00010000:00010000:0.0:1788263142.384189:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ff3829e9000/0x4b1103cba666f16b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.384328:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff398eed800/0x4b1103cba666f076 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f07d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.384336:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263142.384370:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff398eed800/0x4b1103cba666f076 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f07d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.384378:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff398eed800/0x4b1103cba666f076 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f07d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.384389:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263142.384393:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff398eec600/0x4b1103cba666f05a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f061 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.384399:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eec600 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:1.0:1788263142.384402:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eec600/0x4b1103cba666f05a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f061 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.384408:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff398eec600/0x4b1103cba666f05a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f061 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263142.384413:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eec600/0x4b1103cba666f05a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f061 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263142.384419:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788263142.384492:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff398eec600/0x4b1103cba666f05a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f061 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.384704:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263142.384725:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff398eec600/0x4b1103cba666f05a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f061 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.384731:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff398eec600/0x4b1103cba666f05a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f061 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.384743:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263142.384750:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263142.384751:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263142.384760:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263142.384774:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387617480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709648000:0@lo:103: 00000100:00100000:1.0:1788263142.384811:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263142.385214:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709648000 00000100:00100000:0.0:1788263142.385220:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709648000 00010000:00010000:0.0:1788263142.385241:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff3829e8600/0x4b1103cba666f07d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f076 expref: 16 pid: 6484 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263142.385269:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788263142.385277:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387617800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:3620:x1875129709648000:12345-0@lo:103: 00010000:00010000:0.0:1788263142.385288:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263142.385294:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff3829e8600/0x4b1103cba666f07d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f076 expref: 16 pid: 6484 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.385305:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff3829e8600/0x4b1103cba666f07d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f076 expref: 16 pid: 6484 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.385318:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3829e8600/0x4b1103cba666f07d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f076 expref: 16 pid: 6484 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.385330:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263142.385364:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387617800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:3620:x1875129709648000:12345-0@lo:103: Request processed in 88us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263142.385370:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788263142.385406:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387617480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709648000:0@lo:103: 00000100:00100000:2.0:1788263142.385637:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709648128:0@lo:103: 00000100:00100000:2.0:1788263142.385668:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263142.385790:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709648128 00000100:00100000:0.0:1788263142.385794:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709648128 00010000:00010000:0.0:1788263142.385809:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f061 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f05a expref: 15 pid: 6484 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263142.385837:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788263142.385843:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:3618:x1875129709648128:12345-0@lo:103: 00010000:00010000:0.0:1788263142.385850:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263142.385854:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f061 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f05a expref: 15 pid: 6484 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.385863:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f05a expref: 15 pid: 6484 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.385873:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f061 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f05a expref: 15 pid: 6484 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.385884:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ff3829e9000/0x4b1103cba666f16b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.385891:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3829e9000/0x4b1103cba666f16b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788263142.385906:0:6477:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007821599s 00010000:00010000:0.0:1788263142.385910:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff3829e9000/0x4b1103cba666f16b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.385922:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff3829e9000/0x4b1103cba666f16b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.385938:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ff3829e9000/0x4b1103cba666f16b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.385945:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ff3829e9000/0x4b1103cba666f16b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.385950:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9000 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263142.386129:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ff3829e9000/0x4b1103cba666f16b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.386138:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ff3829e9000/0x4b1103cba666f16b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263142.387284:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1788263142.388791:0:8397:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788263142.388972:0:8397:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788263142.389421:0:8397:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788263142.389723:0:8397:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788263142.389931:0:8397:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788263142.390376:0:8397:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788263142.391502:0:8397:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788263142.398971:0:8397:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788263142.398982:0:8397:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788263142.399019:0:8397:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788263142.399062:0:8397:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788263142.399087:0:8397:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788263142.399105:0:8397:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00010000:00010000:1.0:1788263142.403059:0:6507:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ff3829e9000/0x4b1103cba666f16b lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263142.403073:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ff3829e9000/0x4b1103cba666f16b lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:3.0:1788263142.404383:0:8397:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788263142.404720:0:8397:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788263142.408657:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ff3829e9000/0x4b1103cba666f16b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.408676:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3829e9000/0x4b1103cba666f16b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263142.410575:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263142.410687:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:3618:x1875129709648128:12345-0@lo:103: Request processed in 24840us (25013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263142.410699:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788263142.412890:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709648128:0@lo:103: 00010000:00010000:1.0:1788263142.960888:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788263143.153338:0:8482:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788263143.153560:0:8482:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788263143.473086:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709648256:0@lo:41: 00000100:00100000:0.0:1788263143.473152:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263143.473276:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387615f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709648384:0@lo:41: 00000100:00100000:1.0:1788263143.473308:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263143.482121:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709648256 00000100:00100000:2.0:1788263143.482139:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709648256 00000100:00100000:2.0:1788263143.482184:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709648384 00000100:00100000:2.0:1788263143.482187:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709648384 00000100:00100000:2.0:1788263143.482207:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788263143.482218:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709648256:12345-0@lo:41: 00000004:00000024:2.0:1788263143.482255:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:2.0:1788263143.482340:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709648256:12345-0@lo:41: Request processed in 123us (9187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263143.482347:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788263143.482364:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788263143.482369:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709648384:12345-0@lo:41: 00000004:00000024:2.0:1788263143.482384:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788263143.482412:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709648384:12345-0@lo:41: Request processed in 42us (9103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263143.482432:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788263143.486542:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709648256:0@lo:41: 00000100:00100000:1.0:1788263143.487038:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387615f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709648384:0@lo:41: 00010000:00010000:3.0:1788263143.987172:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263145.008796:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788263145.593639:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788263145.593647:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ff38769d000 from 30 10000000:01000000:0.0:1788263145.593652:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788263145.593710:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f400/0x4b1103cba666f172 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263145.593722:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f400/0x4b1103cba666f172 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263145.593742:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f400/0x4b1103cba666f172 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263145.593764:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709648512:0@lo:101: 00000100:00100000:0.0:1788263145.593825:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263145.593873:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae55f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788263145.593971:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709648512 00000100:00100000:1.0:1788263145.593978:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709648512 00000100:00100000:1.0:1788263145.594030:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788263145.594039:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:6489:x1875129709648512:12345-0@lo:101: 00010000:00010000:1.0:1788263145.594051:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263145.594074:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff381681e00/0x4b1103cba666f179 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f172 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263145.594096:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff381681e00/0x4b1103cba666f179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f172 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263145.594106:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff381681e00/0x4b1103cba666f179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f172 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263145.594124:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381681e00, rc 0) 00000100:00100000:1.0:1788263145.594183:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:6489:x1875129709648512:12345-0@lo:101: Request processed in 144us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263145.594189:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788263145.594202:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709648512:0@lo:101: 00010000:00010000:2.0:1788263145.594224:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f400/0x4b1103cba666f172 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f179 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263145.594239:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f400/0x4b1103cba666f172 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f179 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263145.594310:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709648640:0@lo:501: 00000100:00100000:2.0:1788263145.594344:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263145.594373:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384df6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263145.594393:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709648640 00000100:00100000:0.0:1788263145.594397:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709648640 00000100:00100000:0.0:1788263145.594427:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788263145.594434:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:6489:x1875129709648640:12345-0@lo:501: 00000100:00100000:0.0:1788263145.594557:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:6489:x1875129709648640:12345-0@lo:501: Request processed in 123us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263145.594564:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788263145.594610:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709648640:0@lo:501: 00000100:00100000:2.0:1788263145.594635:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709648768:0@lo:503: 00000100:00100000:2.0:1788263145.594671:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263145.594701:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384df6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263145.594884:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709648768 00000100:00100000:0.0:1788263145.594889:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709648768 00000100:00100000:0.0:1788263145.594917:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788263145.594923:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:6489:x1875129709648768:12345-0@lo:503: 00000100:00100000:0.0:1788263145.594993:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:6489:x1875129709648768:12345-0@lo:503: Request processed in 70us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263145.595000:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788263145.597234:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709648768:0@lo:503: 00000100:00100000:0.0:1788263145.599822:0:8602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:8602:1875129709648896:0@lo:502: 00000100:00100000:0.0:1788263145.599886:0:8602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263145.599932:0:8602:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae55f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263145.601222:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709648896 00000100:00100000:2.0:1788263145.601232:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709648896 00000100:00100000:2.0:1788263145.601270:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788263145.601278:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0499450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:8602:x1875129709648896:12345-0@lo:502: 00000100:00100000:2.0:1788263145.601464:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0499450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:8602:x1875129709648896:12345-0@lo:502: Request processed in 185us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263145.601471:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788263145.602868:0:8602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:8602:1875129709648896:0@lo:502: 00000100:00100000:3.0:1788263145.602930:0:8602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387687100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:8602:1875129709649024:0@lo:502: 00000100:00100000:3.0:1788263145.602979:0:8602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263145.603009:0:8602:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384e23540 going to sleep for 11 seconds 00000100:00100000:2.0:1788263145.603400:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709649024 00000100:00100000:2.0:1788263145.603406:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709649024 00000100:00100000:2.0:1788263145.603448:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788263145.603455:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:8602:x1875129709649024:12345-0@lo:502: 00000100:00100000:2.0:1788263145.603553:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:8602:x1875129709649024:12345-0@lo:502: Request processed in 97us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263145.603560:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788263145.604640:0:8602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387687100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:8602:1875129709649024:0@lo:502: 00000040:00080000:0.0:1788263145.604672:0:8602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788263145.605258:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788263145.605287:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788263145.605297:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f400/0x4b1103cba666f172 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f179 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263145.605307:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f400/0x4b1103cba666f172 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f179 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263145.606153:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788263145.606156:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ff38769d000 from 5 10000000:01000000:2.0:1788263145.606159:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788263145.606195:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f180 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263145.606205:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f180 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263145.606214:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f180 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263145.606233:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709649152:0@lo:101: 00000100:00100000:2.0:1788263145.606290:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263145.606520:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709649152 00000100:00100000:0.0:1788263145.606526:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709649152 00000100:00100000:0.0:1788263145.606594:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788263145.606604:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:6489:x1875129709649152:12345-0@lo:101: 00010000:00010000:0.0:1788263145.606615:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263145.606629:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3bd17f800/0x4b1103cba666f187 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f180 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263145.607597:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3bd17f800/0x4b1103cba666f187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f180 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263145.607612:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3bd17f800/0x4b1103cba666f187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f180 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263145.607621:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17f800, rc 0) 00000100:00100000:2.0:1788263145.607876:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384df6000 going to sleep for 11 seconds 00000100:00100000:0.0:1788263145.607940:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:6489:x1875129709649152:12345-0@lo:101: Request processed in 1337us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263145.607948:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788263145.610266:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709649152:0@lo:101: 00010000:00010000:3.0:1788263145.610292:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f180 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f187 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263145.610304:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f180 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f187 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263145.610385:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387687b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709649280:0@lo:256: 00000100:00100000:3.0:1788263145.610441:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263145.610488:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384e23240 going to sleep for 11 seconds 00000100:00100000:0.0:1788263145.610646:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709649280 00000100:00100000:0.0:1788263145.610652:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709649280 00000100:00100000:0.0:1788263145.610694:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788263145.610703:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:6489:x1875129709649280:12345-0@lo:256: 20000000:01000000:0.0:1788263145.610722:0:8424:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788263145.620816:0:8424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788263145.620826:0:8424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788263145.620954:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:6489:x1875129709649280:12345-0@lo:256: Request processed in 10249us (10509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263145.620970:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788263145.621034:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387687b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709649280:0@lo:256: 10000000:01000000:0.0:1788263145.621091:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788263145.621100:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f180 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f187 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263145.621111:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f180 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f187 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263145.621120:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788263145.621123:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1788263145.621125:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788263145.621157:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f18e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263145.621165:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f18e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263145.621174:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f18e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263145.621192:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709649408:0@lo:101: 00000100:00100000:0.0:1788263145.621224:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263145.621252:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae55f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788263145.621267:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709649408 00000100:00100000:0.0:1788263145.621274:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709649408 00000100:00100000:0.0:1788263145.621309:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788263145.621317:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:6489:x1875129709649408:12345-0@lo:101: 00010000:00010000:0.0:1788263145.621336:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263145.621347:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3bd17fa00/0x4b1103cba666f195 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f18e expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263145.621369:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3bd17fa00/0x4b1103cba666f195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f18e expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263145.621379:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3bd17fa00/0x4b1103cba666f195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f18e expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263145.621388:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17fa00, rc 0) 00000100:00100000:0.0:1788263145.621416:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709649408:12345-0@lo:101: Request processed in 100us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263145.621422:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788263145.621450:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709649408:0@lo:101: 00010000:00010000:0.0:1788263145.621461:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f18e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f195 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263145.621469:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f18e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f195 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263145.621526:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709649536:0@lo:501: 00000100:00100000:0.0:1788263145.621548:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263145.621562:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a05bcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788263145.621572:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709649536 00000100:00100000:0.0:1788263145.621575:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709649536 00000100:00100000:0.0:1788263145.621619:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788263145.621626:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709649536:12345-0@lo:501: 00000100:00100000:0.0:1788263145.621807:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709649536:12345-0@lo:501: Request processed in 181us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263145.621813:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788263145.621841:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709649536:0@lo:501: 00000100:00100000:0.0:1788263145.621864:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709649664:0@lo:503: 00000100:00100000:0.0:1788263145.621902:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263145.621914:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a05bcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788263145.621924:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709649664 00000100:00100000:0.0:1788263145.621933:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709649664 00000100:00100000:0.0:1788263145.621953:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788263145.621959:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709649664:12345-0@lo:503: 00000100:00100000:0.0:1788263145.622030:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709649664:12345-0@lo:503: Request processed in 70us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263145.622036:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788263145.622074:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709649664:0@lo:503: 00000100:00100000:0.0:1788263145.622230:0:8603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:8603:1875129709649792:0@lo:502: 00000100:00100000:0.0:1788263145.622260:0:8603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263145.622276:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709649792 00000100:00100000:0.0:1788263145.622279:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709649792 00000100:00100000:0.0:1788263145.622298:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788263145.622304:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:8603:x1875129709649792:12345-0@lo:502: 00000100:00100000:0.0:1788263145.622371:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:8603:x1875129709649792:12345-0@lo:502: Request processed in 66us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263145.622377:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788263145.622400:0:8603:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a05bca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263145.622415:0:8603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:8603:1875129709649792:0@lo:502: 00000020:01000000:0.0:1788263145.622433:0:8603:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788263145.622440:0:8603:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788263145.622445:0:8603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263145.622448:0:8603:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788263145.622453:0:8603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788263145.622457:0:8603:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:01000000:0.0:1788263145.622487:0:8603:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788263145.622490:0:8603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788263145.622504:0:8603:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9ff3b0050000) 00000020:00000080:0.0:1788263145.622524:0:8603:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1788263145.622530:0:8603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788263145.622615:0:8603:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788263145.622622:0:8603:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788263145.622632:0:8603:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b1103cba666f1a3 00010000:00080000:0.0:1788263145.622662:0:8603:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ff387647000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.126@tcp at head 00010000:00010000:0.0:1788263145.624005:0:8603:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788263145.633842:0:8603:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788263145.633862:0:8603:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788263145.634043:0:8603:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788263145.634307:0:8603:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788263145.634388:0:8603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788263145.634501:0:8603:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788263145.648499:0:8605:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788263145.648507:0:8605:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788263145.651740:0:8603:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788263145.651755:0:8603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788263145.651792:0:8603:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788263145.651814:0:8603:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b1103cba666f1aa 00000100:00080000:2.0:1788263145.651825:0:8603:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788263145.651831:0:8603:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ff387647000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263145.651864:0:8603:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff28178e680 x1875129709649920/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788263145.651882:0:8603:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1788263145.651967:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709649920:0@lo:8: 00000100:00100000:1.0:1788263145.652033:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263145.652866:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709649920 00000100:00100000:3.0:1788263145.652876:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709649920 00000100:00100000:3.0:1788263145.652908:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788263145.652915:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387615f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3617:x1875129709649920:12345-0@lo:8: 00010000:00080000:3.0:1788263145.652941:0:8404:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:3.0:1788263145.653110:0:8404:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b1103cba666f1b1 00002000:00100000:3.0:1788263145.653141:0:8404:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9ff3af75d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788263145.653146:0:8404:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1788263145.653149:0:8404:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788263145.653207:0:8404:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788263145.653417:0:8404:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788263145.653441:0:8404:0:(import.c:65:import_set_state_nolock()) ffff9ff3af759000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788263145.653514:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387615f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1875129709649920:12345-0@lo:8: Request processed in 598us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263145.653521:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788263145.653570:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff28178e680 x1875129709649920/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788263155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263145.653599:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788263145.653606:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788263145.653613:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788263145.653618:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788263145.653620:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff387647000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788263145.653633:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788263145.653637:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709649920:0@lo:8: 00000004:00080000:2.0:1788263145.660850:0:8605:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788263145.660921:0:8605:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 154732341335ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788263145.660928:0:8605:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788263145.661990:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875129709650048:0@lo:400: 00000100:00100000:0.0:1788263145.662052:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263145.662206:0:8606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387617480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8606:1875129709650816:0@lo:700: 00000100:00100000:0.0:1788263145.662377:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875129709650560:0@lo:400: 00000020:01000000:2.0:1788263145.662503:0:8603:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263145.662510:0:8603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263145.662512:0:8603:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788263145.662515:0:8603:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263145.662519:0:8603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263145.662521:0:8603:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788263145.662524:0:8603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788263145.662526:0:8603:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788263145.662545:0:8603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:8603:1875129709650944:0@lo:502: 00000100:00100000:1.0:1788263145.662631:0:8606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263145.662654:0:8606:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3b4e0f480 going to sleep for 11 seconds 00000100:00100000:3.0:1788263145.663188:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709650816 00000100:00100000:3.0:1788263145.663195:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709650816 00000100:00100000:3.0:1788263145.663241:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788263145.663250:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8606:x1875129709650816:12345-0@lo:700: 00000100:00100000:3.0:1788263145.663288:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387687480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8412:1875129709651072:0@lo:700: 00000100:00100000:3.0:1788263145.663332:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263145.663350:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384e23cc0 going to sleep for 11 seconds 00000100:00080000:3.0:1788263145.663370:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788263145.663386:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709651072 00000100:00100000:3.0:1788263145.663390:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709651072 00000100:00100000:3.0:1788263145.663420:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788263145.663426:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8412:x1875129709651072:12345-0@lo:700: 00000100:00080000:3.0:1788263145.663519:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263145.665678:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263145.665721:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788263145.666134:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709650432:0@lo:400: 00000100:00100000:0.0:1788263145.666182:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263145.666218:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709650176:0@lo:400: 00000100:00100000:0.0:1788263145.666239:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263145.666256:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5472680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709650688:0@lo:400: 00000100:00100000:0.0:1788263145.666281:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263145.666307:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263145.666323:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709650304:0@lo:400: 00000100:00100000:0.0:1788263145.666344:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263145.666371:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709650048 00000100:00100000:0.0:1788263145.666376:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709650048 00000100:00100000:0.0:1788263145.666402:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709650560 00000100:00100000:0.0:1788263145.666405:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709650560 00000100:00100000:0.0:1788263145.666415:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709650688 00000100:00100000:0.0:1788263145.666416:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709650688 00000100:00100000:0.0:1788263145.666438:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709650304 00000100:00100000:0.0:1788263145.666441:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709650304 00000100:00100000:0.0:1788263145.666453:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788263145.666460:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875129709650048:12345-0@lo:400: 00000100:00100000:0.0:1788263145.666515:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875129709650048:12345-0@lo:400: Request processed in 55us (4464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263145.666522:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788263145.666537:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788263145.666543:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5470700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3621:x1875129709650560:12345-0@lo:400: 00000100:00100000:0.0:1788263145.666569:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5470700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3621:x1875129709650560:12345-0@lo:400: Request processed in 26us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263145.666575:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788263145.666604:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788263145.666610:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709650688:12345-0@lo:400: 00000100:00100000:0.0:1788263145.666847:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709650688:12345-0@lo:400: Request processed in 236us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263145.666854:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788263145.666866:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788263145.666872:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709650304:12345-0@lo:400: 00000100:00100000:0.0:1788263145.666900:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709650304:12345-0@lo:400: Request processed in 28us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263145.666905:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788263145.667160:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709650432 00000100:00100000:0.0:1788263145.667165:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709650432 00000100:00100000:0.0:1788263145.667184:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709650176 00000100:00100000:0.0:1788263145.667187:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709650176 00000100:00100000:0.0:1788263145.667199:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788263145.667205:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709650432:12345-0@lo:400: 00000100:00100000:0.0:1788263145.667238:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709650432:12345-0@lo:400: Request processed in 33us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263145.667244:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788263145.667256:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788263145.667263:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709650176:12345-0@lo:400: 00000100:00100000:0.0:1788263145.667288:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709650176:12345-0@lo:400: Request processed in 27us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263145.667294:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788263145.667393:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3a0f6df80 x1875129709650304/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263145.667407:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709650304:0@lo:400: 00000100:00100000:0.0:1788263145.667420:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709650176:0@lo:400: 00010000:00080000:0.0:1788263145.667438:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3b5472680 x1875129709650688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263145.667447:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5472680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709650688:0@lo:400: 00000100:00080000:3.0:1788263145.667847:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788263145.668361:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709650432:0@lo:400: 00010000:00080000:0.0:1788263145.668374:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3a0f6d880 x1875129709650048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263145.668383:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875129709650048:0@lo:400: 00010000:00080000:0.0:1788263145.668394:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3b5471500 x1875129709650560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263145.668403:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875129709650560:0@lo:400: 00000100:00100000:2.0:1788263145.672378:0:8603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263145.672425:0:8603:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384df6000 going to sleep for 11 seconds 00000100:00100000:1.0:1788263145.672444:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709650944 00000100:00100000:1.0:1788263145.672452:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709650944 00000100:00100000:1.0:1788263145.672517:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788263145.672527:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:8603:x1875129709650944:12345-0@lo:502: 00000100:00100000:1.0:1788263145.672673:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:8603:x1875129709650944:12345-0@lo:502: Request processed in 148us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263145.672680:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788263145.672965:0:8603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:8603:1875129709650944:0@lo:502: 00000020:01000000:2.0:1788263145.672994:0:8603:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263145.673002:0:8603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263145.673004:0:8603:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788263145.673008:0:8603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000004:00080000:1.0:1788263145.673415:0:7422:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000020:01000000:0.0:1788263145.673540:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1788263145.673559:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788263145.673568:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f18e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f195 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263145.673607:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f18e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f195 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263145.673618:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788263145.673620:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ff3888e6000 from 30 10000000:01000000:0.0:1788263145.673623:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788263145.673650:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f1b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263145.673659:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f1b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263145.673681:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f1b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263145.673818:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709651200:0@lo:101: 00000100:00100000:0.0:1788263145.673864:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263145.673894:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3f99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263145.674221:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709651200 00000100:00100000:1.0:1788263145.674228:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709651200 00000100:00100000:1.0:1788263145.674264:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788263145.674272:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709651200:12345-0@lo:101: 00010000:00010000:1.0:1788263145.674283:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263145.674295:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff381680200/0x4b1103cba666f1bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f1b8 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263145.674326:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff381680200/0x4b1103cba666f1bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f1b8 expref: 18 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263145.674344:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff381680200/0x4b1103cba666f1bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f1b8 expref: 18 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263145.674352:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381680200, rc 0) 00000100:00100000:1.0:1788263145.674391:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:6489:x1875129709651200:12345-0@lo:101: Request processed in 120us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263145.674396:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788263145.674511:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709651200:0@lo:101: 00010000:00010000:0.0:1788263145.674524:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f1b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f1bf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263145.674532:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f1b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f1bf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263145.674608:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709651328:0@lo:501: 00000100:00100000:0.0:1788263145.674635:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263145.674656:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3f99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263145.674889:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709651328 00000100:00100000:1.0:1788263145.674894:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709651328 00000100:00100000:1.0:1788263145.674921:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788263145.674928:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:6489:x1875129709651328:12345-0@lo:501: 00000100:00100000:1.0:1788263145.675027:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:6489:x1875129709651328:12345-0@lo:501: Request processed in 99us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263145.675034:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788263145.675220:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709651328:0@lo:501: 00000100:00100000:0.0:1788263145.675245:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709651456:0@lo:503: 00000100:00100000:0.0:1788263145.675283:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263145.676394:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709651456 00000100:00100000:2.0:1788263145.676403:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709651456 00000100:00100000:2.0:1788263145.676457:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788263145.676465:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:6489:x1875129709651456:12345-0@lo:503: 00000100:00100000:2.0:1788263145.676570:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:6489:x1875129709651456:12345-0@lo:503: Request processed in 106us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263145.676599:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788263145.677835:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3f99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263145.677860:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709651456:0@lo:503: 00000100:00100000:1.0:1788263145.679359:0:8607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5636300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:8607:1875129709651584:0@lo:502: 00000100:00100000:1.0:1788263145.679430:0:8607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263145.679466:0:8607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3b4e0f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788263145.680134:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709651584 00000100:00100000:2.0:1788263145.680141:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709651584 00000100:00100000:2.0:1788263145.680187:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788263145.680196:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:8607:x1875129709651584:12345-0@lo:502: 00000100:00100000:2.0:1788263145.680453:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:8607:x1875129709651584:12345-0@lo:502: Request processed in 257us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263145.680461:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788263145.680563:0:8607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5636300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:8607:1875129709651584:0@lo:502: 00000100:00100000:1.0:1788263145.680633:0:8607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5636300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:8607:1875129709651712:0@lo:502: 00000100:00100000:1.0:1788263145.680667:0:8607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263145.680698:0:8607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3b4e0f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788263145.680857:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709651712 00000100:00100000:2.0:1788263145.680862:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709651712 00000100:00100000:2.0:1788263145.680890:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788263145.680896:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:8607:x1875129709651712:12345-0@lo:502: 00000100:00100000:2.0:1788263145.680968:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:8607:x1875129709651712:12345-0@lo:502: Request processed in 71us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263145.680975:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788263145.681276:0:8607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5636300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:8607:1875129709651712:0@lo:502: 00000040:00080000:0.0:1788263145.681295:0:8607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788263145.681493:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788263145.681512:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788263145.681520:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f1b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f1bf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263145.681543:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f1b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f1bf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263145.681553:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788263145.681555:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ff3888e6000 from 5 10000000:01000000:1.0:1788263145.681558:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788263145.681611:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff381680a00/0x4b1103cba666f1c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263145.681619:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff381680a00/0x4b1103cba666f1c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263145.681628:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff381680a00/0x4b1103cba666f1c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263145.681641:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5634a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709651840:0@lo:101: 00000100:00100000:1.0:1788263145.681671:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263145.681700:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3b4e0f600 going to sleep for 11 seconds 40000000:02000000:2.0:1788263145.681815:0:6498:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:0.0:1788263145.682708:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709651840 00000100:00100000:0.0:1788263145.682722:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709651840 00000100:00100000:0.0:1788263145.682814:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788263145.682822:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:6489:x1875129709651840:12345-0@lo:101: 00010000:00010000:0.0:1788263145.682833:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263145.682845:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3bd17e400/0x4b1103cba666f1cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f1c6 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263145.682866:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3bd17e400/0x4b1103cba666f1cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f1c6 expref: 19 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263145.682875:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3bd17e400/0x4b1103cba666f1cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f1c6 expref: 19 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263145.682883:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17e400, rc 0) 00000100:00100000:0.0:1788263145.682929:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:6489:x1875129709651840:12345-0@lo:101: Request processed in 108us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263145.682936:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788263145.682975:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5634a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709651840:0@lo:101: 00010000:00010000:0.0:1788263145.682988:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff381680a00/0x4b1103cba666f1c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f1cd expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263145.682996:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff381680a00/0x4b1103cba666f1c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f1cd expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263145.683045:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709651968:0@lo:256: 00000100:00100000:0.0:1788263145.684277:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263145.684407:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709651968 00000100:00100000:1.0:1788263145.684414:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709651968 00000100:00100000:1.0:1788263145.684448:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788263145.684457:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:6489:x1875129709651968:12345-0@lo:256: 20000000:01000000:1.0:1788263145.684484:0:8424:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788263145.684503:0:8424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788263145.684506:0:8424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788263145.684604:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:6489:x1875129709651968:12345-0@lo:256: Request processed in 148us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263145.684612:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788263145.684834:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3f9300 going to sleep for 11 seconds 00000100:00100000:0.0:1788263145.684852:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709651968:0@lo:256: 10000000:01000000:0.0:1788263145.684913:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788263145.684920:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff381680a00/0x4b1103cba666f1c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f1cd expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263145.684931:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff381680a00/0x4b1103cba666f1c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f1cd expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263145.684940:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788263145.684942:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788263145.684945:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788263145.684966:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f1d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263145.684974:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f1d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263145.684983:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f1d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263145.684998:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709652096:0@lo:101: 00000100:00100000:0.0:1788263145.685024:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263145.685039:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3f9300 going to sleep for 11 seconds 00000100:00100000:1.0:1788263145.685862:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709652096 00000100:00100000:1.0:1788263145.685869:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709652096 00000100:00100000:1.0:1788263145.685900:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788263145.685906:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:6489:x1875129709652096:12345-0@lo:101: 00010000:00010000:1.0:1788263145.685916:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263145.685928:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff381680c00/0x4b1103cba666f1db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f1d4 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263145.685948:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff381680c00/0x4b1103cba666f1db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f1d4 expref: 20 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263145.685956:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff381680c00/0x4b1103cba666f1db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f1d4 expref: 20 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263145.685964:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381680c00, rc 0) 00000100:00100000:1.0:1788263145.686002:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:6489:x1875129709652096:12345-0@lo:101: Request processed in 95us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263145.686008:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788263145.686845:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709652096:0@lo:101: 00010000:00010000:0.0:1788263145.686864:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f1d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f1db expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263145.686875:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f1d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f1db expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263145.686953:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709652224:0@lo:501: 00000100:00100000:0.0:1788263145.686989:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263145.687012:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3f9300 going to sleep for 11 seconds 00000100:00100000:1.0:1788263145.687854:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709652224 00000100:00100000:1.0:1788263145.687862:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709652224 00000100:00100000:1.0:1788263145.688194:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788263145.688204:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:6489:x1875129709652224:12345-0@lo:501: 00000100:00100000:1.0:1788263145.689195:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:6489:x1875129709652224:12345-0@lo:501: Request processed in 990us (2202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263145.689205:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788263145.689367:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709652224:0@lo:501: 00000100:00100000:0.0:1788263145.689411:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709652352:0@lo:503: 00000100:00100000:0.0:1788263145.689463:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263145.689502:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3f9300 going to sleep for 11 seconds 00000100:00100000:1.0:1788263145.689803:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709652352 00000100:00100000:1.0:1788263145.689809:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709652352 00000100:00100000:1.0:1788263145.689844:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788263145.689852:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:6489:x1875129709652352:12345-0@lo:503: 00000100:00100000:1.0:1788263145.689942:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:6489:x1875129709652352:12345-0@lo:503: Request processed in 91us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263145.689948:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788263145.690911:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709652352:0@lo:503: 00000100:00100000:1.0:1788263145.692921:0:8608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5636d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:8608:1875129709652480:0@lo:502: 00000100:00100000:1.0:1788263145.692993:0:8608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263145.693029:0:8608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3b4e0f240 going to sleep for 11 seconds 00000100:00100000:0.0:1788263145.694264:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709652480 00000100:00100000:0.0:1788263145.694273:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709652480 00000100:00100000:0.0:1788263145.694326:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788263145.694336:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:8608:x1875129709652480:12345-0@lo:502: 00000100:00100000:0.0:1788263145.694486:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:8608:x1875129709652480:12345-0@lo:502: Request processed in 150us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263145.694494:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788263145.694628:0:8608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5636d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:8608:1875129709652480:0@lo:502: 00000020:01000000:1.0:1788263145.694658:0:8608:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788263145.694665:0:8608:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788263145.694672:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263145.694675:0:8608:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788263145.694679:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788263145.694683:0:8608:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:01000000:1.0:1788263145.695382:0:8608:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788263145.695386:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788263145.695412:0:8608:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ff3af7e0000) 00000020:00000080:1.0:1788263145.695437:0:8608:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1788263145.695443:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788263145.695561:0:8608:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788263145.695568:0:8608:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788263145.695575:0:8608:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b1103cba666f1e9 00010000:00080000:1.0:1788263145.695622:0:8608:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ff3af7d8800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.126@tcp at head 00010000:00010000:1.0:1788263145.700375:0:8608:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:1.0:1788263145.714074:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8412:x1875129709651072:12345-0@lo:700: Request processed in 50632us (50725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263145.714088:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788263145.715441:0:8412:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff387687480 x1875129709651072/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788263161 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263145.715496:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387687480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8412:1875129709651072:0@lo:700: 40000000:02000000:1.0:1788263145.715509:0:8412:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:3.0:1788263145.731491:0:8608:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788263145.731514:0:8608:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788263145.732120:0:8608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788263145.732334:0:8608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788263145.732419:0:8608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788263145.732511:0:8608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788263145.734052:0:8609:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788263145.734057:0:8609:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000001:00100000:0.0:1788263145.735204:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788263145.735468:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8606:x1875129709650816:12345-0@lo:700: Request processed in 72214us (72832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263145.735493:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788263145.735671:0:8606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff387617480 x1875129709650816/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788263161 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263145.736138:0:8606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387617480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8606:1875129709650816:0@lo:700: 00000020:00000080:2.0:1788263145.736232:0:8608:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788263145.736244:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788263145.736283:0:8608:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788263145.736305:0:8608:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b1103cba666f1f0 00000100:00080000:2.0:1788263145.736329:0:8608:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788263145.736333:0:8608:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ff3af7d8800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263145.736361:0:8608:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff28178df80 x1875129709652608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788263145.736383:0:8608:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788263145.736451:0:8608:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263145.736455:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263145.736457:0:8608:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788263145.736459:0:8608:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263145.736463:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263145.736464:0:8608:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788263145.736466:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788263145.736468:0:8608:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788263145.736499:0:8608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:8608:1875129709652736:0@lo:502: 00000100:00100000:2.0:1788263145.736550:0:8608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263145.736608:0:8608:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384df6600 going to sleep for 11 seconds 00000100:00100000:3.0:1788263145.737163:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709652608:0@lo:8: 00000100:00100000:3.0:1788263145.737201:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263145.737470:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709652736 00000100:00100000:1.0:1788263145.737487:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709652736 00000100:00100000:1.0:1788263145.737536:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788263145.737545:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:8608:x1875129709652736:12345-0@lo:502: 00000100:00100000:2.0:1788263145.737804:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709652608 00000100:00100000:2.0:1788263145.737809:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709652608 00000100:00100000:2.0:1788263145.737828:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788263145.737833:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3617:x1875129709652608:12345-0@lo:8: 00010000:00080000:2.0:1788263145.737852:0:8406:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:2.0:1788263145.737876:0:8406:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b1103cba666f1f7 00002000:00100000:2.0:1788263145.742919:0:8406:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ff281fab800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788263145.742931:0:8406:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788263145.742934:0:8406:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788263145.743017:0:8406:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788263145.743049:0:8406:0:(import.c:65:import_set_state_nolock()) ffff9ff281fa9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263145.744895:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1875129709652608:12345-0@lo:8: Request processed in 7055us (7687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263145.744915:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788263145.748044:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff28178df80 x1875129709652608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788263155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263145.748075:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788263145.748084:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788263145.748092:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788263145.748099:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788263145.748102:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3af7d8800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788263145.748118:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788263145.748124:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709652608:0@lo:8: 00000100:00100000:1.0:1788263145.748871:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:8608:x1875129709652736:12345-0@lo:502: Request processed in 11323us (12316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263145.748882:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000004:00080000:0.0:1788263145.749656:0:8609:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788263145.749708:0:8609:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 154821128534ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788263145.749723:0:8609:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788263145.751347:0:8608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:8608:1875129709652736:0@lo:502: 00000020:01000000:3.0:1788263145.751384:0:8608:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788263145.751391:0:8608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263145.751393:0:8608:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788263145.751402:0:8608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1788263145.751461:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788263145.751489:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788263145.751499:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f1d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f1db expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263145.751510:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f1d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f1db expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263145.751519:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788263145.751521:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ff3b0028000 from 1 10000000:01000000:3.0:1788263145.751524:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788263145.751551:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f1fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263145.751559:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f1fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263145.751568:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f1fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263145.751600:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387684e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709652864:0@lo:101: 00000100:00100000:3.0:1788263145.751654:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263145.751693:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384e23300 going to sleep for 11 seconds 00000100:00100000:3.0:1788263145.751709:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709652864 00000100:00100000:3.0:1788263145.751722:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709652864 00000100:00100000:3.0:1788263145.751758:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788263145.751767:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:6489:x1875129709652864:12345-0@lo:101: 00010000:00010000:3.0:1788263145.751779:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263145.751790:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3829e8400/0x4b1103cba666f205 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f1fe expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263145.751830:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3829e8400/0x4b1103cba666f205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f1fe expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263145.751840:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3829e8400/0x4b1103cba666f205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f1fe expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263145.751848:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3829e8400, rc 0) 00000100:00100000:3.0:1788263145.751880:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709652864:12345-0@lo:101: Request processed in 114us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263145.751886:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788263145.751914:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387684e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709652864:0@lo:101: 00010000:00010000:3.0:1788263145.751925:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f1fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f205 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263145.751933:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f1fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f205 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263145.751973:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387684e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709652992:0@lo:501: 00000100:00100000:3.0:1788263145.751991:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263145.752003:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384e23300 going to sleep for 11 seconds 00000100:00100000:3.0:1788263145.752013:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709652992 00000100:00100000:3.0:1788263145.752015:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709652992 00000100:00100000:3.0:1788263145.752032:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788263145.752038:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709652992:12345-0@lo:501: 00000100:00100000:3.0:1788263145.752101:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709652992:12345-0@lo:501: Request processed in 62us (108us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788263145.752107:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788263145.752138:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387684e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709652992:0@lo:501: 10000000:01000000:3.0:1788263145.752158:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788263145.752162:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f1fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f205 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263145.752182:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f1fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f205 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788263145.756843:0:8606:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788263145.756871:0:8606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5634000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8606:1875129709653248:0@lo:7: 00000100:00100000:1.0:1788263145.756931:0:8606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263145.756967:0:8606:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3b4e0fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788263145.756992:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709653248 00000100:00100000:1.0:1788263145.756998:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709653248 00000100:00100000:1.0:1788263145.757039:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788263145.757047:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8606:x1875129709653248:12345-0@lo:7: 00000100:00100000:0.0:1788263145.757394:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709653120:0@lo:13: 00000100:00100000:0.0:1788263145.757430:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1788263145.760912:0:8405:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788263145.760919:0:8405:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788263145.761009:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8606:x1875129709653248:12345-0@lo:7: Request processed in 3959us (4074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263145.761020:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788263145.765739:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709653120 00000100:00100000:0.0:1788263145.765753:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709653120 00000100:00100000:0.0:1788263145.765876:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788263145.765888:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709653120:12345-0@lo:13: 00002000:00000024:0.0:1788263145.765919:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923808256 avail 3692285952 00010000:00080000:3.0:1788263145.765973:0:8606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3b5634000 x1875129709653248/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788263161 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263145.765990:0:8606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5634000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8606:1875129709653248:0@lo:7: 00000004:00080000:3.0:1788263145.766005:0:8606:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788263145.766009:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709653120:12345-0@lo:13: Request processed in 122us (8576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263145.766018:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788263145.766052:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3b5636d80 x1875129709653120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263145.766067:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709653120:0@lo:13: 00000004:00080000:2.0:1788263145.767648:0:6470:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788263145.767781:0:8610:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788263145.767804:0:8610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5472680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8610:1875129709653504:0@lo:7: 00000100:00100000:3.0:1788263145.767825:0:8606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387684e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8606:1875129709653632:0@lo:5: 00000100:00100000:0.0:1788263145.768144:0:8610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263145.768220:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709653504 00000100:00100000:1.0:1788263145.768227:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709653504 00000100:00100000:1.0:1788263145.768388:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788263145.768398:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8610:x1875129709653504:12345-0@lo:7: 00000100:00080000:2.0:1788263145.768467:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263145.768772:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788263145.768785:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709653376:0@lo:13: 00000100:00100000:0.0:1788263145.773905:0:8610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3f9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788263145.775366:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263145.775426:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709653376 00000100:00100000:2.0:1788263145.775434:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709653376 00000100:00100000:2.0:1788263145.775488:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788263145.775498:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875129709653376:12345-0@lo:13: 00002000:00000024:2.0:1788263145.775521:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923808256 avail 3692285952 00000100:00100000:2.0:1788263145.775568:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875129709653376:12345-0@lo:13: Request processed in 72us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263145.775574:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788263145.775627:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3b5473b80 x1875129709653376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263145.775645:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709653376:0@lo:13: 00002000:00080000:1.0:1788263145.776998:0:8406:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788263145.777005:0:8406:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788263145.777209:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8610:x1875129709653504:12345-0@lo:7: Request processed in 8809us (9062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263145.777219:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788263145.777518:0:8606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263145.777544:0:8606:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384e23300 going to sleep for 11 seconds 00000100:00100000:1.0:1788263145.777630:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709653632 00000100:00100000:1.0:1788263145.777637:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709653632 00000100:00100000:1.0:1788263145.777673:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788263145.777779:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8606:x1875129709653632:12345-0@lo:5: 00002000:00080000:1.0:1788263145.777806:0:8404:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1788263145.777848:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8606:x1875129709653632:12345-0@lo:5: Request processed in 168us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263145.777854:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788263145.777913:0:8606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff387684e00 x1875129709653632/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788263161 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263145.777927:0:8606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387684e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8606:1875129709653632:0@lo:5: 00000004:00080000:3.0:1788263145.777937:0:8606:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788263145.777973:0:8606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387684e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8606:1875129709653760:0@lo:5: 00000100:00100000:3.0:1788263145.778007:0:8606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263145.778037:0:8606:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384e23300 going to sleep for 11 seconds 00000100:00100000:1.0:1788263145.778261:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709653760 00000100:00100000:1.0:1788263145.778265:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709653760 00000100:00100000:1.0:1788263145.778294:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788263145.778301:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8606:x1875129709653760:12345-0@lo:5: 00002000:00080000:1.0:1788263145.778387:0:8405:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00010000:00080000:2.0:1788263145.778851:0:8610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3b5472680 x1875129709653504/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788263161 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263145.778864:0:8610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5472680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8610:1875129709653504:0@lo:7: 00000004:00080000:2.0:1788263145.778876:0:8610:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788263145.778903:0:8610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8610:1875129709653888:0@lo:5: 00000100:00100000:2.0:1788263145.778940:0:8610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263145.778999:0:8610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a05bcb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788263145.780657:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8606:x1875129709653760:12345-0@lo:5: Request processed in 2354us (2647us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788263145.780667:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788263145.780689:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709653888 00000100:00100000:1.0:1788263145.780694:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709653888 00000100:00100000:3.0:1788263145.781164:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788263145.781175:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8610:x1875129709653888:12345-0@lo:5: 00002000:00080000:3.0:1788263145.781200:0:8404:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788263145.781209:0:8404:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00010000:00080000:1.0:1788263145.782995:0:8606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff387684e00 x1875129709653760/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788263161 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263145.783015:0:8606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387684e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8606:1875129709653760:0@lo:5: 00000004:00080000:1.0:1788263145.783768:0:8606:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1788263145.783849:0:8606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5470000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8606:1875129709654016:0@lo:900: 00000100:00100000:0.0:1788263145.783918:0:8606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263145.783957:0:8606:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3f9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788263145.784115:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709654016 00000100:00100000:1.0:1788263145.784127:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709654016 00000100:00100000:1.0:1788263145.784333:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788263145.784343:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8606:x1875129709654016:12345-0@lo:900: 00000100:00100000:1.0:1788263145.784405:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8606:x1875129709654016:12345-0@lo:900: Request processed in 64us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263145.784413:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788263145.784481:0:8606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3b5470000 x1875129709654016/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788263161 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263145.784494:0:8606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5470000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8606:1875129709654016:0@lo:900: 00000001:00080000:3.0:1788263145.792958:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:3.0:1788263145.792974:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788263145.792985:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788263145.799275:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8610:x1875129709653888:12345-0@lo:5: Request processed in 18093us (20326us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788263145.799288:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788263145.802952:0:8610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff28178f100 x1875129709653888/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788263161 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263145.802976:0:8610:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788263145.802983:0:8610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8610:1875129709653888:0@lo:5: 00000004:00080000:2.0:1788263145.802998:0:8610:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788263145.805762:0:8610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5636a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8610:1875129709654144:0@lo:700: 00000100:00100000:1.0:1788263145.805833:0:8610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263145.806542:0:8610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd14d780 going to sleep for 11 seconds 00000100:00100000:1.0:1788263145.808241:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709654144 00000100:00100000:1.0:1788263145.808251:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709654144 00000100:00100000:1.0:1788263145.808317:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788263145.808328:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8610:x1875129709654144:12345-0@lo:700: 00000100:00100000:1.0:1788263145.824858:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8610:x1875129709654144:12345-0@lo:700: Request processed in 16523us (19016us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263145.824872:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788263145.825013:0:8610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3b5636a00 x1875129709654144/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788263161 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263145.825090:0:8610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5636a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8610:1875129709654144:0@lo:700: 00000004:02000040:0.0:1788263145.831497:0:8610:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1788263145.839362:0:8610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5472a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8610:1875129709654272:0@lo:5: 00000100:00100000:0.0:1788263145.839442:0:8610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263145.839500:0:8610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3f9480 going to sleep for 11 seconds 00000100:00100000:3.0:1788263145.841018:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709654272 00000100:00100000:3.0:1788263145.841039:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709654272 00000100:00100000:3.0:1788263145.841085:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788263145.841094:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8610:x1875129709654272:12345-0@lo:5: 00002000:00080000:3.0:1788263145.852370:0:8406:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788263145.852390:0:8406:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1788263145.855316:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8610:x1875129709654272:12345-0@lo:5: Request processed in 14209us (15859us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788263145.855329:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788263145.855895:0:8610:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3b5472a00 x1875129709654272/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788263161 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263145.855912:0:8610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5472a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8610:1875129709654272:0@lo:5: 00000004:00080000:0.0:1788263145.855925:0:8610:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:0.0:1788263146.031905:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263147.055807:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263148.080042:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788263148.287203:0:8780:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788263148.592487:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788263148.592512:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709654528:0@lo:41: 00000100:00100000:0.0:1788263148.592626:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263148.592686:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709654528 00000100:00100000:0.0:1788263148.592693:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709654528 00000100:00100000:0.0:1788263148.592733:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788263148.592758:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709654528:12345-0@lo:41: 00000004:00000024:0.0:1788263148.592789:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788263148.592847:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709654528:12345-0@lo:41: Request processed in 106us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263148.592854:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788263148.592950:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709654528:0@lo:41: 00000100:00100000:1.0:1788263148.593315:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709654400:0@lo:41: 00000100:00100000:1.0:1788263148.593367:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263148.594435:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709654400 00000100:00100000:0.0:1788263148.594442:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709654400 00000100:00100000:0.0:1788263148.594496:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788263148.594504:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709654400:12345-0@lo:41: 00000004:00000024:0.0:1788263148.594528:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788263148.594609:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709654400:12345-0@lo:41: Request processed in 106us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263148.594616:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788263148.594656:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709654400:0@lo:41: 00010000:00010000:2.0:1788263149.103701:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788263149.143932:0:8832:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788263149.145092:0:8832:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788263150.127851:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788263150.206505:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1788263151.152400:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709654656:0@lo:400: 00000100:00100000:3.0:1788263151.152480:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263151.152535:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709655168:0@lo:400: 00000100:00100000:3.0:1788263151.152562:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263151.152596:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709655680:0@lo:400: 00000100:00100000:3.0:1788263151.152618:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263151.152655:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788263151.152661:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709655040:0@lo:400: 00000100:00100000:3.0:1788263151.152683:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263151.152695:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709655552:0@lo:400: 00000100:00100000:3.0:1788263151.153213:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263151.153250:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709654656 00000100:00100000:3.0:1788263151.153256:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709654656 00000100:00100000:3.0:1788263151.153310:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788263151.153319:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:3619:x1875129709654656:12345-0@lo:400: 00000100:00100000:3.0:1788263151.153366:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:3619:x1875129709654656:12345-0@lo:400: Request processed in 48us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263151.153374:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788263151.153430:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709654656:0@lo:400: 00010000:00010000:1.0:1788263151.155173:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263151.155193:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709655680 00000100:00100000:1.0:1788263151.155201:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709655680 00000100:00100000:1.0:1788263151.155270:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709655552 00000100:00100000:1.0:1788263151.155285:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709655552 00000100:00100000:1.0:1788263151.155310:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263151.155319:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709655680:12345-0@lo:400: 00000100:00100000:1.0:1788263151.155387:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709655680:12345-0@lo:400: Request processed in 69us (2767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263151.155394:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263151.155408:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788263151.155415:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709655552:12345-0@lo:400: 00000100:00100000:1.0:1788263151.155456:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709655552:12345-0@lo:400: Request processed in 42us (2243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263151.155462:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788263151.155501:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff28178ce00 x1875129709655552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263151.155511:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788263151.155525:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709655552:0@lo:400: 00010000:00080000:1.0:1788263151.155537:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff28178f800 x1875129709655680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263151.155544:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788263151.155553:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709655680:0@lo:400: 00000100:00080000:2.0:1788263151.155649:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788263151.155928:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709654784:0@lo:400: 00000100:00100000:3.0:1788263151.155948:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709655168 00000100:00100000:3.0:1788263151.155954:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709655168 00000100:00100000:0.0:1788263151.155970:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263151.155989:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788263151.155998:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709655296:0@lo:400: 00000100:00100000:3.0:1788263151.156000:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709655168:12345-0@lo:400: 00000100:00100000:0.0:1788263151.156031:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263151.156060:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709655168:12345-0@lo:400: Request processed in 63us (3496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263151.156066:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709655808:0@lo:13: 00000100:00100000:3.0:1788263151.156072:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788263151.156097:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263151.156111:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709654912:0@lo:400: 00000100:00100000:0.0:1788263151.156131:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709655040 00000100:00100000:0.0:1788263151.156136:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709655040 00000100:00100000:0.0:1788263151.156158:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709654784 00000100:00100000:0.0:1788263151.156161:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709654784 00000100:00100000:0.0:1788263151.156172:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709655296 00000100:00100000:0.0:1788263151.156174:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709655296 00000100:00100000:0.0:1788263151.156197:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788263151.156206:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709655040:12345-0@lo:400: 00000100:00100000:3.0:1788263151.156215:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263151.156284:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788263151.156293:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788263151.156309:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709655808 00000100:00100000:2.0:1788263151.156313:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709655808 00000100:00100000:2.0:1788263151.156339:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788263151.156346:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709655808:12345-0@lo:13: 00002000:00000024:2.0:1788263151.156367:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263151.157871:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709654912 00000100:00100000:1.0:1788263151.157879:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709654912 00000100:00100000:1.0:1788263151.157908:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788263151.157915:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709654912:12345-0@lo:400: 00000100:00100000:0.0:1788263151.158522:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709655040:12345-0@lo:400: Request processed in 2317us (5837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263151.158531:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788263151.158686:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788263151.158695:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709654784:12345-0@lo:400: 00000100:00100000:0.0:1788263151.158731:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709654784:12345-0@lo:400: Request processed in 39us (2762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263151.158737:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788263151.158952:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788263151.158961:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709655296:12345-0@lo:400: 00000100:00100000:0.0:1788263151.158994:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709655296:12345-0@lo:400: Request processed in 35us (2963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263151.159000:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788263151.159019:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788263151.159049:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff28178ca80 x1875129709654784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263151.159062:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709654784:0@lo:400: 00010000:00080000:0.0:1788263151.159074:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff28178d500 x1875129709655296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263151.159083:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709655296:0@lo:400: 00010000:00080000:0.0:1788263151.159141:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff28178df80 x1875129709655040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263151.159151:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709655040:0@lo:400: 00000100:00100000:0.0:1788263151.159163:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709655168:0@lo:400: 00000100:00100000:3.0:1788263151.167539:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875129709655424:0@lo:400: 00000100:00100000:3.0:1788263151.167618:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263151.167894:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709655808:12345-0@lo:13: Request processed in 11476us (11724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263151.167906:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788263151.167963:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3b5473800 x1875129709655808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263151.167986:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709655808:0@lo:13: 00000100:00100000:1.0:1788263151.168243:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709654912:12345-0@lo:400: Request processed in 10326us (12027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263151.168252:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788263151.168399:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709655936:0@lo:13: 00000100:00100000:3.0:1788263151.168456:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263151.168487:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709654912:0@lo:400: 00000100:00100000:2.0:1788263151.169547:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709655936 00000100:00100000:2.0:1788263151.169555:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709655936 00000100:00100000:2.0:1788263151.169621:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788263151.171926:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709655936:12345-0@lo:13: 00002000:00000024:2.0:1788263151.171950:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263151.172024:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709655936:12345-0@lo:13: Request processed in 111us (3567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263151.172042:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788263151.173549:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff387684e00 x1875129709655936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263151.173573:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709655936:0@lo:13: 00000100:00100000:0.0:1788263151.180681:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709655424 00000100:00100000:0.0:1788263151.180695:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709655424 00000100:00100000:0.0:1788263151.180784:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788263151.180796:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875129709655424:12345-0@lo:400: 00000100:00100000:0.0:1788263151.180893:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875129709655424:12345-0@lo:400: Request processed in 100us (13276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263151.180900:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788263151.181117:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788263151.181164:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff28178ed80 x1875129709655424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263151.181179:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875129709655424:0@lo:400: 00010000:00010000:1.0:1788263152.182209:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788263152.297143:0:8935:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788263152.297373:0:8935:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788263153.201604:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788263153.371730:0:8983:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788263153.371739:0:8983:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1788263153.723760:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788263153.723785:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709656064:0@lo:41: 00000100:00100000:2.0:1788263153.723854:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263153.723919:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709656064 00000100:00100000:0.0:1788263153.723931:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709656064 00000100:00100000:0.0:1788263153.723999:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788263153.724008:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709656064:12345-0@lo:41: 00000004:00000024:0.0:1788263153.724038:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788263153.724083:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709656064:12345-0@lo:41: Request processed in 77us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263153.724090:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788263153.725861:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709656064:0@lo:41: 00000100:00100000:0.0:1788263153.728156:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263153.728175:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709656192:0@lo:41: 00000100:00100000:0.0:1788263153.728233:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263153.728339:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709656192 00000100:00100000:0.0:1788263153.728346:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709656192 00000100:00100000:0.0:1788263153.728386:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788263153.728395:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709656192:12345-0@lo:41: 00000004:00000024:0.0:1788263153.728431:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788263153.728467:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709656192:12345-0@lo:41: Request processed in 74us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263153.728473:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788263153.728505:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709656192:0@lo:41: 00010000:00010000:0.0:1788263154.226919:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263155.250229:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263156.272022:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709656320:0@lo:13: 00000100:00100000:2.0:1788263156.272090:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263156.272976:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709656320 00000100:00100000:3.0:1788263156.272985:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709656320 00000100:00100000:3.0:1788263156.273036:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788263156.273050:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709656320:12345-0@lo:13: 00002000:00000024:3.0:1788263156.273075:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263156.273122:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709656320:12345-0@lo:13: Request processed in 73us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263156.273128:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788263156.273164:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff281e3b100 x1875129709656320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263156.273181:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709656320:0@lo:13: 00000100:00080000:1.0:1788263156.273229:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788263156.273335:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263156.273599:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709656576:0@lo:400: 00000100:00100000:3.0:1788263156.273631:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263156.273784:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709656704:0@lo:400: 00000100:00100000:1.0:1788263156.273814:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263156.273838:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875129709657216:0@lo:400: 00000100:00100000:1.0:1788263156.273922:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709656704 00000100:00100000:1.0:1788263156.273927:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709656704 00000100:00100000:1.0:1788263156.273956:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788263156.273962:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709656704:12345-0@lo:400: 00000100:00100000:1.0:1788263156.274001:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709656704:12345-0@lo:400: Request processed in 39us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263156.274007:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788263156.274069:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709656448:0@lo:400: 00000100:00100000:2.0:1788263156.274099:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263156.274126:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709656960:0@lo:400: 00000100:00100000:2.0:1788263156.274145:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263156.274157:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709657472:0@lo:13: 00000100:00100000:2.0:1788263156.274173:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263156.274772:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709656448 00000100:00100000:1.0:1788263156.274779:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709656448 00000100:00100000:1.0:1788263156.274808:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788263156.274815:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:3621:x1875129709656448:12345-0@lo:400: 00000100:00100000:1.0:1788263156.274869:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:3621:x1875129709656448:12345-0@lo:400: Request processed in 44us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263156.274877:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788263156.274914:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709656960 00000100:00100000:1.0:1788263156.274917:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709656960 00000100:00100000:1.0:1788263156.274937:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788263156.274941:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709656960:12345-0@lo:400: 00000100:00100000:1.0:1788263156.274969:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709656960:12345-0@lo:400: Request processed in 27us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263156.274975:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788263156.275538:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709656448:0@lo:400: 00000100:00100000:2.0:1788263156.275551:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709656960:0@lo:400: 00000100:00100000:2.0:1788263156.275567:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788263156.275576:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875129709656832:0@lo:400: 00000100:00100000:3.0:1788263156.276811:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709657088:0@lo:400: 00000100:00100000:3.0:1788263156.276853:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263156.276898:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709656576 00000100:00100000:3.0:1788263156.276904:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709656576 00000100:00100000:3.0:1788263156.276941:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709657088 00000100:00100000:3.0:1788263156.276944:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709657088 00000100:00100000:2.0:1788263156.276964:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263156.276970:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709656832 00000100:00100000:3.0:1788263156.276974:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709656832 00000100:00100000:2.0:1788263156.276987:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709657344:0@lo:400: 00000100:00100000:3.0:1788263156.276994:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788263156.277004:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709656576:12345-0@lo:400: 00000100:00100000:2.0:1788263156.277020:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263156.277076:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709656576:12345-0@lo:400: Request processed in 73us (3442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263156.277083:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788263156.277096:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709657344 00000100:00100000:1.0:1788263156.277101:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709657344 00000100:00100000:3.0:1788263156.277116:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788263156.277130:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709657088:12345-0@lo:400: 00000100:00100000:1.0:1788263156.277136:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788263156.277145:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709657344:12345-0@lo:400: 00000100:00100000:3.0:1788263156.277165:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709657088:12345-0@lo:400: Request processed in 37us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263156.277182:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788263156.277191:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709657344:12345-0@lo:400: Request processed in 47us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263156.277199:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788263156.277218:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788263156.277220:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788263156.277225:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263156.277230:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875129709656832:12345-0@lo:400: 00000100:00100000:1.0:1788263156.277238:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263156.277269:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709656704:0@lo:400: 00000100:00100000:3.0:1788263156.277288:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875129709656832:12345-0@lo:400: Request processed in 61us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263156.277294:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788263156.277303:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff281e3ad80 x1875129709656832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263156.277305:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709657216 00000100:00100000:3.0:1788263156.277312:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709657216 00000100:00100000:1.0:1788263156.277320:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875129709656832:0@lo:400: 00010000:00080000:1.0:1788263156.277328:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff281e38380 x1875129709657344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263156.277348:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709657344:0@lo:400: 00010000:00080000:2.0:1788263156.277421:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff281e3a300 x1875129709656576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263156.277436:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709656576:0@lo:400: 00010000:00080000:2.0:1788263156.277460:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff281e39c00 x1875129709657088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263156.277468:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709657088:0@lo:400: 00000100:00100000:3.0:1788263156.277490:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788263156.277498:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875129709657216:12345-0@lo:400: 00000100:00080000:1.0:1788263156.277511:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788263156.277544:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875129709657216:12345-0@lo:400: Request processed in 45us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263156.277551:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788263156.277681:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709657472 00000100:00100000:3.0:1788263156.277686:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709657472 00000100:00100000:3.0:1788263156.277721:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788263156.277728:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709657472:12345-0@lo:13: 00002000:00000024:3.0:1788263156.277756:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263156.277803:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709657472:12345-0@lo:13: Request processed in 76us (3628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263156.277809:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788263156.277816:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff281e3aa00 x1875129709657216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263156.277826:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875129709657216:0@lo:400: 00010000:00080000:2.0:1788263156.277889:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3b5635180 x1875129709657472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263156.277902:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709657472:0@lo:13: 00010000:00010000:0.0:1788263157.295716:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263158.319690:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263158.831904:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788263158.831927:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709657600:0@lo:41: 00000100:00100000:0.0:1788263158.831994:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263158.832053:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709657600 00000100:00100000:0.0:1788263158.832059:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709657600 00000100:00100000:0.0:1788263158.832098:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788263158.832107:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709657600:12345-0@lo:41: 00000004:00000024:0.0:1788263158.832145:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788263158.832187:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709657600:12345-0@lo:41: Request processed in 81us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263158.832194:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788263158.832235:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709657600:0@lo:41: 00000100:00100000:2.0:1788263158.832326:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263158.832336:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709657728:0@lo:41: 00000100:00100000:2.0:1788263158.832364:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263158.832398:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709657728 00000100:00100000:2.0:1788263158.832402:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709657728 00000100:00100000:2.0:1788263158.832425:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788263158.832431:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709657728:12345-0@lo:41: 00000004:00000024:2.0:1788263158.832446:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788263158.832475:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709657728:12345-0@lo:41: Request processed in 44us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263158.832481:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788263158.832511:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709657728:0@lo:41: 00010000:00010000:1.0:1788263159.344761:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263160.372719:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263161.392747:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875129709657984:0@lo:400: 00000100:00100000:1.0:1788263161.392815:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263161.392855:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875129709658496:0@lo:400: 00000100:00100000:1.0:1788263161.392876:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263161.392904:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788263161.392910:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709657856:0@lo:400: 00000100:00100000:1.0:1788263161.392936:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263161.392958:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709658368:0@lo:400: 00000100:00100000:1.0:1788263161.392981:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263161.392998:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709658880:0@lo:400: 00000100:00100000:1.0:1788263161.393019:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263161.393045:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709658112:0@lo:400: 00000100:00100000:1.0:1788263161.393091:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263161.393112:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709658624:0@lo:400: 00000100:00100000:1.0:1788263161.393139:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263161.393156:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788263161.393161:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709658240:0@lo:400: 00000100:00100000:1.0:1788263161.393181:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263161.393202:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709658752:0@lo:400: 00000100:00100000:1.0:1788263161.393220:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263161.393248:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709657984 00000100:00100000:1.0:1788263161.393255:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709657984 00000100:00100000:1.0:1788263161.393288:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709658496 00000100:00100000:1.0:1788263161.393291:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709658496 00000100:00100000:1.0:1788263161.393315:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709658624 00000100:00100000:1.0:1788263161.393317:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709658624 00000100:00100000:1.0:1788263161.393327:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709658240 00000100:00100000:1.0:1788263161.393329:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709658240 00000100:00100000:1.0:1788263161.393341:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788263161.393349:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875129709657984:12345-0@lo:400: 00000100:00100000:1.0:1788263161.393533:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875129709657984:12345-0@lo:400: Request processed in 184us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263161.393541:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788263161.393560:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788263161.393567:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875129709658496:12345-0@lo:400: 00000100:00100000:1.0:1788263161.393611:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875129709658496:12345-0@lo:400: Request processed in 45us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263161.393617:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788263161.393629:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788263161.393635:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709658624:12345-0@lo:400: 00000100:00100000:1.0:1788263161.393669:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709658624:12345-0@lo:400: Request processed in 35us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263161.393675:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788263161.393688:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788263161.393694:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709658240:12345-0@lo:400: 00000100:00100000:1.0:1788263161.393725:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709658240:12345-0@lo:400: Request processed in 32us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263161.393738:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788263161.393755:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709657856 00000100:00100000:1.0:1788263161.393758:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709657856 00000100:00100000:1.0:1788263161.393787:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788263161.393795:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:3621:x1875129709657856:12345-0@lo:400: 00000100:00100000:1.0:1788263161.393823:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:3621:x1875129709657856:12345-0@lo:400: Request processed in 30us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263161.393828:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788263161.393851:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709658368 00000100:00100000:1.0:1788263161.393855:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709658368 00000100:00100000:1.0:1788263161.393871:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709658112 00000100:00100000:1.0:1788263161.393874:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709658112 00000100:00100000:1.0:1788263161.393890:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788263161.393896:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709658368:12345-0@lo:400: 00000100:00100000:1.0:1788263161.393926:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709658368:12345-0@lo:400: Request processed in 31us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263161.393932:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788263161.393944:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788263161.393950:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5402300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709658112:12345-0@lo:400: 00000100:00100000:1.0:1788263161.393980:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5402300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709658112:12345-0@lo:400: Request processed in 31us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263161.393985:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788263161.394001:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709658880 00000100:00100000:1.0:1788263161.394005:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709658880 00000100:00100000:1.0:1788263161.394034:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709658752 00000100:00100000:1.0:1788263161.394037:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709658752 00000100:00100000:1.0:1788263161.394067:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788263161.394074:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709658880:12345-0@lo:400: 00000100:00100000:1.0:1788263161.394116:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709658880:12345-0@lo:400: Request processed in 44us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263161.394123:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788263161.394134:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788263161.394139:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709658752:12345-0@lo:400: 00000100:00100000:1.0:1788263161.394168:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709658752:12345-0@lo:400: Request processed in 29us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263161.394175:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788263161.394204:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788263161.394208:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788263161.394209:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788263161.394240:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3b5634700 x1875129709658240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263161.394693:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788263161.394707:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709659008:0@lo:13: 00000100:00100000:2.0:1788263161.394744:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263161.394814:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709659008 00000100:00100000:2.0:1788263161.394824:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709659008 00000100:00100000:2.0:1788263161.394848:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788263161.394854:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709659008:12345-0@lo:13: 00002000:00000024:2.0:1788263161.394874:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00010000:3.0:1788263161.394896:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263161.394913:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709659008:12345-0@lo:13: Request processed in 57us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263161.394919:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788263161.394945:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3b5470000 x1875129709659008/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263161.394961:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709659008:0@lo:13: 00000100:00100000:1.0:1788263161.398978:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709658240:0@lo:400: 00010000:00080000:1.0:1788263161.399090:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3b5636a00 x1875129709658752/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263161.399105:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709658752:0@lo:400: 00000100:00100000:1.0:1788263161.399121:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709658112:0@lo:400: 00010000:00080000:1.0:1788263161.399134:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3b5637800 x1875129709658624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263161.399143:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709658624:0@lo:400: 00000100:00100000:1.0:1788263161.399181:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709659136:0@lo:13: 00000100:00100000:1.0:1788263161.399236:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263161.399806:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709659136 00000100:00100000:1.0:1788263161.399818:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709659136 00000100:00100000:1.0:1788263161.399868:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788263161.399878:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5401c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709659136:12345-0@lo:13: 00002000:00000024:1.0:1788263161.399899:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263161.399944:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5401c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709659136:12345-0@lo:13: Request processed in 68us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263161.399950:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788263161.399981:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709657856:0@lo:400: 00000100:00100000:1.0:1788263161.399993:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709658368:0@lo:400: 00010000:00080000:1.0:1788263161.400005:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3b5636d80 x1875129709658880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263161.400079:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709658880:0@lo:400: 00010000:00080000:1.0:1788263161.400095:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3b5636680 x1875129709657984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263161.400103:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5636680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875129709657984:0@lo:400: 00010000:00080000:1.0:1788263161.400113:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3b5635180 x1875129709658496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263161.400120:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875129709658496:0@lo:400: 00010000:00080000:1.0:1788263161.400148:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3b5470000 x1875129709659136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263161.400160:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709659136:0@lo:13: 00010000:00010000:0.0:1788263162.416958:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263163.447238:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788263163.782312:0:9481:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788263163.782316:0:9481:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788263163.782317:0:9481:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788263163.782451:0:9481:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ff281faf000 00000020:01000004:2.0:1788263163.782466:0:9481:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788263163.782479:0:9481:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788263163.782492:0:9481:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ff281fa0000) 00000020:00000080:2.0:1788263163.782508:0:9481:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788263163.849244:0:9481:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788263163.849294:0:9481:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1788263163.882421:0:9481:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788263163.889296:0:9481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788263163.889312:0:9481:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788263163.889323:0:9481:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4b1103cba666f213 00000020:01000004:0.0:1788263163.889331:0:9481:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788263163.889424:0:9481:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.126@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788263163.889427:0:9481:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788263163.889434:0:9481:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788263163.889464:0:9481:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788263163.889468:0:9481:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.126@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788263163.928095:0:9481:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788263163.930325:0:9481:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.126@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788263163.930330:0:9481:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788263163.930332:0:9481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788263163.930333:0:9481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788263163.930335:0:9481:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788263163.930336:0:9481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788263163.930338:0:9481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788263163.930339:0:9481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788263163.930340:0:9481:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788263163.930342:0:9481:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788263163.930344:0:9481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788263163.930557:0:9481:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788263163.930562:0:9481:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788263163.930565:0:9481:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788263163.930566:0:9481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788263163.930753:0:9481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788263163.930755:0:9481:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788263163.930756:0:9481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788263163.930757:0:9481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788263163.930759:0:9481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788263163.930760:0:9481:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788263163.930761:0:9481:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788263163.930762:0:9481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788263163.930763:0:9481:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788263163.930928:0:9481:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788263163.930948:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5402a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709659264:0@lo:253: 00000100:00100000:1.0:1788263163.931027:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263163.931076:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28222b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788263163.931124:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709659264 00000100:00100000:2.0:1788263163.931132:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709659264 00000100:00100000:2.0:1788263163.931264:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788263163.931274:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:9481:x1875129709659264:12345-0@lo:253: 20000000:01000000:2.0:1788263163.931304:0:8424:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788263163.931309:0:8424:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788263163.931313:0:8424:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788263163.931316:0:8424:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1788263163.932031:0:8424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788263163.932168:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1788263163.932182:0:8424:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788263163.932257:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:2.0:1788263163.932273:0:8424:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788263163.932291:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:2.0:1788263163.932307:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1788263163.932480:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1788263163.932561:0:8424:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.126@tcp 20000000:01000000:2.0:1788263163.932564:0:8424:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:2.0:1788263163.933074:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:2.0:1788263163.933084:0:8424:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788263163.933101:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:2.0:1788263163.933107:0:8424:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:2.0:1788263163.933120:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:2.0:1788263163.933127:0:8424:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788263163.933139:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:2.0:1788263163.933156:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:2.0:1788263163.933290:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:2.0:1788263163.933303:0:8424:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.126@tcp 20000000:01000000:2.0:1788263163.933305:0:8424:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:2.0:1788263163.933319:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:2.0:1788263163.933325:0:8424:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788263163.933409:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:2.0:1788263163.933417:0:8424:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:2.0:1788263163.933435:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1788263163.933441:0:8424:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788263163.933453:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1788263163.933470:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:2.0:1788263163.934132:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:2.0:1788263163.934146:0:8424:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.126@tcp 20000000:01000000:2.0:1788263163.934148:0:8424:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:2.0:1788263163.934162:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1788263163.934169:0:8424:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788263163.934181:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1788263163.934249:0:8424:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:2.0:1788263163.934267:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1788263163.934273:0:8424:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788263163.934284:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1788263163.934298:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1788263163.934310:0:8424:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788263163.934312:0:8424:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788263163.934315:0:8424:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788263163.934428:0:8424:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788263163.934430:0:8424:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788263163.935025:0:9487:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1788263163.935048:0:9487:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1788263163.935063:0:9487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1788263163.935301:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1788263163.935320:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1788263163.935334:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:2.0:1788263163.935420:0:8424:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788263163.935422:0:8424:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788263163.937160:0:9488:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1788263163.937258:0:9488:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1788263163.937272:0:9488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788263163.938470:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788263163.938514:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1788263163.938529:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1788263163.938540:0:8424:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788263163.938543:0:8424:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788263163.939142:0:9489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1788263163.939471:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1788263163.939490:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1788263163.939516:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:1.0:1788263163.939529:0:8424:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788263163.939532:0:8424:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788263163.940028:0:9490:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1788263163.940047:0:9490:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1788263163.940062:0:9490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1788263163.940542:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1788263163.940563:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1788263163.940821:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1788263163.940837:0:8424:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788263163.940839:0:8424:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788263163.941169:0:9491:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1788263163.941188:0:9491:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1788263163.941265:0:9491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1788263163.941514:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1788263163.941536:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1788263163.941552:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:1.0:1788263163.941569:0:8424:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788263163.941849:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ff3ae765a00/0x4b1103cba666f21a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.941865:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff3bd17fc00/0x4b1103cba666f110 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f109 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.941943:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f13a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f133 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.941952:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff381681e00/0x4b1103cba666f179 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f172 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.941958:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff3bd17fa00/0x4b1103cba666f195 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f18e expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.941976:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff381680200/0x4b1103cba666f1bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f1b8 expref: 21 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.941983:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff381680c00/0x4b1103cba666f1db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f1d4 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.941990:0:8424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff3829e8400/0x4b1103cba666f205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f1fe expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.941997:0:8424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ff3ae765a00/0x4b1103cba666f21a lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.942034:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff3829e8400/0x4b1103cba666f205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f1fe expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.942048:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff3829e8400/0x4b1103cba666f205 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f1fe expref: 21 pid: 6486 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263163.942062:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5400380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:8424:1875129709659392:0@lo:104: 00000100:00100000:1.0:1788263163.942120:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788263163.942209:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff381680c00/0x4b1103cba666f1db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f1d4 expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.942217:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff381680c00/0x4b1103cba666f1db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f1d4 expref: 21 pid: 6484 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263163.942226:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5400e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:8424:1875129709659520:0@lo:104: 00000100:00100000:1.0:1788263163.942247:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788263163.942840:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff381680200/0x4b1103cba666f1bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f1b8 expref: 21 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.942858:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff381680200/0x4b1103cba666f1bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f1b8 expref: 21 pid: 8424 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263163.942880:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5403480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:8424:1875129709659648:0@lo:104: 00000100:00100000:1.0:1788263163.942908:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263163.942987:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709659392 00000100:00100000:2.0:1788263163.942994:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709659392 00000100:00100000:0.0:1788263163.943045:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709659520 00000100:00100000:0.0:1788263163.943050:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709659520 00000100:00100000:0.0:1788263163.943074:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788263163.943083:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5403800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:8424:x1875129709659392:12345-0@lo:104: 00010000:00010000:0.0:1788263163.943096:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f1fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f205 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.943152:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788263163.943158:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5403800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:8424:x1875129709659392:12345-0@lo:104: Request processed in 78us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263163.943166:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788263163.943181:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788263163.943188:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5401180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:8424:x1875129709659520:12345-0@lo:104: 00010000:00010000:0.0:1788263163.943250:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f1d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f1db expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.943284:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788263163.943295:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5401180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:8424:x1875129709659520:12345-0@lo:104: Request processed in 108us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263163.943302:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1788263163.943321:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788263163.943327:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f1fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f205 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.943335:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9600 already unused, calling callback (ffffffffc12d0c20) 00010000:00010000:3.0:1788263163.943420:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263163.943548:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263163.943555:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f1d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f1db expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.943561:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17f200 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:3.0:1788263163.943564:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f1d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f1db expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.943572:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f1d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f1db expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263163.943594:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f1d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f1db expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263163.943710:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788263163.943739:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f1d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f1db expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.943746:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263163.943762:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f1d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f1db expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.943769:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f1d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f1db expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.943785:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263163.943787:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263163.943789:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263163.943801:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709659776:0@lo:103: 00000100:00100000:3.0:1788263163.943831:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263163.943867:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709659776 10000000:00010000:0.0:1788263163.943956:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f1fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f205 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.943966:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f1fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f205 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263163.943972:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f1fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f205 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263163.943978:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788263163.943994:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f1fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f205 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.944000:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263163.944015:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f1fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f205 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.944020:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f1fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f205 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.944029:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263163.944031:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263163.944033:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263163.944045:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788263163.944053:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709659904:0@lo:103: 00000100:00100000:0.0:1788263163.944078:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263163.944101:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709659904 00000100:00100000:0.0:1788263163.944105:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709659904 00010000:00010000:0.0:1788263163.944122:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff3829e8400/0x4b1103cba666f205 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f1fe expref: 22 pid: 6486 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263163.944144:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788263163.944151:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5470000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:3621:x1875129709659904:12345-0@lo:103: 00010000:00010000:0.0:1788263163.944160:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263163.944164:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff3829e8400/0x4b1103cba666f205 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f1fe expref: 22 pid: 6486 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.944174:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff3829e8400/0x4b1103cba666f205 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f1fe expref: 22 pid: 6486 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.944188:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788263163.944307:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff3bd17fa00/0x4b1103cba666f195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f18e expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.944317:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff3bd17fa00/0x4b1103cba666f195 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f18e expref: 22 pid: 6486 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263163.944326:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5401500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:8424:1875129709660032:0@lo:104: 00000100:00100000:3.0:1788263163.944417:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709659776 00010000:00010000:3.0:1788263163.944433:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff381680c00/0x4b1103cba666f1db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f1d4 expref: 23 pid: 6484 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263163.944448:0:6476:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788263163.944454:0:6476:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788263163.944574:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263163.944691:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709659648 00000100:00100000:2.0:1788263163.944696:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709659648 00000100:00100000:2.0:1788263163.944713:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709660032 00000100:00100000:2.0:1788263163.944715:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709660032 00000100:00100000:2.0:1788263163.944726:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788263163.944732:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5403b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:8424:x1875129709659648:12345-0@lo:104: 00010000:00010000:2.0:1788263163.944741:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f1b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f1bf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.944809:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff381681e00/0x4b1103cba666f179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f172 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.944818:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff381681e00/0x4b1103cba666f179 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f172 expref: 23 pid: 6486 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263163.944827:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5401f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:8424:1875129709660160:0@lo:104: 00010000:00010000:3.0:1788263163.944894:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263163.944897:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263163.945217:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788263163.945223:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5403b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:8424:x1875129709659648:12345-0@lo:104: Request processed in 491us (2314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263163.945231:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788263163.945248:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788263163.945263:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5402680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:8424:x1875129709660032:12345-0@lo:104: 00010000:00010000:2.0:1788263163.945271:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f18e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f195 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.945305:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788263163.945310:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5402680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:8424:x1875129709660032:12345-0@lo:104: Request processed in 50us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263163.945316:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788263163.945445:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788263163.945453:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:3619:x1875129709659776:12345-0@lo:103: 00010000:00010000:3.0:1788263163.945462:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263163.945467:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff381680c00/0x4b1103cba666f1db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f1d4 expref: 23 pid: 6484 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.945478:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff381680c00/0x4b1103cba666f1db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f1d4 expref: 23 pid: 6484 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.945489:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263163.945526:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:3619:x1875129709659776:12345-0@lo:103: Request processed in 75us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263163.945532:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788263163.945563:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709659776:0@lo:103: 00010000:00010000:3.0:1788263163.945614:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788263163.945619:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f1b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f1bf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.945625:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17e800 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:3.0:1788263163.945629:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f1b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f1bf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.945636:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f1b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f1bf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263163.945642:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f1b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f1bf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263163.945647:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788263163.945668:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f1b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f1bf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.945675:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263163.945687:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f1b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f1bf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.945695:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f1b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f1bf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.945705:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263163.945708:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f18e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f195 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.945714:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17f000 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:3.0:1788263163.945723:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f18e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f195 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.945730:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f18e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f195 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263163.945736:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f18e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f195 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263163.945741:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788263163.945754:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f18e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f195 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.945760:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263163.945770:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f18e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f195 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.945776:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f18e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f195 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.945785:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263163.945787:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263163.945788:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263163.945799:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788263163.945808:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709660288:0@lo:103: 00000100:00100000:3.0:1788263163.945835:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263163.945859:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709660416:0@lo:103: 00000100:00100000:3.0:1788263163.945896:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263163.945918:0:6476:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788263163.945927:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709660288 00000100:00100000:3.0:1788263163.945935:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709660288 00010000:00010000:3.0:1788263163.945950:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff381680200/0x4b1103cba666f1bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f1b8 expref: 23 pid: 8424 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263163.945962:0:6476:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788263163.945968:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709660416 00000100:00100000:3.0:1788263163.945970:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709660416 00010000:00010000:3.0:1788263163.945979:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff3bd17fa00/0x4b1103cba666f195 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f18e expref: 24 pid: 6486 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263163.945989:0:6476:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788263163.945995:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788263163.946000:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3620:x1875129709660288:12345-0@lo:103: 00010000:00010000:3.0:1788263163.946007:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263163.946010:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff381680200/0x4b1103cba666f1bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f1b8 expref: 24 pid: 8424 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.946018:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff381680200/0x4b1103cba666f1bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f1b8 expref: 24 pid: 8424 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.946028:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263163.946055:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3620:x1875129709660288:12345-0@lo:103: Request processed in 55us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263163.946061:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788263163.946072:0:6476:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788263163.946077:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788263163.946082:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a9661850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:3618:x1875129709660416:12345-0@lo:103: 00010000:00010000:3.0:1788263163.946089:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263163.946093:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff3bd17fa00/0x4b1103cba666f195 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f18e expref: 23 pid: 6486 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.946113:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff3bd17fa00/0x4b1103cba666f195 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f18e expref: 23 pid: 6486 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263163.946121:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263163.946147:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a9661850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:3618:x1875129709660416:12345-0@lo:103: Request processed in 64us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263163.946152:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788263163.946174:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709660288:0@lo:103: 00000100:00100000:3.0:1788263163.946203:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709660416:0@lo:103: 00000100:00100000:1.0:1788263163.947855:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788263163.948004:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f13a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f133 expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.948015:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f13a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f133 expref: 22 pid: 6484 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263163.948027:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5401880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:8424:1875129709660544:0@lo:104: 00000100:00100000:1.0:1788263163.948068:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263163.948288:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5470000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:3621:x1875129709659904:12345-0@lo:103: Request processed in 4137us (4207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263163.948297:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788263163.948385:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709659904:0@lo:103: 00010000:00010000:0.0:1788263163.948407:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263163.948522:0:8424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff3bd17fc00/0x4b1103cba666f110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f109 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.948531:0:8424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff3bd17fc00/0x4b1103cba666f110 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f109 expref: 21 pid: 6486 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263163.948541:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5403100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:8424:1875129709660672:0@lo:104: 00000100:00100000:1.0:1788263163.948561:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28222b9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788263163.948575:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3829e8400/0x4b1103cba666f205 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f1fe expref: 21 pid: 6486 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263163.948623:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5400380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:8424:1875129709659392:0@lo:104: 00010000:00010000:1.0:1788263163.948636:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff381680c00/0x4b1103cba666f1db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f1d4 expref: 20 pid: 6484 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263163.948645:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5400e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:8424:1875129709659520:0@lo:104: 00010000:00010000:1.0:1788263163.948654:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff381680200/0x4b1103cba666f1bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f1b8 expref: 19 pid: 8424 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263163.948661:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5403480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:8424:1875129709659648:0@lo:104: 00010000:00010000:1.0:1788263163.948670:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3bd17fa00/0x4b1103cba666f195 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f18e expref: 18 pid: 6486 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263163.948677:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5401500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:8424:1875129709660032:0@lo:104: 00000100:00100000:0.0:1788263163.949045:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709660160 00000100:00100000:0.0:1788263163.949052:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709660160 00000100:00100000:0.0:1788263163.949080:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709660544 00000100:00100000:0.0:1788263163.949083:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709660544 00000100:00100000:0.0:1788263163.949097:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788263163.949104:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5400700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:8424:x1875129709660160:12345-0@lo:104: 00010000:00010000:0.0:1788263163.949125:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f400/0x4b1103cba666f172 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f179 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.949187:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1788263163.949264:0:9492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263163.949271:0:9492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f400/0x4b1103cba666f172 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f179 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.949277:0:9492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17f400 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:2.0:1788263163.949281:0:9492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f400/0x4b1103cba666f172 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f179 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.949289:0:9492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f400/0x4b1103cba666f172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f179 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263163.949297:0:9492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f400/0x4b1103cba666f172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f179 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263163.949303:0:9492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788263163.949325:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5400700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:8424:x1875129709660160:12345-0@lo:104: Request processed in 90us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263163.949332:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788263163.949361:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788263163.949368:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2820f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:8424:x1875129709660544:12345-0@lo:104: 00010000:00010000:0.0:1788263163.949376:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff381681800/0x4b1103cba666f133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f13a expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.949414:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788263163.949418:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2820f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:8424:x1875129709660544:12345-0@lo:104: Request processed in 52us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263163.949424:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788263163.949455:0:6475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263163.949467:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709660672 00000100:00100000:0.0:1788263163.949470:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709660672 00000100:00100000:0.0:1788263163.949485:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788263163.949489:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5473800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:8424:x1875129709660672:12345-0@lo:104: 00000100:00100000:1.0:1788263163.949651:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5401f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:8424:1875129709660160:0@lo:104: 00000100:00100000:1.0:1788263163.949659:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5401880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:8424:1875129709660544:0@lo:104: 00010000:00010000:0.0:1788263163.949750:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f110 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.949796:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788263163.949802:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5473800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:8424:x1875129709660672:12345-0@lo:104: Request processed in 312us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263163.949807:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788263163.949828:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788263163.949833:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff381681800/0x4b1103cba666f133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f13a expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.949839:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381681800 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:0.0:1788263163.949841:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff381681800/0x4b1103cba666f133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f13a expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.949849:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff381681800/0x4b1103cba666f133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f13a expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263163.949855:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff381681800/0x4b1103cba666f133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f13a expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263163.949861:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788263163.949933:0:6474:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:1.0:1788263163.950046:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5403100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0003:MGS:8424:1875129709660672:0@lo:104: 00010000:00010000:1.0:1788263163.950082:0:8424:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ff3ae765a00/0x4b1103cba666f21a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.950165:0:9492:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f400/0x4b1103cba666f172 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f179 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.950172:0:9492:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788263163.950218:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709660800:0@lo:103: 00000100:00100000:1.0:1788263163.950249:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788263163.950427:0:9492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f400/0x4b1103cba666f172 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f179 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.950446:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f400/0x4b1103cba666f172 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f179 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.950457:0:9492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263163.950460:0:9492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f110 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.950465:0:9492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9a00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:2.0:1788263163.950468:0:9492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f110 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.950475:0:9492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f110 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263163.950482:0:9492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f110 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263163.950487:0:9492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788263163.950640:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff381681800/0x4b1103cba666f133 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f13a expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.950647:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263163.950664:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff381681800/0x4b1103cba666f133 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f13a expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.950671:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff381681800/0x4b1103cba666f133 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f13a expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.950682:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263163.950683:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263163.950685:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263163.950691:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788263163.950701:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709660928:0@lo:103: 00000100:00100000:0.0:1788263163.950727:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788263163.950758:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263163.951064:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709660800 00000100:00100000:3.0:1788263163.951070:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709660800 00010000:00010000:3.0:1788263163.951094:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff381681e00/0x4b1103cba666f179 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f172 expref: 18 pid: 6486 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263163.951158:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709660928 00000100:00100000:3.0:1788263163.951163:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709660928 00010000:00010000:3.0:1788263163.951174:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f13a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f133 expref: 19 pid: 6484 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.951618:0:9492:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f109 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f110 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.951625:0:9492:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788263163.951640:0:9492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f109 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f110 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.951646:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f109 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f110 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263163.951663:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788263163.951680:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709661056:0@lo:103: 00000100:00100000:2.0:1788263163.951716:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263163.951750:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709661056 00000100:00100000:2.0:1788263163.951753:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709661056 00010000:00010000:2.0:1788263163.951766:0:9493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff3bd17fc00/0x4b1103cba666f110 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f109 expref: 20 pid: 6486 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263163.951784:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788263163.951791:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5403100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:3619:x1875129709660800:12345-0@lo:103: 00010000:00010000:2.0:1788263163.951801:0:9493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263163.951805:0:9493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff381681e00/0x4b1103cba666f179 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f172 expref: 20 pid: 6486 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.951816:0:9493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff381681e00/0x4b1103cba666f179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f172 expref: 20 pid: 6486 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.951829:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff381681e00/0x4b1103cba666f179 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f172 expref: 20 pid: 6486 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.951841:0:9493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263163.951885:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5403100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:3619:x1875129709660800:12345-0@lo:103: Request processed in 81us (1622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263163.951891:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788263163.951919:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709660800:0@lo:103: 00000100:00100000:2.0:1788263163.951938:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788263163.951944:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387617800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:3621:x1875129709660928:12345-0@lo:103: 00010000:00010000:2.0:1788263163.951951:0:9493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263163.951955:0:9493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f13a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f133 expref: 18 pid: 6484 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.951970:0:9493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f13a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f133 expref: 18 pid: 6484 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.951980:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f13a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f133 expref: 18 pid: 6484 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.951988:0:9493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263163.952012:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387617800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:3621:x1875129709660928:12345-0@lo:103: Request processed in 69us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263163.952018:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788263163.952030:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788263163.952037:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:3620:x1875129709661056:12345-0@lo:103: 00010000:00010000:2.0:1788263163.952043:0:9493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263163.952048:0:9493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff3bd17fc00/0x4b1103cba666f110 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f109 expref: 16 pid: 6486 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.952056:0:9493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff3bd17fc00/0x4b1103cba666f110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f109 expref: 16 pid: 6486 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.952065:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3bd17fc00/0x4b1103cba666f110 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f109 expref: 16 pid: 6486 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.952074:0:9493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ff3ae765a00/0x4b1103cba666f21a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.952081:0:9493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3ae765a00/0x4b1103cba666f21a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.952093:0:9493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff3ae765a00/0x4b1103cba666f21a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.952107:0:9493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff3ae765a00/0x4b1103cba666f21a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.952113:0:9493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ff3ae765a00/0x4b1103cba666f21a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.952119:0:9493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ff3ae765a00/0x4b1103cba666f21a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.952124:0:9493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765a00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:2.0:1788263163.952128:0:9493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ff3ae765a00/0x4b1103cba666f21a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.952134:0:9493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ff3ae765a00/0x4b1103cba666f21a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.952148:0:9493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ff3ae765a00/0x4b1103cba666f21a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.952156:0:9493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788263163.952169:0:8424:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ff3ae765a00/0x4b1103cba666f21a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.952176:0:8424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ff3ae765a00/0x4b1103cba666f21a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.952183:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3ae765a00/0x4b1103cba666f21a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788263163.952419:0:8424:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:2.0:1788263163.953024:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263163.953034:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263163.953036:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263163.953078:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:3620:x1875129709661056:12345-0@lo:103: Request processed in 1040us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263163.953085:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788263163.953116:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709661056:0@lo:103: 00000100:00100000:2.0:1788263163.953731:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709660928:0@lo:103: 00000100:00100000:2.0:1788263163.954469:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788263163.954483:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709661184:0@lo:41: 00000100:00100000:2.0:1788263163.954784:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263163.955863:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709661184 00000100:00100000:1.0:1788263163.955882:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709661184 00000100:00100000:1.0:1788263163.955931:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788263163.955940:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709661184:12345-0@lo:41: 00000004:00000024:1.0:1788263163.955973:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1788263163.956032:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709661184:12345-0@lo:41: Request processed in 94us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263163.956040:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788263163.956810:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709661312:0@lo:41: 00000100:00100000:2.0:1788263163.956850:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263163.957019:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709661184:0@lo:41: 00000100:00100000:2.0:1788263163.957048:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709661312 00000100:00100000:2.0:1788263163.957052:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709661312 00000100:00100000:2.0:1788263163.957084:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788263163.957091:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709661312:12345-0@lo:41: 00000004:00000024:2.0:1788263163.957107:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788263163.957140:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709661312:12345-0@lo:41: Request processed in 50us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263163.957147:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788263163.957176:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709661312:0@lo:41: 00000100:00100000:1.0:1788263163.958137:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:9481:x1875129709659264:12345-0@lo:253: Request processed in 26862us (27107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263163.958146:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788263163.958502:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5402a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709659264:0@lo:253: 10000000:01000000:0.0:1788263163.958516:0:9481:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788263163.958519:0:9481:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788263163.958520:0:9481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788263163.958522:0:9481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788263163.958523:0:9481:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788263163.958524:0:9481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788263163.958526:0:9481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788263163.958527:0:9481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788263163.958529:0:9481:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788263163.958530:0:9481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788263163.958531:0:9481:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788263163.958549:0:9481:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ff281faf000 from lustre-OST0001 10000000:01000000:0.0:1788263163.958574:0:9481:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788263163.958836:0:9481:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788263163.958844:0:9481:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ff3b0028000 local copy 10000000:01000000:0.0:1788263163.958848:0:9481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788263163.958894:0:9481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f221 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.958904:0:9481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f221 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.958914:0:9481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f221 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263163.958933:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709661440:0@lo:101: 00000100:00100000:0.0:1788263163.958970:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263163.959005:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3c05bc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263163.959114:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709661440 00000100:00100000:1.0:1788263163.959120:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709661440 00000100:00100000:1.0:1788263163.959157:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788263163.959165:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a2692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:9481:x1875129709661440:12345-0@lo:101: 00010000:00010000:1.0:1788263163.959175:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263163.959203:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3ae765000/0x4b1103cba666f228 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f221 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.959224:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3ae765000/0x4b1103cba666f228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f221 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.959234:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3ae765000/0x4b1103cba666f228 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f221 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.959256:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae765000, rc 0) 00000100:00100000:1.0:1788263163.959288:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a2692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:9481:x1875129709661440:12345-0@lo:101: Request processed in 123us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263163.959294:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788263163.959539:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709661440:0@lo:101: 00010000:00010000:0.0:1788263163.959551:0:9481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f221 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4b1103cba666f228 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.959567:0:9481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f221 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4b1103cba666f228 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263163.959952:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709661568:0@lo:501: 00000100:00100000:0.0:1788263163.959982:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263163.960011:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3c05bc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263163.960062:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709661568 00000100:00100000:1.0:1788263163.960067:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709661568 00000100:00100000:1.0:1788263163.960100:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788263163.960107:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a2692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:9481:x1875129709661568:12345-0@lo:501: 00000100:00100000:1.0:1788263163.960161:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a2692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:9481:x1875129709661568:12345-0@lo:501: Request processed in 55us (179us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788263163.960167:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788263163.960465:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709661568:0@lo:501: 10000000:01000000:0.0:1788263163.960478:0:9481:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788263163.960506:0:9481:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788263163.960512:0:9481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f221 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4b1103cba666f228 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.960521:0:9481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f221 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4b1103cba666f228 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.960529:0:9481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4b1103cba666f228 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.960552:0:9481:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788263163.960573:0:9481:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ff281faf000 10000000:01000000:0.0:1788263163.960802:0:9481:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788263163.960808:0:9481:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788263163.960812:0:9481:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788263163.960816:0:9481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788263163.960818:0:9481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788263163.960836:0:9481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f22f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.960857:0:9481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f22f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.960866:0:9481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f22f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263163.960945:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709661696:0@lo:101: 00000100:00100000:0.0:1788263163.960975:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263163.961003:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3c05bcd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788263163.961042:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709661696 00000100:00100000:2.0:1788263163.961047:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709661696 00000100:00100000:2.0:1788263163.961078:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788263163.961084:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:9481:x1875129709661696:12345-0@lo:101: 00010000:00010000:2.0:1788263163.961098:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263163.961107:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff398eed800/0x4b1103cba666f236 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f22f expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.961125:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff398eed800/0x4b1103cba666f236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f22f expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.961134:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff398eed800/0x4b1103cba666f236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f22f expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.961142:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eed800, rc 0) 00000100:00100000:2.0:1788263163.961168:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:9481:x1875129709661696:12345-0@lo:101: Request processed in 84us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263163.961173:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00010000:00010000:1.0:1788263163.961329:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263163.961335:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4b1103cba666f228 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.961409:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17fa00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:1.0:1788263163.961413:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f221 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4b1103cba666f228 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.961422:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x4b1103cba666f228 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263163.961430:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f221 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x4b1103cba666f228 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263163.961435:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788263163.961454:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f221 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b1103cba666f228 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.961469:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263163.961489:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f221 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b1103cba666f228 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.961502:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f221 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b1103cba666f228 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263163.961513:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263163.961515:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263163.961517:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263163.961548:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5401f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709661824:0@lo:103: 00000100:00100000:2.0:1788263163.961573:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263163.961745:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709661824 00000100:00100000:2.0:1788263163.961750:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709661824 00000100:00100000:2.0:1788263163.961777:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788263163.961783:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:3620:x1875129709661824:12345-0@lo:103: 00010000:00010000:2.0:1788263163.961791:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263163.961801:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3ae765000/0x4b1103cba666f228 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b1103cba666f221 expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263163.961809:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263163.961833:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:3620:x1875129709661824:12345-0@lo:103: Request processed in 50us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263163.961839:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788263163.961930:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5401f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709661824:0@lo:103: 00000100:00100000:0.0:1788263163.962054:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709661696:0@lo:101: 00010000:00010000:0.0:1788263163.962067:0:9481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f22f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f236 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263163.962075:0:9481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f22f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f236 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263163.962136:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709661952:0@lo:501: 00000100:00100000:0.0:1788263163.962159:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263163.962280:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3c05bcd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788263163.962442:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709661952 00000100:00100000:2.0:1788263163.962447:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709661952 00000100:00100000:2.0:1788263163.962474:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788263163.962479:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:9481:x1875129709661952:12345-0@lo:501: 00000100:00100000:2.0:1788263163.962792:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:9481:x1875129709661952:12345-0@lo:501: Request processed in 312us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263163.962799:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788263163.962860:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709661952:0@lo:501: 00000100:00100000:0.0:1788263163.962944:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709662080:0@lo:503: 00000100:00100000:0.0:1788263163.962980:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263163.963001:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3c05bcd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788263163.963037:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709662080 00000100:00100000:2.0:1788263163.963040:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709662080 00000100:00100000:2.0:1788263163.963065:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788263163.963071:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:9481:x1875129709662080:12345-0@lo:503: 00000100:00100000:2.0:1788263163.963206:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:9481:x1875129709662080:12345-0@lo:503: Request processed in 134us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263163.963212:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788263163.963463:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709662080:0@lo:503: 00000040:00080000:1.0:1788263163.964061:0:9481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788263163.964123:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5401500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709662208:0@lo:502: 00000100:00100000:1.0:1788263163.964157:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263163.964302:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28222b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788263163.964331:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709662208 00000100:00100000:0.0:1788263163.964336:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709662208 00000100:00100000:0.0:1788263163.964441:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788263163.964455:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:9481:x1875129709662208:12345-0@lo:502: 00000100:00100000:0.0:1788263163.966488:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:9481:x1875129709662208:12345-0@lo:502: Request processed in 2028us (2324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263163.966508:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788263163.967479:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5401500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709662208:0@lo:502: 00000040:00080000:1.0:1788263163.968157:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788263163.968297:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788263163.968315:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788263163.968328:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788263163.968418:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788263163.968437:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788263163.968473:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5401500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709662336:0@lo:502: 00000100:00100000:1.0:1788263163.968813:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263163.968898:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28222b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788263163.969078:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709662336 00000100:00100000:0.0:1788263163.969085:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709662336 00000100:00100000:0.0:1788263163.969130:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788263163.969140:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:9481:x1875129709662336:12345-0@lo:502: 00000100:00100000:0.0:1788263163.969840:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:9481:x1875129709662336:12345-0@lo:502: Request processed in 699us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263163.969849:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788263163.970102:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5401500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709662336:0@lo:502: 00000040:00080000:1.0:1788263163.970159:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788263163.970175:0:9481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:2.0:1788263163.971428:0:9494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788263163.971436:0:9494:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788263163.971443:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263163.971446:0:9494:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788263163.971451:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788263163.971465:0:9494:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ff281fa4d28) 00000020:00000080:2.0:1788263163.971489:0:9494:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788263163.971495:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788263163.971566:0:9494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ff281faf000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788263163.971574:0:9494:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788263163.971779:0:9494:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4b1103cba666f244 00010000:00010000:3.0:1788263163.979804:0:9494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1788263163.981017:0:9494:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788263163.986095:0:9494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788263163.986980:0:9494:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788263163.994315:0:9494:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1788263163.995316:0:9494:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788263164.015329:0:9494:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788263164.044048:0:9494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788263164.044061:0:9494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263164.044066:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263164.044068:0:9494:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788263164.044072:0:9494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263164.044075:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263164.044077:0:9494:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788263164.044079:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788263164.044082:0:9494:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788263164.044106:0:9494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263164.044109:0:9494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263164.044110:0:9494:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788263164.044114:0:9494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788263164.045466:0:9481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788263164.045514:0:9481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788263164.045537:0:9481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f22f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f236 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263164.045549:0:9481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f22f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f236 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263164.045556:0:9481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff281faf000 from 1 10000000:01000000:1.0:1788263164.045559:0:9481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788263164.045611:0:9481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f24b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263164.045619:0:9481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f24b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263164.045640:0:9481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f24b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263164.045665:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5401500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709662464:0@lo:101: 00000100:00100000:1.0:1788263164.045724:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263164.045773:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28222be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788263164.045945:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709662464 00000100:00100000:2.0:1788263164.045952:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709662464 00000100:00100000:2.0:1788263164.046003:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788263164.046012:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:9481:x1875129709662464:12345-0@lo:101: 00010000:00010000:2.0:1788263164.046023:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263164.046035:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f252 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f24b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263164.046057:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f252 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f24b expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263164.046067:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f252 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f24b expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263164.046076:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eed400, rc 0) 00000100:00100000:2.0:1788263164.046114:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:9481:x1875129709662464:12345-0@lo:101: Request processed in 104us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263164.046128:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788263164.046169:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5401500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709662464:0@lo:101: 00010000:00010000:2.0:1788263164.046324:0:9481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f24b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f252 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263164.046335:0:9481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f24b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f252 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263164.046486:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709662592:0@lo:501: 00000100:00100000:2.0:1788263164.046511:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263164.046526:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2822bbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263164.046540:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709662592 00000100:00100000:2.0:1788263164.046543:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709662592 00000100:00100000:2.0:1788263164.046567:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788263164.046573:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:9481:x1875129709662592:12345-0@lo:501: 00000100:00100000:0.0:1788263164.048090:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:9481:x1875129709662592:12345-0@lo:501: Request processed in 1512us (1573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263164.048099:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788263164.048745:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709662592:0@lo:501: 00000100:00100000:2.0:1788263164.048784:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709662720:0@lo:503: 00000100:00100000:2.0:1788263164.048826:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263164.048861:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2822bbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788263164.049063:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709662720 00000100:00100000:1.0:1788263164.049069:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709662720 00000100:00100000:1.0:1788263164.049111:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788263164.049119:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:9481:x1875129709662720:12345-0@lo:503: 00000100:00100000:1.0:1788263164.049203:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:9481:x1875129709662720:12345-0@lo:503: Request processed in 85us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263164.049210:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788263164.050711:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709662720:0@lo:503: 00000040:00080000:2.0:1788263164.055369:0:9481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788263164.055468:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709662848:0@lo:502: 00000100:00100000:2.0:1788263164.055551:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263164.055601:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2822bbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263164.056549:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709662848 00000100:00100000:0.0:1788263164.056559:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709662848 00000100:00100000:0.0:1788263164.056659:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788263164.056669:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:9481:x1875129709662848:12345-0@lo:502: 00000100:00100000:0.0:1788263164.056817:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:9481:x1875129709662848:12345-0@lo:502: Request processed in 149us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263164.056823:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788263164.057443:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709662848:0@lo:502: 00000040:00080000:1.0:1788263164.057689:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788263164.057719:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788263164.057749:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5403480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709662976:0@lo:502: 00000100:00100000:1.0:1788263164.057798:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263164.057828:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28222bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263164.058404:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709662976 00000100:00100000:2.0:1788263164.058419:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709662976 00000100:00100000:2.0:1788263164.058461:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788263164.058470:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:9481:x1875129709662976:12345-0@lo:502: 00000100:00100000:2.0:1788263164.058566:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:9481:x1875129709662976:12345-0@lo:502: Request processed in 97us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263164.058574:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788263164.058650:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5403480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709662976:0@lo:502: 00000040:00080000:2.0:1788263164.058699:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788263164.058707:0:9481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788263164.066449:0:9498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788263164.066463:0:9498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263164.066465:0:9498:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788263164.066473:0:9498:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ff281faf000 00000020:00000080:3.0:1788263164.066475:0:9498:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788263164.066487:0:9498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788263164.066496:0:9498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263164.066497:0:9498:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788263164.066500:0:9498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788263164.067292:0:9481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788263164.067330:0:9481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788263164.067362:0:9481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f24b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f252 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263164.067374:0:9481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f24b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f252 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263164.067426:0:9481:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788263164.067429:0:9481:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ff281faf000 10000000:01000000:2.0:1788263164.067431:0:9481:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ff281faf000 10000000:01000000:2.0:1788263164.067435:0:9481:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788263164.067442:0:9481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ff281faf000 from 1 10000000:01000000:2.0:1788263164.067444:0:9481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788263164.067478:0:9481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eec600/0x4b1103cba666f259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263164.067486:0:9481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff398eec600/0x4b1103cba666f259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263164.067496:0:9481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff398eec600/0x4b1103cba666f259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263164.067526:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709663104:0@lo:101: 00000100:00100000:2.0:1788263164.067618:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263164.067655:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2822bb480 going to sleep for 11 seconds 00000100:00100000:3.0:1788263164.067900:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709663104 00000100:00100000:3.0:1788263164.067907:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709663104 00000100:00100000:3.0:1788263164.067950:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788263164.067959:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:9481:x1875129709663104:12345-0@lo:101: 00010000:00010000:3.0:1788263164.067972:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263164.067984:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3829e8800/0x4b1103cba666f260 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f259 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.068005:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3829e8800/0x4b1103cba666f260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f259 expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.068015:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3829e8800/0x4b1103cba666f260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f259 expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.068035:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3829e8800, rc 0) 00000100:00100000:3.0:1788263164.068074:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:9481:x1875129709663104:12345-0@lo:101: Request processed in 117us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263164.068081:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788263164.068208:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709663104:0@lo:101: 00010000:00010000:1.0:1788263164.068222:0:9481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff398eec600/0x4b1103cba666f259 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f260 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263164.068230:0:9481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff398eec600/0x4b1103cba666f259 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f260 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263164.068309:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5400e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709663232:0@lo:501: 00000100:00100000:1.0:1788263164.068336:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263164.068370:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28222bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788263164.068513:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709663232 00000100:00100000:3.0:1788263164.068518:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709663232 00000100:00100000:3.0:1788263164.068550:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788263164.068558:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:9481:x1875129709663232:12345-0@lo:501: 00000100:00100000:3.0:1788263164.068790:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:9481:x1875129709663232:12345-0@lo:501: Request processed in 231us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263164.068797:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788263164.069708:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5400e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709663232:0@lo:501: 00000100:00100000:2.0:1788263164.069747:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709663360:0@lo:503: 00000100:00100000:2.0:1788263164.069798:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263164.069825:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2822bba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788263164.069898:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709663360 00000100:00100000:3.0:1788263164.069908:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709663360 00000100:00100000:3.0:1788263164.069942:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788263164.069948:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:9481:x1875129709663360:12345-0@lo:503: 00000100:00100000:3.0:1788263164.071318:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:9481:x1875129709663360:12345-0@lo:503: Request processed in 1367us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263164.071329:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788263164.078659:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709663360:0@lo:503: 00000040:00080000:2.0:1788263164.078920:0:9481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788263164.078996:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709663488:0@lo:502: 00000100:00100000:2.0:1788263164.079065:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263164.079107:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2822bba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263164.082400:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709663488 00000100:00100000:0.0:1788263164.082412:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709663488 00000100:00100000:0.0:1788263164.082464:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788263164.082475:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:9481:x1875129709663488:12345-0@lo:502: 00000100:00100000:0.0:1788263164.082671:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:9481:x1875129709663488:12345-0@lo:502: Request processed in 198us (3605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263164.082694:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788263164.082961:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709663488:0@lo:502: 00000040:00080000:3.0:1788263164.083310:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788263164.083354:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788263164.083374:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788263164.083389:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788263164.083404:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788263164.083418:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788263164.083433:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788263164.083447:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788263164.083461:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788263164.083476:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788263164.083491:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788263164.083504:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788263164.083521:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788263164.083535:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788263164.083550:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788263164.088855:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788263164.088918:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788263164.088937:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788263164.088977:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788263164.088993:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788263164.089007:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788263164.090323:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788263164.090383:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788263164.090402:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788263164.090417:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788263164.090430:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788263164.090443:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788263164.090457:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788263164.090470:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788263164.090484:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788263164.090510:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788263164.090524:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788263164.090536:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788263164.090549:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788263164.090656:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788263164.090677:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788263164.090691:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1788263164.090704:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788263164.090718:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1788263164.090731:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1788263164.090745:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1788263164.090758:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1788263164.090777:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1788263164.090791:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1788263164.090803:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1788263164.090814:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1788263164.090857:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709663616:0@lo:502: 00000100:00100000:2.0:1788263164.090931:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263164.090975:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2822bb300 going to sleep for 11 seconds 00000100:00100000:0.0:1788263164.091713:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709663616 00000100:00100000:0.0:1788263164.091722:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709663616 00000100:00100000:0.0:1788263164.091768:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788263164.091777:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:9481:x1875129709663616:12345-0@lo:502: 00000100:00100000:0.0:1788263164.091892:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:9481:x1875129709663616:12345-0@lo:502: Request processed in 116us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263164.091899:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788263164.091995:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709663616:0@lo:502: 00000040:00080000:2.0:1788263164.092083:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1788263164.092091:0:9481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1788263164.093281:0:9499:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788263164.093296:0:9499:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ff3bc6b19b8) 00000020:00000080:3.0:1788263164.093319:0:9499:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1788263164.093425:0:9499:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ff281faf000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788263164.093429:0:9499:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ff281faf000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788263164.093432:0:9499:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ff281faf000 3 00010000:00080000:3.0:1788263164.093460:0:9499:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ff3851c6800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.126@tcp at head 00010000:00010000:2.0:1788263164.097967:0:9499:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1788263164.098252:0:9499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788263164.098296:0:9499:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788263164.098308:0:9499:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4b1103cba666f26e 00000100:00080000:2.0:1788263164.098319:0:9499:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788263164.098324:0:9499:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ff3851c6800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263164.098363:0:9499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff28178fb80 x1875129709663744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788263164.098402:0:9499:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788263164.099097:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709664256:0@lo:400: 00000100:00100000:0.0:1788263164.099155:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263164.099200:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788263164.099205:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709663872:0@lo:400: 00000100:00100000:0.0:1788263164.099224:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263164.099237:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709664384:0@lo:400: 00000100:00100000:0.0:1788263164.099256:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263164.099278:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709664000:0@lo:400: 00000100:00100000:0.0:1788263164.099299:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263164.099315:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709664512:0@lo:400: 00000100:00100000:0.0:1788263164.099332:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263164.099358:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263164.099363:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709664128:0@lo:400: 00000100:00100000:0.0:1788263164.099381:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263164.099409:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709664256 00000100:00100000:0.0:1788263164.099415:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709664256 00000100:00100000:0.0:1788263164.099455:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709663872 00000100:00100000:0.0:1788263164.099458:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709663872 00000100:00100000:0.0:1788263164.099478:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709664000 00000100:00100000:0.0:1788263164.099482:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709664000 00000100:00100000:0.0:1788263164.099491:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709664128 00000100:00100000:0.0:1788263164.099493:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709664128 00000100:00100000:0.0:1788263164.099509:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788263164.099517:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709664256:12345-0@lo:400: 00000100:00100000:0.0:1788263164.099564:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709664256:12345-0@lo:400: Request processed in 48us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263164.099570:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788263164.099806:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788263164.099814:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709663872:12345-0@lo:400: 00000100:00100000:0.0:1788263164.099843:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709663872:12345-0@lo:400: Request processed in 31us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263164.099849:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788263164.099861:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788263164.099866:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709664000:12345-0@lo:400: 00000100:00100000:0.0:1788263164.099895:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709664000:12345-0@lo:400: Request processed in 30us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263164.099901:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788263164.099912:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788263164.099918:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709664128:12345-0@lo:400: 00000100:00100000:0.0:1788263164.099942:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709664128:12345-0@lo:400: Request processed in 24us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263164.099948:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788263164.099972:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709664384 00000100:00100000:0.0:1788263164.099976:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709664384 00000100:00100000:0.0:1788263164.100000:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709664512 00000100:00100000:0.0:1788263164.100009:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709664512 00000100:00100000:0.0:1788263164.100488:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788263164.100496:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709664384:12345-0@lo:400: 00000100:00100000:0.0:1788263164.100530:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709664384:12345-0@lo:400: Request processed in 36us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263164.100536:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788263164.100548:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788263164.100554:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709664512:12345-0@lo:400: 00000100:00100000:0.0:1788263164.100787:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709664512:12345-0@lo:400: Request processed in 25us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263164.100796:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788263164.100826:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788263164.100830:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788263164.100833:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788263164.100973:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3a0f6df80 x1875129709664128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263164.100986:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709664128:0@lo:400: 00010000:00080000:0.0:1788263164.100997:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3a0f6e300 x1875129709664000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263164.101005:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709664000:0@lo:400: 00010000:00080000:0.0:1788263164.101015:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff282fddf80 x1875129709664512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263164.101121:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875129709663744:0@lo:38: 00000100:00100000:1.0:1788263164.101162:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263164.102758:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709664512:0@lo:400: 00010000:00080000:0.0:1788263164.102817:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3a0f6d880 x1875129709663872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263164.102845:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709663872:0@lo:400: 00010000:00080000:0.0:1788263164.102859:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff282fde680 x1875129709664384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263164.102866:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709664384:0@lo:400: 00010000:00080000:0.0:1788263164.102876:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3a0f6f480 x1875129709664256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263164.102884:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709664256:0@lo:400: 00000100:00100000:0.0:1788263164.102910:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709663744 00000100:00100000:0.0:1788263164.102916:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709663744 00000100:00100000:0.0:1788263164.102950:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788263164.102956:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875129709663744:12345-0@lo:38: 00010000:00080000:0.0:1788263164.102980:0:6493:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:0.0:1788263164.103011:0:6493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4b1103cba666f275 00000004:00100000:0.0:1788263164.103038:0:6493:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788263164.103068:0:6493:0:(import.c:65:import_set_state_nolock()) ffff9ff3bc676000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263164.103129:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875129709663744:12345-0@lo:38: Request processed in 172us (1966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263164.103136:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788263164.103993:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff28178fb80 x1875129709663744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788263174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263164.104003:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788263164.104010:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788263164.104177:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788263164.104191:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788263164.104194:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3851c6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788263164.104200:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875129709663744:0@lo:38: 00000020:01000004:2.0:1788263164.104315:0:9499:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788263164.104330:0:9499:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9ff281fa19b8) 00000020:00000080:2.0:1788263164.104361:0:9499:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1788263164.104431:0:9499:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ff281faf000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788263164.104434:0:9499:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ff281faf000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788263164.104437:0:9499:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ff281faf000 3 00010000:00080000:2.0:1788263164.104461:0:9499:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ff3a052f800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.126@tcp at head 00000100:00100000:0.0:1788263164.105636:0:9500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fde680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9500:1875129709664640:0@lo:901: 00000100:00100000:0.0:1788263164.111978:0:9500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263164.112026:0:9500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff391aa69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263164.112298:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709664640 00000100:00100000:1.0:1788263164.112307:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709664640 00000100:00100000:1.0:1788263164.112386:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788263164.112395:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9500:x1875129709664640:12345-0@lo:901: 00000100:00100000:1.0:1788263164.112491:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9500:x1875129709664640:12345-0@lo:901: Request processed in 98us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263164.112499:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788263164.115553:0:9499:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00080000:0.0:1788263164.115751:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788263164.115795:0:9500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff282fde680 x1875129709664640/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788263180 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263164.115822:0:9500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fde680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9500:1875129709664640:0@lo:901: 00000020:00000080:2.0:1788263164.116440:0:9499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788263164.116483:0:9499:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788263164.116494:0:9499:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x4b1103cba666f283 00000100:00080000:2.0:1788263164.116501:0:9499:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788263164.116507:0:9499:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9ff3a052f800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263164.116533:0:9499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff28178fb80 x1875129709664768/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788263164.116562:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1875129709664768:0@lo:38: 00000100:00100000:2.0:1788263164.116654:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263164.116706:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709664768 00000100:00100000:2.0:1788263164.116712:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709664768 00000100:00100000:2.0:1788263164.116751:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788263164.116758:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875129709664768:12345-0@lo:38: 00010000:00080000:2.0:1788263164.116778:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:2.0:1788263164.116803:0:6492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x4b1103cba666f28a 00000004:00100000:2.0:1788263164.116817:0:6492:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788263164.116844:0:6492:0:(import.c:65:import_set_state_nolock()) ffff9ff3bf62b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263164.116891:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875129709664768:12345-0@lo:38: Request processed in 131us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263164.116898:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788263164.116927:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff28178fb80 x1875129709664768/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788263174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263164.116935:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788263164.116941:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788263164.116947:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788263164.116951:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788263164.116953:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3a052f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788263164.116959:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1875129709664768:0@lo:38: 00000100:00080000:2.0:1788263164.116975:0:9499:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:2.0:1788263164.118789:0:9499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1788263164.118841:0:9481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1788263164.118872:0:9481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788263164.118890:0:9481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eec600/0x4b1103cba666f259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f260 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263164.118913:0:9481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff398eec600/0x4b1103cba666f259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f260 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788263164.118957:0:9481:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788263164.118959:0:9481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788263164.118960:0:9481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263164.118962:0:9481:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263164.118963:0:9481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263164.118964:0:9481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263164.118966:0:9481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788263164.118967:0:9481:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788263164.118968:0:9481:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788263164.118970:0:9481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263164.118971:0:9481:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788263164.118975:0:9481:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788263164.118977:0:9481:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788263164.118978:0:9481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788263164.118979:0:9481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263164.118980:0:9481:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263164.118981:0:9481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263164.118983:0:9481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263164.118984:0:9481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788263164.118985:0:9481:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788263164.118986:0:9481:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788263164.118987:0:9481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263164.118988:0:9481:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788263164.119009:0:9481:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788263164.119283:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709664896:0@lo:253: 00000100:00100000:2.0:1788263164.119338:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263164.119378:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2822bb240 going to sleep for 11 seconds 00000100:00100000:2.0:1788263164.119408:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709664896 00000100:00100000:2.0:1788263164.119414:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709664896 00000100:00100000:2.0:1788263164.119453:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788263164.119462:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:9481:x1875129709664896:12345-0@lo:253: 20000000:01000000:2.0:1788263164.119496:0:6484:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788263164.119510:0:6484:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788263164.129268:0:6484:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788263164.129287:0:6484:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788263164.129386:0:6507:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788263164.129391:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788263164.129419:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ff3ae765400/0x4b1103cba666f291 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263164.129436:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff3bd17f800/0x4b1103cba666f187 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f180 expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263164.129445:0:6507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff3bd17e400/0x4b1103cba666f1cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f1c6 expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263164.129457:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ff3ae765400/0x4b1103cba666f291 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263164.129496:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff3bd17e400/0x4b1103cba666f1cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f1c6 expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263164.129509:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff3bd17e400/0x4b1103cba666f1cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f1c6 expref: 17 pid: 6484 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263164.129522:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5400e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6507:1875129709665024:0@lo:104: 00000100:00100000:1.0:1788263164.129612:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788263164.129658:0:6507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff3bd17f800/0x4b1103cba666f187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f180 expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263164.129667:0:6507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff3bd17f800/0x4b1103cba666f187 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f180 expref: 17 pid: 6484 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263164.129675:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5401500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6507:1875129709665152:0@lo:104: 00000100:00100000:1.0:1788263164.129695:0:6507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263164.129708:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28222b600 going to sleep for 11 seconds 00000100:00100000:3.0:1788263164.130013:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709665024 00000100:00100000:3.0:1788263164.130026:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709665024 00000100:00100000:3.0:1788263164.130059:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709665152 00000100:00100000:3.0:1788263164.130062:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709665152 00000100:00100000:3.0:1788263164.130075:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788263164.130083:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5403480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:6507:x1875129709665024:12345-0@lo:104: 00010000:00010000:3.0:1788263164.130095:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff381680a00/0x4b1103cba666f1c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f1cd expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.130145:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788263164.130150:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5403480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:6507:x1875129709665024:12345-0@lo:104: Request processed in 69us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263164.130156:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788263164.130173:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788263164.130179:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5401f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:6507:x1875129709665152:12345-0@lo:104: 00010000:00010000:3.0:1788263164.130185:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f180 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f187 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.130221:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788263164.130227:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5401f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:6507:x1875129709665152:12345-0@lo:104: Request processed in 48us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263164.130232:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788263164.130248:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788263164.130254:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff381680a00/0x4b1103cba666f1c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f1cd expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.130261:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381680a00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:3.0:1788263164.130264:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff381680a00/0x4b1103cba666f1c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f1cd expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.130281:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff381680a00/0x4b1103cba666f1c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f1cd expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263164.130288:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff381680a00/0x4b1103cba666f1c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f1cd expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263164.130294:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788263164.130317:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff381680a00/0x4b1103cba666f1c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f1cd expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.130323:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263164.130338:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff381680a00/0x4b1103cba666f1c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f1cd expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.130353:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff381680a00/0x4b1103cba666f1c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f1cd expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.130366:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263164.130368:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f180 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f187 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.130374:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eeca00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:3.0:1788263164.130377:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f180 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f187 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.130383:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f187 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263164.130388:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f187 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263164.130400:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788263164.130414:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f180 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f187 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.130419:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263164.130433:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f180 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f187 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.130439:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f180 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f187 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.130451:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263164.130453:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263164.130454:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263164.130466:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709665280:0@lo:103: 00000100:00100000:3.0:1788263164.130494:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263164.130526:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709665408:0@lo:103: 00000100:00100000:3.0:1788263164.130548:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263164.130573:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709665280 00000100:00100000:3.0:1788263164.130606:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709665280 00010000:00010000:3.0:1788263164.130623:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff3bd17e400/0x4b1103cba666f1cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f1c6 expref: 18 pid: 6484 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263164.130642:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709665408 00000100:00100000:3.0:1788263164.130645:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709665408 00010000:00010000:3.0:1788263164.130653:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff3bd17f800/0x4b1103cba666f187 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f180 expref: 19 pid: 6484 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263164.130669:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788263164.130682:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:3619:x1875129709665280:12345-0@lo:103: 00010000:00010000:3.0:1788263164.130692:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263164.130697:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff3bd17e400/0x4b1103cba666f1cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f1c6 expref: 19 pid: 6484 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.130706:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff3bd17e400/0x4b1103cba666f1cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f1c6 expref: 19 pid: 6484 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.130718:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263164.130743:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:3619:x1875129709665280:12345-0@lo:103: Request processed in 63us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263164.130749:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788263164.130760:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788263164.130766:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:3620:x1875129709665408:12345-0@lo:103: 00010000:00010000:3.0:1788263164.130773:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263164.130777:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff3bd17f800/0x4b1103cba666f187 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f180 expref: 18 pid: 6484 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.130784:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff3bd17f800/0x4b1103cba666f187 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f180 expref: 18 pid: 6484 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.130795:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ff3ae765400/0x4b1103cba666f291 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.130802:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3ae765400/0x4b1103cba666f291 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788263164.130813:0:6478:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007821599s 00010000:00010000:3.0:1788263164.130817:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff3ae765400/0x4b1103cba666f291 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.130832:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff3ae765400/0x4b1103cba666f291 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.130839:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ff3ae765400/0x4b1103cba666f291 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.130845:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ff3ae765400/0x4b1103cba666f291 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.130850:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765400 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263164.130854:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ff3ae765400/0x4b1103cba666f291 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.130860:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ff3ae765400/0x4b1103cba666f291 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.130867:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ff3ae765400/0x4b1103cba666f291 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.130876:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263164.130903:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:3620:x1875129709665408:12345-0@lo:103: Request processed in 137us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263164.130909:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788263164.130941:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709665280:0@lo:103: 00000100:00100000:3.0:1788263164.130961:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709665408:0@lo:103: 00010000:00010000:3.0:1788263164.130982:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3bd17e400/0x4b1103cba666f1cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f1c6 expref: 17 pid: 6484 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263164.130990:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5400e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6507:1875129709665024:0@lo:104: 00010000:00010000:3.0:1788263164.131005:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3bd17f800/0x4b1103cba666f187 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f180 expref: 16 pid: 6484 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263164.131012:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5401500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6507:1875129709665152:0@lo:104: 00010000:00010000:3.0:1788263164.131024:0:6507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ff3ae765400/0x4b1103cba666f291 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.131032:0:6507:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ff3ae765400/0x4b1103cba666f291 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.131039:0:6507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ff3ae765400/0x4b1103cba666f291 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263164.131044:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3ae765400/0x4b1103cba666f291 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263164.131327:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263164.131557:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:9481:x1875129709664896:12345-0@lo:253: Request processed in 12095us (12218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263164.131566:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788263164.131716:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:15f48257-b19e-4792-92d2-a48eb49d0ad1:9481:1875129709664896:0@lo:253: 10000000:01000000:2.0:1788263164.131727:0:9481:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788263164.131730:0:9481:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788263164.131731:0:9481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788263164.131732:0:9481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263164.131734:0:9481:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263164.131735:0:9481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263164.131736:0:9481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263164.131738:0:9481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788263164.131739:0:9481:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788263164.131740:0:9481:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788263164.131742:0:9481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263164.131744:0:9481:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788263164.131754:0:9481:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788263164.140133:0:9481:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788263164.140818:0:9481:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788263164.141012:0:9481:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788263164.141172:0:9481:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788263164.143744:0:9481:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788263164.143952:0:9481:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788263164.147720:0:9481:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788263164.180286:0:9481:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788263164.180295:0:9481:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788263164.180331:0:9481:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788263164.180382:0:9481:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.126@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788263164.180401:0:9481:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788263164.180427:0:9481:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788263164.185828:0:9481:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788263164.186006:0:9481:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788263164.467864:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788263165.164420:0:9556:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788263165.164797:0:9556:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788263165.487904:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263166.512372:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263166.517763:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709665536:0@lo:13: 00000100:00100000:3.0:1788263166.517833:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263166.517901:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709665536 00000100:00100000:3.0:1788263166.517908:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709665536 00000100:00100000:3.0:1788263166.517957:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788263166.517967:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709665536:12345-0@lo:13: 00002000:00000024:3.0:1788263166.517993:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263166.518035:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709665536:12345-0@lo:13: Request processed in 70us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263166.518056:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788263166.518076:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788263166.518103:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff281e39180 x1875129709665536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263166.518121:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709665536:0@lo:13: 00000100:00100000:1.0:1788263166.519881:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709665664:0@lo:13: 00000100:00100000:1.0:1788263166.519933:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263166.520027:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709665664 00000100:00100000:0.0:1788263166.520034:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709665664 00000100:00100000:0.0:1788263166.520087:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788263166.520095:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709665664:12345-0@lo:13: 00002000:00000024:0.0:1788263166.520111:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263166.520152:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709665664:12345-0@lo:13: Request processed in 58us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263166.520158:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788263166.520191:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff282fde680 x1875129709665664/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263166.520206:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709665664:0@lo:13: 00000100:00080000:1.0:1788263166.520309:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788263167.535725:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263168.572307:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263169.071964:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263169.071986:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709665792:0@lo:41: 00000100:00100000:0.0:1788263169.072053:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263169.072118:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709665792 00000100:00100000:0.0:1788263169.072125:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709665792 00000100:00100000:0.0:1788263169.072167:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788263169.072200:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709665792:12345-0@lo:41: 00000004:00000024:0.0:1788263169.072231:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1788263169.072275:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709665792:12345-0@lo:41: Request processed in 79us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263169.072283:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788263169.072340:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709665792:0@lo:41: 00000100:00100000:3.0:1788263169.074571:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709665920:0@lo:41: 00000100:00100000:3.0:1788263169.074658:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263169.074733:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709665920 00000100:00100000:3.0:1788263169.074740:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709665920 00000100:00100000:3.0:1788263169.074786:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788263169.074796:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709665920:12345-0@lo:41: 00000004:00000024:3.0:1788263169.074824:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788263169.074935:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709665920:12345-0@lo:41: Request processed in 75us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263169.074943:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788263169.074998:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709665920:0@lo:41: 00010000:00010000:3.0:1788263169.586318:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263169.596382:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709666048:0@lo:400: 00000100:00100000:1.0:1788263169.596657:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263169.596712:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5402680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875129709666560:0@lo:400: 00000100:00100000:1.0:1788263169.596808:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263169.596828:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875129709667072:0@lo:400: 00000100:00100000:1.0:1788263169.596852:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263169.596873:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788263169.596878:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875129709666432:0@lo:400: 00000100:00100000:1.0:1788263169.596896:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263169.596912:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875129709666944:0@lo:400: 00000100:00100000:1.0:1788263169.596929:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263169.596955:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709666176:0@lo:400: 00000100:00100000:1.0:1788263169.596975:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263169.596984:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5400700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709666688:0@lo:400: 00000100:00100000:1.0:1788263169.597001:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263169.597092:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788263169.597097:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709666304:0@lo:400: 00000100:00100000:1.0:1788263169.597119:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263169.597140:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5401500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709666816:0@lo:400: 00000100:00100000:1.0:1788263169.597174:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263169.597205:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709666048 00000100:00100000:1.0:1788263169.597212:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709666048 00000100:00100000:1.0:1788263169.597252:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788263169.597266:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:3621:x1875129709666048:12345-0@lo:400: 00000100:00100000:1.0:1788263169.597324:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:3621:x1875129709666048:12345-0@lo:400: Request processed in 58us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263169.597332:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788263169.597364:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709666560 00000100:00100000:1.0:1788263169.597368:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709666560 00000100:00100000:1.0:1788263169.597392:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709667072 00000100:00100000:1.0:1788263169.597395:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709667072 00000100:00100000:1.0:1788263169.597406:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709666432 00000100:00100000:1.0:1788263169.597408:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709666432 00000100:00100000:1.0:1788263169.597417:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709666944 00000100:00100000:1.0:1788263169.597418:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709666944 00000100:00100000:1.0:1788263169.597439:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709666176 00000100:00100000:1.0:1788263169.597442:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709666176 00000100:00100000:1.0:1788263169.597453:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709666304 00000100:00100000:1.0:1788263169.597455:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709666304 00000100:00100000:1.0:1788263169.597466:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788263169.597471:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875129709666560:12345-0@lo:400: 00000100:00100000:1.0:1788263169.599349:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875129709666560:12345-0@lo:400: Request processed in 1871us (2533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263169.599362:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788263169.599394:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788263169.599405:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875129709667072:12345-0@lo:400: 00000100:00100000:1.0:1788263169.599436:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875129709667072:12345-0@lo:400: Request processed in 35us (2583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263169.599441:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788263169.599454:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788263169.599461:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875129709666432:12345-0@lo:400: 00000100:00100000:1.0:1788263169.599653:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875129709666432:12345-0@lo:400: Request processed in 193us (2756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263169.599659:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788263169.599672:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788263169.599679:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875129709666944:12345-0@lo:400: 00000100:00100000:1.0:1788263169.599707:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875129709666944:12345-0@lo:400: Request processed in 29us (2777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263169.599723:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788263169.599735:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788263169.599742:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709666176:12345-0@lo:400: 00000100:00100000:1.0:1788263169.599788:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709666176:12345-0@lo:400: Request processed in 47us (2812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263169.599794:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788263169.599806:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788263169.599812:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709666304:12345-0@lo:400: 00000100:00100000:1.0:1788263169.599839:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709666304:12345-0@lo:400: Request processed in 28us (2720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263169.599845:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788263169.599881:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709666688 00000100:00100000:1.0:1788263169.599888:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709666688 00000100:00100000:1.0:1788263169.599920:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709666816 00000100:00100000:1.0:1788263169.599923:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709666816 00000100:00100000:1.0:1788263169.599938:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788263169.599944:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709666688:12345-0@lo:400: 00000100:00100000:1.0:1788263169.599974:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709666688:12345-0@lo:400: Request processed in 30us (2972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263169.599989:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788263169.600267:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788263169.600280:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709666816:12345-0@lo:400: 00000100:00100000:1.0:1788263169.600323:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709666816:12345-0@lo:400: Request processed in 48us (3149us total) trans 0 rc 0/0 00010000:00080000:2.0:1788263169.600460:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5403b80 x1875129709666432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263169.600475:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875129709666432:0@lo:400: 00010000:00080000:2.0:1788263169.600489:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5400e00 x1875129709666944/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263169.600506:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875129709666944:0@lo:400: 00000100:00100000:2.0:1788263169.600519:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709666048:0@lo:400: 00010000:00080000:2.0:1788263169.600533:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5402680 x1875129709666560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263169.600541:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5402680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875129709666560:0@lo:400: 00010000:00080000:2.0:1788263169.600551:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5635180 x1875129709667072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263169.600559:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875129709667072:0@lo:400: 00010000:00080000:2.0:1788263169.600626:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5401180 x1875129709666304/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263169.600634:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709666304:0@lo:400: 00010000:00080000:2.0:1788263169.600644:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5401500 x1875129709666816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263169.600651:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5401500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709666816:0@lo:400: 00010000:00080000:2.0:1788263169.600661:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5403800 x1875129709666176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263169.600669:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709666176:0@lo:400: 00010000:00080000:2.0:1788263169.600678:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5400700 x1875129709666688/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263169.600685:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5400700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709666688:0@lo:400: 00000100:00080000:2.0:1788263169.606133:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788263169.606155:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788263169.606158:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788263169.607162:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000001:02000400:2.0:1788263169.996897:0:9846:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788263170.607690:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788263170.611494:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788263170.611503:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ff3ae569800 from 39 10000000:01000000:2.0:1788263170.611509:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788263170.611550:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f298 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263170.611561:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f298 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263170.611572:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f298 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263170.611627:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709667200:0@lo:101: 00000100:00100000:2.0:1788263170.611690:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263170.611746:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3854103c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263170.611831:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709667200 00000100:00100000:0.0:1788263170.611839:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709667200 00000100:00100000:0.0:1788263170.612125:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788263170.612132:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:6489:x1875129709667200:12345-0@lo:101: 00010000:00010000:0.0:1788263170.612142:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263170.612151:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3bd17f400/0x4b1103cba666f29f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f298 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263170.612169:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3bd17f400/0x4b1103cba666f29f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f298 expref: 16 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263170.612176:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3bd17f400/0x4b1103cba666f29f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f298 expref: 16 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263170.612182:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17f400, rc 0) 00000100:00100000:0.0:1788263170.612228:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:6489:x1875129709667200:12345-0@lo:101: Request processed in 95us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263170.612234:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788263170.612275:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709667200:0@lo:101: 00010000:00010000:0.0:1788263170.612287:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f298 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f29f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263170.612318:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f298 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f29f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263170.612384:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fde680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709667328:0@lo:501: 00000100:00100000:0.0:1788263170.612409:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263170.612562:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709667328 00000100:00100000:0.0:1788263170.612563:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28222bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788263170.612568:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709667328 00000100:00100000:1.0:1788263170.612621:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788263170.612629:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:6489:x1875129709667328:12345-0@lo:501: 00000100:00100000:1.0:1788263170.612753:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:6489:x1875129709667328:12345-0@lo:501: Request processed in 125us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263170.612760:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788263170.613176:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fde680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709667328:0@lo:501: 00000100:00100000:0.0:1788263170.613206:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fde680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709667456:0@lo:503: 00000100:00100000:0.0:1788263170.613245:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263170.613276:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28222bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263170.613324:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709667456 00000100:00100000:2.0:1788263170.613328:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709667456 00000100:00100000:2.0:1788263170.613363:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788263170.613371:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:6489:x1875129709667456:12345-0@lo:503: 00000100:00100000:2.0:1788263170.614434:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:6489:x1875129709667456:12345-0@lo:503: Request processed in 1061us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263170.614444:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788263170.616052:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fde680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709667456:0@lo:503: 00000100:00100000:2.0:1788263170.620637:0:9876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:9876:1875129709667584:0@lo:502: 00000100:00100000:2.0:1788263170.620712:0:9876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263170.620752:0:9876:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3c057d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788263170.620809:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709667584 00000100:00100000:3.0:1788263170.620815:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709667584 00000100:00100000:3.0:1788263170.620866:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788263170.620875:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:9876:x1875129709667584:12345-0@lo:502: 00000100:00100000:3.0:1788263170.620989:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:9876:x1875129709667584:12345-0@lo:502: Request processed in 115us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263170.620997:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788263170.621046:0:9876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:9876:1875129709667584:0@lo:502: 00000100:00100000:3.0:1788263170.621094:0:9876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:9876:1875129709667712:0@lo:502: 00000100:00100000:3.0:1788263170.621126:0:9876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263170.621147:0:9876:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3f9480 going to sleep for 11 seconds 00000100:00100000:2.0:1788263170.621230:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709667712 00000100:00100000:2.0:1788263170.621240:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709667712 00000100:00100000:2.0:1788263170.621271:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788263170.621278:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:9876:x1875129709667712:12345-0@lo:502: 00000100:00100000:2.0:1788263170.621423:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:9876:x1875129709667712:12345-0@lo:502: Request processed in 145us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263170.621429:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788263170.621499:0:9876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:9876:1875129709667712:0@lo:502: 00000040:00080000:3.0:1788263170.621518:0:9876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788263170.621938:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788263170.621963:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788263170.621972:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f298 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f29f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263170.621982:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f298 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f29f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263170.621992:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788263170.621995:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788263170.621997:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788263170.622021:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f2a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263170.622028:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f2a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263170.622037:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f2a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263170.622050:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709667840:0@lo:101: 00000100:00100000:2.0:1788263170.622075:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263170.622134:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3c057d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263170.623225:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709667840 00000100:00100000:3.0:1788263170.623233:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709667840 00000100:00100000:3.0:1788263170.623319:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788263170.623327:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:6489:x1875129709667840:12345-0@lo:101: 00010000:00010000:3.0:1788263170.623338:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263170.623353:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3829e8a00/0x4b1103cba666f2ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f2a6 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263170.623375:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3829e8a00/0x4b1103cba666f2ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f2a6 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263170.623383:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3829e8a00/0x4b1103cba666f2ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f2a6 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263170.623391:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3829e8a00, rc 0) 00000100:00100000:3.0:1788263170.623440:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709667840:12345-0@lo:101: Request processed in 114us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263170.623446:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788263170.623643:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709667840:0@lo:101: 00010000:00010000:3.0:1788263170.623659:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f2a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f2ad expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263170.623685:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f2a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f2ad expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263170.623750:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709667968:0@lo:501: 00000100:00100000:3.0:1788263170.623778:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263170.623837:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3f9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263170.623868:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709667968 00000100:00100000:2.0:1788263170.623878:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709667968 00000100:00100000:2.0:1788263170.624010:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788263170.624019:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709667968:12345-0@lo:501: 00000100:00100000:2.0:1788263170.624139:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709667968:12345-0@lo:501: Request processed in 121us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263170.624146:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788263170.624198:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709667968:0@lo:501: 00000100:00100000:3.0:1788263170.624226:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709668096:0@lo:503: 00000100:00100000:3.0:1788263170.624262:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263170.624337:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3f9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788263170.624367:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709668096 00000100:00100000:1.0:1788263170.624373:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709668096 00000100:00100000:1.0:1788263170.624409:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788263170.624416:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709668096:12345-0@lo:503: 00000100:00100000:1.0:1788263170.624512:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709668096:12345-0@lo:503: Request processed in 96us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263170.624518:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788263170.624807:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709668096:0@lo:503: 00000100:00100000:3.0:1788263170.625142:0:9878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:9878:1875129709668224:0@lo:502: 00000100:00100000:3.0:1788263170.625177:0:9878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263170.625205:0:9878:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3f9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263170.625311:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709668224 00000100:00100000:0.0:1788263170.625316:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709668224 00000100:00100000:0.0:1788263170.625351:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788263170.625360:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:9878:x1875129709668224:12345-0@lo:502: 00000100:00100000:0.0:1788263170.625450:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:9878:x1875129709668224:12345-0@lo:502: Request processed in 91us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263170.625456:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788263170.625517:0:9878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:9878:1875129709668224:0@lo:502: 00000020:01000000:3.0:1788263170.625539:0:9878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788263170.625546:0:9878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263170.625548:0:9878:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788263170.625553:0:9878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788263170.625555:0:9878:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788263170.625569:0:9878:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:9878:1875129709668352:0@lo:502: 00000100:00100000:3.0:1788263170.628464:0:9878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263170.628508:0:9878:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3f9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263170.628681:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709668352 00000100:00100000:2.0:1788263170.628689:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709668352 00000100:00100000:2.0:1788263170.628741:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788263170.628750:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:9878:x1875129709668352:12345-0@lo:502: 00000100:00100000:2.0:1788263170.628875:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:9878:x1875129709668352:12345-0@lo:502: Request processed in 126us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263170.628883:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788263170.629384:0:9878:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:9878:1875129709668352:0@lo:502: 00000020:01000000:0.0:1788263170.629420:0:9878:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263170.629426:0:9878:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263170.629429:0:9878:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788263170.629434:0:9878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788263170.629541:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788263170.629560:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788263170.629569:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f2a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f2ad expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263170.629629:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f2a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f2ad expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263170.629639:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788263170.629642:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ff38769d000 from 39 10000000:01000000:3.0:1788263170.629644:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788263170.629675:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9200/0x4b1103cba666f2b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263170.629683:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9200/0x4b1103cba666f2b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263170.629692:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9200/0x4b1103cba666f2b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263170.629708:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709668480:0@lo:101: 00000100:00100000:3.0:1788263170.629746:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263170.629772:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3f90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263170.629866:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709668480 00000100:00100000:2.0:1788263170.629871:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709668480 00000100:00100000:2.0:1788263170.629916:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788263170.629923:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709668480:12345-0@lo:101: 00010000:00010000:2.0:1788263170.629932:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263170.629944:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f2bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f2b4 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263170.629964:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f2bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f2b4 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263170.629976:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f2bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f2b4 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263170.629984:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eed600, rc 0) 00000100:00100000:2.0:1788263170.630026:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:6489:x1875129709668480:12345-0@lo:101: Request processed in 104us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263170.630039:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788263170.630876:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709668480:0@lo:101: 00010000:00010000:3.0:1788263170.630903:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9200/0x4b1103cba666f2b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f2bb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263170.630914:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9200/0x4b1103cba666f2b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f2bb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263170.630970:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709668608:0@lo:501: 00000100:00100000:3.0:1788263170.630999:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263170.631028:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3f90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263170.631201:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709668608 00000100:00100000:2.0:1788263170.631206:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709668608 00000100:00100000:2.0:1788263170.631239:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788263170.631246:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:6489:x1875129709668608:12345-0@lo:501: 00000100:00100000:2.0:1788263170.631373:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:6489:x1875129709668608:12345-0@lo:501: Request processed in 126us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263170.631380:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788263170.631389:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709668608:0@lo:501: 00000100:00100000:0.0:1788263170.631424:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709668736:0@lo:503: 00000100:00100000:0.0:1788263170.634372:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263170.634431:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28222b600 going to sleep for 11 seconds 00000100:00100000:3.0:1788263170.636398:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709668736 00000100:00100000:3.0:1788263170.636411:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709668736 00000100:00100000:3.0:1788263170.636480:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788263170.636491:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:6489:x1875129709668736:12345-0@lo:503: 00000100:00100000:3.0:1788263170.636671:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:6489:x1875129709668736:12345-0@lo:503: Request processed in 181us (2303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263170.636679:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788263170.636778:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709668736:0@lo:503: 00000100:00100000:0.0:1788263170.638063:0:9880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:9880:1875129709668864:0@lo:502: 00000100:00100000:0.0:1788263170.638125:0:9880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263170.638198:0:9880:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28222bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263170.638694:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709668864 00000100:00100000:2.0:1788263170.638702:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709668864 00000100:00100000:2.0:1788263170.638783:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788263170.638793:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:9880:x1875129709668864:12345-0@lo:502: 00000100:00100000:2.0:1788263170.638924:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:9880:x1875129709668864:12345-0@lo:502: Request processed in 132us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263170.638934:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788263170.639015:0:9880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:9880:1875129709668864:0@lo:502: 00000100:00100000:1.0:1788263170.639068:0:9880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5635180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:9880:1875129709668992:0@lo:502: 00000100:00100000:1.0:1788263170.639106:0:9880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263170.639264:0:9880:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae4686c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263170.639306:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709668992 00000100:00100000:0.0:1788263170.639311:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709668992 00000100:00100000:0.0:1788263170.639375:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788263170.639388:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:9880:x1875129709668992:12345-0@lo:502: 00000100:00100000:0.0:1788263170.639473:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:9880:x1875129709668992:12345-0@lo:502: Request processed in 91us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263170.639481:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788263170.639629:0:9880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5635180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:9880:1875129709668992:0@lo:502: 00000040:00080000:1.0:1788263170.639651:0:9880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788263170.639720:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788263170.639750:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788263170.639761:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9200/0x4b1103cba666f2b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f2bb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263170.639772:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9200/0x4b1103cba666f2b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f2bb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263170.639782:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788263170.639784:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ff38769d000 from 6 10000000:01000000:3.0:1788263170.639787:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788263170.639810:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f2c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263170.639818:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f2c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263170.639959:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f2c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263170.639975:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709669120:0@lo:101: 00000100:00100000:3.0:1788263170.640008:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263170.640046:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3f9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788263170.640051:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709669120 00000100:00100000:1.0:1788263170.640058:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709669120 00000100:00100000:1.0:1788263170.640126:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788263170.640134:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:6489:x1875129709669120:12345-0@lo:101: 00010000:00010000:1.0:1788263170.640143:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263170.640156:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3ae765600/0x4b1103cba666f2c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f2c2 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263170.640180:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3ae765600/0x4b1103cba666f2c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f2c2 expref: 19 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263170.640191:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3ae765600/0x4b1103cba666f2c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f2c2 expref: 19 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263170.640201:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae765600, rc 0) 00000100:00100000:1.0:1788263170.640240:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:6489:x1875129709669120:12345-0@lo:101: Request processed in 107us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263170.640246:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788263170.640307:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709669120:0@lo:101: 00010000:00010000:0.0:1788263170.640320:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f2c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f2c9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263170.640329:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f2c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f2c9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263170.640381:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709669248:0@lo:256: 00000100:00100000:0.0:1788263170.640413:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263170.640489:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28222b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788263170.641131:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709669248 00000100:00100000:2.0:1788263170.641138:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709669248 00000100:00100000:2.0:1788263170.641177:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788263170.641185:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:6489:x1875129709669248:12345-0@lo:256: 20000000:01000000:2.0:1788263170.641202:0:6486:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788263170.641218:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788263170.641221:0:6486:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788263170.641313:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:6489:x1875129709669248:12345-0@lo:256: Request processed in 129us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263170.641320:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788263170.641359:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709669248:0@lo:256: 10000000:01000000:2.0:1788263170.641417:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788263170.641424:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f2c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f2c9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263170.641432:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f2c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f2c9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263170.641440:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788263170.641442:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1788263170.641445:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788263170.641707:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eeda00/0x4b1103cba666f2d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263170.641715:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff398eeda00/0x4b1103cba666f2d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263170.641723:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff398eeda00/0x4b1103cba666f2d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263170.641738:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709669376:0@lo:101: 00000100:00100000:2.0:1788263170.641765:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263170.641817:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384e233c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263170.641871:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709669376 00000100:00100000:1.0:1788263170.641876:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709669376 00000100:00100000:0.0:1788263170.642115:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788263170.642125:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:6489:x1875129709669376:12345-0@lo:101: 00010000:00010000:0.0:1788263170.642141:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263170.642153:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3bd17fc00/0x4b1103cba666f2d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f2d0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263170.642173:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3bd17fc00/0x4b1103cba666f2d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f2d0 expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263170.642182:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3bd17fc00/0x4b1103cba666f2d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f2d0 expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263170.642191:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17fc00, rc 0) 00000100:00100000:0.0:1788263170.642263:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:6489:x1875129709669376:12345-0@lo:101: Request processed in 139us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263170.642269:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788263170.646333:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709669376:0@lo:101: 00010000:00010000:3.0:1788263170.646982:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff398eeda00/0x4b1103cba666f2d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f2d7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263170.646996:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff398eeda00/0x4b1103cba666f2d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f2d7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263170.647148:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709669504:0@lo:501: 00000100:00100000:2.0:1788263170.647210:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263170.647281:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384e23000 going to sleep for 11 seconds 00000100:00100000:3.0:1788263170.650386:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709669504 00000100:00100000:3.0:1788263170.650400:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709669504 00000100:00100000:3.0:1788263170.650448:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788263170.650457:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0499450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:6489:x1875129709669504:12345-0@lo:501: 00000100:00100000:3.0:1788263170.650644:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0499450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:6489:x1875129709669504:12345-0@lo:501: Request processed in 187us (3434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263170.650653:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788263170.650790:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709669504:0@lo:501: 00000100:00100000:0.0:1788263170.650835:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709669632:0@lo:503: 00000100:00100000:0.0:1788263170.650881:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263170.650918:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28222b600 going to sleep for 11 seconds 00000100:00100000:2.0:1788263170.651340:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709669632 00000100:00100000:2.0:1788263170.651346:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709669632 00000100:00100000:2.0:1788263170.651381:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788263170.651390:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:6489:x1875129709669632:12345-0@lo:503: 00000100:00100000:2.0:1788263170.651500:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:6489:x1875129709669632:12345-0@lo:503: Request processed in 111us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263170.651506:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788263170.651618:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709669632:0@lo:503: 00000100:00100000:3.0:1788263170.651954:0:9882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e3aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:9882:1875129709669760:0@lo:502: 00000100:00100000:3.0:1788263170.651991:0:9882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263170.652021:0:9882:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3f93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263170.652365:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709669760 00000100:00100000:0.0:1788263170.652371:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709669760 00000100:00100000:0.0:1788263170.652438:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788263170.652447:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:9882:x1875129709669760:12345-0@lo:502: 00000100:00100000:0.0:1788263170.652543:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:9882:x1875129709669760:12345-0@lo:502: Request processed in 97us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263170.652550:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788263170.652633:0:9882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e3aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:9882:1875129709669760:0@lo:502: 00000020:01000000:3.0:1788263170.652661:0:9882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788263170.652668:0:9882:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788263170.652674:0:9882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263170.652676:0:9882:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788263170.652683:0:9882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788263170.652688:0:9882:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:01000000:3.0:1788263170.652709:0:9882:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788263170.652720:0:9882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788263170.652734:0:9882:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9ff3bc6b3370) 00000020:00000080:3.0:1788263170.652757:0:9882:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1788263170.652764:0:9882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788263170.652842:0:9882:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788263170.652848:0:9882:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788263170.652854:0:9882:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b1103cba666f2e5 00010000:00080000:3.0:1788263170.652884:0:9882:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ff3bf665000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.126@tcp at head 00010000:00010000:3.0:1788263170.653109:0:9882:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1788263170.653239:0:9882:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788263170.653249:0:9882:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788263170.653428:0:9882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788263170.653539:0:9882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788263170.653703:0:9882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788263170.653795:0:9882:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788263170.655198:0:9883:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788263170.655204:0:9883:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788263170.656208:0:9882:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788263170.656221:0:9882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788263170.656258:0:9882:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788263170.656281:0:9882:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b1103cba666f2ec 00000100:00080000:2.0:1788263170.656290:0:9882:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788263170.656296:0:9882:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ff3bf665000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263170.656339:0:9882:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff28178fb80 x1875129709669888/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788263170.656399:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709669888:0@lo:8: 00000100:00100000:3.0:1788263170.656468:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788263170.656676:0:9882:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788263170.656739:0:9882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263170.656744:0:9882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263170.656746:0:9882:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788263170.656750:0:9882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263170.656756:0:9882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263170.656758:0:9882:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788263170.656762:0:9882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788263170.656764:0:9882:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788263170.656788:0:9882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5400700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:9882:1875129709670016:0@lo:502: 00000100:00100000:2.0:1788263170.656830:0:9882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263170.656847:0:9882:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384e23000 going to sleep for 11 seconds 00000100:00100000:2.0:1788263170.656865:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709670016 00000100:00100000:2.0:1788263170.656871:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709670016 00000100:00100000:2.0:1788263170.656910:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788263170.656920:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:9882:x1875129709670016:12345-0@lo:502: 00000100:00100000:2.0:1788263170.657040:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:9882:x1875129709670016:12345-0@lo:502: Request processed in 122us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263170.657048:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788263170.657099:0:9882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5400700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:9882:1875129709670016:0@lo:502: 00000020:01000000:2.0:1788263170.657123:0:9882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263170.657128:0:9882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263170.657130:0:9882:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788263170.657133:0:9882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:2.0:1788263170.657225:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1788263170.657252:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788263170.657261:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eeda00/0x4b1103cba666f2d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f2d7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263170.657272:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff398eeda00/0x4b1103cba666f2d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f2d7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263170.657281:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788263170.657284:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ff3888e6000 from 39 10000000:01000000:2.0:1788263170.657287:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788263170.657318:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eec200/0x4b1103cba666f2f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263170.657327:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff398eec200/0x4b1103cba666f2f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263170.657336:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff398eec200/0x4b1103cba666f2f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263170.657348:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5400700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709670144:0@lo:101: 00000100:00100000:2.0:1788263170.657385:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263170.657403:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2831a1540 going to sleep for 11 seconds 00000100:00100000:2.0:1788263170.657417:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709670144 00000100:00100000:2.0:1788263170.657420:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709670144 00000100:00100000:2.0:1788263170.657443:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788263170.657449:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:6489:x1875129709670144:12345-0@lo:101: 00010000:00010000:2.0:1788263170.657457:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263170.657468:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f2fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f2f3 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263170.657489:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f2fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f2f3 expref: 21 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263170.657611:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f2fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f2f3 expref: 21 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263170.657621:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eece00, rc 0) 00000100:00100000:2.0:1788263170.657656:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709670144:12345-0@lo:101: Request processed in 206us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263170.657663:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788263170.657694:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5400700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709670144:0@lo:101: 00010000:00010000:2.0:1788263170.657706:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff398eec200/0x4b1103cba666f2f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f2fa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263170.657716:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff398eec200/0x4b1103cba666f2f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f2fa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263170.657754:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5400700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709670272:0@lo:501: 00000100:00100000:2.0:1788263170.657790:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263170.657814:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2831a1540 going to sleep for 11 seconds 00000100:00100000:2.0:1788263170.657825:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709670272 00000100:00100000:2.0:1788263170.657828:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709670272 00000100:00100000:2.0:1788263170.657851:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788263170.657858:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709670272:12345-0@lo:501: 00000100:00100000:2.0:1788263170.657953:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709670272:12345-0@lo:501: Request processed in 94us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263170.657961:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788263170.658002:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5400700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709670272:0@lo:501: 00000100:00100000:2.0:1788263170.658028:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5400700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709670400:0@lo:503: 00000100:00100000:2.0:1788263170.658060:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263170.658081:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2831a1540 going to sleep for 11 seconds 00000100:00100000:2.0:1788263170.658189:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709670528:0@lo:400: 00000100:00100000:2.0:1788263170.658213:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263170.658231:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709671040:0@lo:400: 00000100:00100000:2.0:1788263170.658250:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263170.658266:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875129709671552:0@lo:400: 00000100:00100000:2.0:1788263170.658286:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263170.658315:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788263170.658321:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5401500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709670656:0@lo:400: 00000100:00100000:2.0:1788263170.658343:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263170.658361:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709671168:0@lo:400: 00000100:00100000:2.0:1788263170.658380:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263170.658394:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709671680:0@lo:400: 00000100:00100000:2.0:1788263170.658424:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263170.658446:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709670784:0@lo:400: 00000100:00100000:2.0:1788263170.658466:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263170.658477:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709671296:0@lo:400: 00000100:00100000:0.0:1788263170.658621:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709669888 00000100:00100000:0.0:1788263170.658625:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709669888 00000100:00100000:0.0:1788263170.658656:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788263170.658661:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3617:x1875129709669888:12345-0@lo:8: 00010000:00080000:0.0:1788263170.658682:0:8404:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:0.0:1788263170.658704:0:8404:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b1103cba666f301 00002000:00100000:0.0:1788263170.658717:0:8404:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9ff3bc673800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788263170.658720:0:8404:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:0.0:1788263170.658723:0:8404:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788263170.658772:0:8404:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788263170.659028:0:8404:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788263170.659050:0:8404:0:(import.c:65:import_set_state_nolock()) ffff9ff3bc674800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263170.659129:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263170.659153:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788263170.659160:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5402680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709670912:0@lo:400: 00000100:00100000:2.0:1788263170.659182:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263170.659200:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709671424:0@lo:400: 00000100:00100000:2.0:1788263170.659223:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263170.659248:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709670528 00000100:00100000:2.0:1788263170.659251:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709670528 00000100:00100000:2.0:1788263170.659271:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709671040 00000100:00100000:2.0:1788263170.659273:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709671040 00000100:00100000:2.0:1788263170.659284:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709671552 00000100:00100000:2.0:1788263170.659286:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709671552 00000100:00100000:2.0:1788263170.659295:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709671168 00000100:00100000:2.0:1788263170.659297:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709671168 00000100:00100000:2.0:1788263170.659317:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709671680 00000100:00100000:2.0:1788263170.659320:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709671680 00000100:00100000:2.0:1788263170.659330:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709670784 00000100:00100000:2.0:1788263170.659332:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709670784 00000100:00100000:2.0:1788263170.659343:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788263170.659350:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38767bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709670528:12345-0@lo:400: 00000100:00100000:2.0:1788263170.659386:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38767bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709670528:12345-0@lo:400: Request processed in 36us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263170.659392:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788263170.659405:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788263170.659411:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38767b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709671040:12345-0@lo:400: 00000100:00100000:2.0:1788263170.659449:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38767b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709671040:12345-0@lo:400: Request processed in 38us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263170.659454:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788263170.659466:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788263170.659471:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875129709671552:12345-0@lo:400: 00000100:00100000:2.0:1788263170.659670:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875129709671552:12345-0@lo:400: Request processed in 196us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263170.659679:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788263170.659693:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788263170.659699:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38767b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709671168:12345-0@lo:400: 00000100:00100000:2.0:1788263170.659730:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38767b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709671168:12345-0@lo:400: Request processed in 31us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263170.659735:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788263170.659745:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788263170.659751:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38767aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875129709671680:12345-0@lo:400: 00000100:00100000:2.0:1788263170.659777:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38767aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875129709671680:12345-0@lo:400: Request processed in 27us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263170.659782:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788263170.659792:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788263170.659798:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38767a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709670784:12345-0@lo:400: 00000100:00100000:2.0:1788263170.659826:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38767a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709670784:12345-0@lo:400: Request processed in 29us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263170.659832:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788263170.659859:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709670656 00000100:00100000:2.0:1788263170.659862:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709670656 00000100:00100000:2.0:1788263170.659878:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709670912 00000100:00100000:2.0:1788263170.659887:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709670912 00000100:00100000:2.0:1788263170.659903:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788263170.659909:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709670656:12345-0@lo:400: 00000100:00100000:2.0:1788263170.659938:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709670656:12345-0@lo:400: Request processed in 30us (1594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263170.659944:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788263170.659955:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788263170.659960:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709670912:12345-0@lo:400: 00000100:00100000:2.0:1788263170.659984:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709670912:12345-0@lo:400: Request processed in 25us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263170.659990:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788263170.660029:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5402680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709670912:0@lo:400: 00010000:00080000:2.0:1788263170.660042:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5401180 x1875129709670784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263170.660052:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709670784:0@lo:400: 00000100:00100000:2.0:1788263170.660080:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5401500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709670656:0@lo:400: 00010000:00080000:2.0:1788263170.660090:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5400e00 x1875129709671168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263170.660098:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709671168:0@lo:400: 00010000:00080000:2.0:1788263170.660107:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff387679880 x1875129709671680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263170.660114:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709671680:0@lo:400: 00010000:00080000:2.0:1788263170.660124:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5403800 x1875129709670528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263170.660144:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709670528:0@lo:400: 00010000:00080000:2.0:1788263170.660158:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5401880 x1875129709671040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263170.660165:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709671040:0@lo:400: 00010000:00080000:2.0:1788263170.660174:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff387678a80 x1875129709671552/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263170.660182:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875129709671552:0@lo:400: 00000100:00100000:1.0:1788263170.661690:0:8406:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788263170.661703:0:8406:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788263170.661736:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709670400 00000100:00100000:1.0:1788263170.661743:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709670400 00000100:00100000:1.0:1788263170.661917:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788263170.661927:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709670400:12345-0@lo:503: 00000100:00100000:1.0:1788263170.662393:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709670400:12345-0@lo:503: Request processed in 466us (4331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263170.662410:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788263170.662549:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5400700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709670400:0@lo:503: 00000100:00100000:0.0:1788263170.663571:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1875129709669888:12345-0@lo:8: Request processed in 4905us (7100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263170.663598:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788263170.663620:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709671296 00000100:00100000:0.0:1788263170.663625:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709671296 00000100:00100000:0.0:1788263170.663657:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709671424 00000100:00100000:0.0:1788263170.663660:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709671424 00000100:00100000:0.0:1788263170.663672:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788263170.663679:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709671296:12345-0@lo:400: 00000100:00100000:0.0:1788263170.663745:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709671296:12345-0@lo:400: Request processed in 67us (4616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263170.663752:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788263170.663765:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788263170.663772:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709671424:12345-0@lo:400: 00000100:00100000:0.0:1788263170.663803:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709671424:12345-0@lo:400: Request processed in 32us (4579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263170.663809:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788263170.663925:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff387679c00 x1875129709671424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263170.663939:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709671424:0@lo:400: 00010000:00080000:1.0:1788263170.664020:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5403b80 x1875129709671296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263170.664029:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709671296:0@lo:400: 00010000:00080000:3.0:1788263170.664478:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28178fb80 x1875129709669888/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788263180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263170.664488:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788263170.664551:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788263170.664560:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788263170.664566:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788263170.664570:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3bf665000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788263170.664668:0:9884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9884:1875129709671808:0@lo:700: 00000100:00100000:2.0:1788263170.664713:0:9884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263170.664741:0:9884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2831a1000 going to sleep for 11 seconds 00000100:00100000:1.0:1788263170.664852:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709671808 00000100:00100000:1.0:1788263170.664857:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709671808 00000100:00080000:2.0:1788263170.664912:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788263170.664916:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788263170.664926:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9884:x1875129709671808:12345-0@lo:700: 00000004:00080000:3.0:1788263170.665015:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788263170.665022:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709669888:0@lo:8: 00000100:00100000:1.0:1788263170.665133:0:8413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5635180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8413:1875129709671936:0@lo:700: 00000100:00100000:3.0:1788263170.665199:0:9886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:9886:1875129709672064:0@lo:502: 00000100:00100000:1.0:1788263170.665205:0:8413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263170.665236:0:8413:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae468840 going to sleep for 11 seconds 00000100:00100000:3.0:1788263170.665255:0:9886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263170.665307:0:9886:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff383205900 going to sleep for 11 seconds 00000100:00100000:0.0:1788263170.665360:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709671936 00000100:00100000:0.0:1788263170.665364:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709671936 00000100:00100000:0.0:1788263170.665399:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788263170.665407:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8413:x1875129709671936:12345-0@lo:700: 00000100:00100000:1.0:1788263170.665666:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709672064 00000100:00100000:1.0:1788263170.665671:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709672064 00000100:00100000:1.0:1788263170.665710:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788263170.665718:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:9886:x1875129709672064:12345-0@lo:502: 00000004:00080000:2.0:1788263170.665756:0:9883:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788263170.665822:0:9883:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 179737242381ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788263170.665829:0:9883:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788263170.667111:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:9886:x1875129709672064:12345-0@lo:502: Request processed in 1389us (1851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263170.667123:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788263170.667220:0:9886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:9886:1875129709672064:0@lo:502: 00000100:00100000:3.0:1788263170.667282:0:9886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:9886:1875129709672192:0@lo:502: 00000100:00100000:3.0:1788263170.667340:0:9886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263170.667372:0:9886:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff383205900 going to sleep for 11 seconds 00000100:00100000:1.0:1788263170.667809:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709672192 00000100:00100000:1.0:1788263170.667817:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709672192 00000100:00100000:1.0:1788263170.667869:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788263170.667877:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:9886:x1875129709672192:12345-0@lo:502: 00000100:00100000:1.0:1788263170.668443:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:9886:x1875129709672192:12345-0@lo:502: Request processed in 566us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263170.668497:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788263170.668538:0:9886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:9886:1875129709672192:0@lo:502: 00000040:00080000:3.0:1788263170.668567:0:9886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788263170.668893:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788263170.668918:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788263170.668927:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eec200/0x4b1103cba666f2f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f2fa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263170.668938:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff398eec200/0x4b1103cba666f2f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f2fa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263170.668948:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788263170.668950:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ff3888e6000 from 6 10000000:01000000:0.0:1788263170.668953:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788263170.668980:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f308 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263170.668989:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f308 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263170.668999:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f308 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263170.669014:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709672320:0@lo:101: 00000100:00100000:0.0:1788263170.669053:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263170.669094:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28222b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788263170.669157:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709672320 00000100:00100000:1.0:1788263170.669162:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709672320 00000004:00080000:2.0:1788263170.669192:0:7422:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788263170.669232:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788263170.669242:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709672320:12345-0@lo:101: 00010000:00010000:1.0:1788263170.669251:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263170.669264:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3ae764200/0x4b1103cba666f30f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f308 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263170.669286:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3ae764200/0x4b1103cba666f30f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f308 expref: 22 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263170.669295:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3ae764200/0x4b1103cba666f30f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f308 expref: 22 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263170.669313:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae764200, rc 0) 00000100:00100000:1.0:1788263170.669358:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:6489:x1875129709672320:12345-0@lo:101: Request processed in 119us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263170.669364:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788263170.669391:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709672320:0@lo:101: 00010000:00010000:2.0:1788263170.669407:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f308 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f30f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263170.669418:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f308 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f30f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263170.669463:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709672448:0@lo:256: 00000100:00100000:2.0:1788263170.669561:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263170.672194:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709672448 00000100:00100000:3.0:1788263170.672206:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709672448 00000100:00100000:2.0:1788263170.672210:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2831a1180 going to sleep for 11 seconds 00000100:00100000:3.0:1788263170.672266:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788263170.672274:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:6489:x1875129709672448:12345-0@lo:256: 20000000:01000000:3.0:1788263170.672295:0:6484:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788263170.672325:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788263170.672329:0:6484:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788263170.672454:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:6489:x1875129709672448:12345-0@lo:256: Request processed in 179us (2890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263170.672463:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788263170.672533:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709672448:0@lo:256: 10000000:01000000:2.0:1788263170.672681:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788263170.672690:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f308 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f30f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263170.672701:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f30f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263170.672712:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788263170.672714:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788263170.672718:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788263170.672747:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eedc00/0x4b1103cba666f316 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263170.672756:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff398eedc00/0x4b1103cba666f316 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263170.672812:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff398eedc00/0x4b1103cba666f316 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263170.673021:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709672576:0@lo:101: 00000100:00100000:2.0:1788263170.673340:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263170.673374:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2831a1180 going to sleep for 11 seconds 00000100:00100000:2.0:1788263170.673715:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709672576 00000100:00100000:2.0:1788263170.673722:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709672576 00000100:00100000:2.0:1788263170.673779:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788263170.673788:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:6489:x1875129709672576:12345-0@lo:101: 00010000:00010000:2.0:1788263170.673799:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263170.673818:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff398eec000/0x4b1103cba666f31d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f316 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263170.673849:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff398eec000/0x4b1103cba666f31d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f316 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263170.673870:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff398eec000/0x4b1103cba666f31d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f316 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263170.673878:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eec000, rc 0) 00000100:00100000:2.0:1788263170.673926:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:6489:x1875129709672576:12345-0@lo:101: Request processed in 140us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263170.673933:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788263170.673991:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709672576:0@lo:101: 00010000:00010000:0.0:1788263170.674005:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff398eedc00/0x4b1103cba666f316 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f31d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263170.674023:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff398eedc00/0x4b1103cba666f316 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f31d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263170.674098:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709672704:0@lo:501: 00000100:00100000:0.0:1788263170.674129:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263170.674166:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28222b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788263170.674204:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709672704 00000100:00100000:1.0:1788263170.674209:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709672704 00000100:00100000:1.0:1788263170.674240:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788263170.674248:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:6489:x1875129709672704:12345-0@lo:501: 00000100:00100000:1.0:1788263170.674371:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:6489:x1875129709672704:12345-0@lo:501: Request processed in 123us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263170.674384:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788263170.675051:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709672704:0@lo:501: 00000100:00100000:2.0:1788263170.675090:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709672832:0@lo:503: 00000100:00100000:2.0:1788263170.675132:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263170.675167:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2831a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263170.677867:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709672832 00000100:00100000:1.0:1788263170.677881:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709672832 00000100:00100000:1.0:1788263170.678086:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788263170.678096:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:6489:x1875129709672832:12345-0@lo:503: 00000100:00100000:1.0:1788263170.678266:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:6489:x1875129709672832:12345-0@lo:503: Request processed in 171us (3132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263170.678274:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788263170.678378:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709672832:0@lo:503: 40000000:02000000:1.0:1788263170.679721:0:6498:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1788263170.680281:0:9887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:9887:1875129709672960:0@lo:502: 00000100:00100000:0.0:1788263170.680370:0:9887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263170.680409:0:9887:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a05bccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263170.680458:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709672960 00000100:00100000:2.0:1788263170.680519:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709672960 00000100:00100000:2.0:1788263170.680611:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788263170.680621:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:9887:x1875129709672960:12345-0@lo:502: 00000100:00100000:2.0:1788263170.680751:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:9887:x1875129709672960:12345-0@lo:502: Request processed in 131us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263170.680758:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788263170.680828:0:9887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:9887:1875129709672960:0@lo:502: 00000020:01000000:3.0:1788263170.680853:0:9887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788263170.680860:0:9887:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788263170.680867:0:9887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263170.680869:0:9887:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788263170.680875:0:9887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788263170.680878:0:9887:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:01000000:3.0:1788263170.680908:0:9887:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788263170.680911:0:9887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788263170.680932:0:9887:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ff2832299b8) 00000020:00000080:3.0:1788263170.680958:0:9887:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1788263170.680965:0:9887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788263170.681037:0:9887:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788263170.681043:0:9887:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788263170.681049:0:9887:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b1103cba666f32b 00010000:00080000:3.0:1788263170.681075:0:9887:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ff283242000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.126@tcp at head 00010000:00010000:3.0:1788263170.681291:0:9887:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1788263170.681417:0:9887:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788263170.681428:0:9887:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788263170.681617:0:9887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788263170.681725:0:9887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788263170.681860:0:9887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788263170.681944:0:9887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788263170.684328:0:9888:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788263170.684334:0:9888:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788263170.685344:0:9887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788263170.685358:0:9887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788263170.685396:0:9887:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788263170.685420:0:9887:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b1103cba666f332 00000100:00080000:0.0:1788263170.685430:0:9887:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788263170.685436:0:9887:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ff283242000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:0.0:1788263170.685556:0:9887:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff282fdf480 x1875129709673088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788263170.685599:0:9887:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788263170.685649:0:9887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263170.685654:0:9887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263170.685656:0:9887:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788263170.685659:0:9887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263170.685662:0:9887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263170.685663:0:9887:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788263170.685666:0:9887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788263170.685674:0:9887:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788263170.685702:0:9887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:9887:1875129709673216:0@lo:502: 00000100:00100000:0.0:1788263170.685787:0:9887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263170.685821:0:9887:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a05bccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263170.685967:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709673088:0@lo:8: 00000100:00100000:3.0:1788263170.686003:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263170.686034:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709673216 00000100:00100000:3.0:1788263170.686040:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709673216 00000100:00100000:3.0:1788263170.686081:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788263170.686089:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:9887:x1875129709673216:12345-0@lo:502: 00000100:00100000:3.0:1788263170.686202:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:9887:x1875129709673216:12345-0@lo:502: Request processed in 113us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263170.686210:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788263170.686295:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709673088 00000100:00100000:0.0:1788263170.686309:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709673088 00000100:00100000:0.0:1788263170.686331:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788263170.686337:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3617:x1875129709673088:12345-0@lo:8: 00010000:00080000:0.0:1788263170.686359:0:8404:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:0.0:1788263170.686381:0:8404:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b1103cba666f339 00002000:00100000:0.0:1788263170.686393:0:8404:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ff283247000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788263170.686397:0:8404:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788263170.686400:0:8404:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788263170.686455:0:8404:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788263170.686552:0:8404:0:(import.c:65:import_set_state_nolock()) ffff9ff283242800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263170.686619:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3617:x1875129709673088:12345-0@lo:8: Request processed in 281us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263170.686626:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788263170.686664:0:9887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:9887:1875129709673216:0@lo:502: 00000020:01000000:0.0:1788263170.686691:0:9887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263170.686696:0:9887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263170.686698:0:9887:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788263170.686701:0:9887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00010000:00080000:3.0:1788263170.686850:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff282fdf480 x1875129709673088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788263180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263170.686861:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788263170.686867:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788263170.686874:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788263170.686878:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788263170.686881:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff283242000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788263170.686901:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788263170.686906:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709673088:0@lo:8: 00000004:00080000:2.0:1788263170.687087:0:9888:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788263170.687131:0:9888:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 179758551550ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788263170.687146:0:9888:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788263170.690042:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8413:x1875129709671936:12345-0@lo:700: Request processed in 24628us (24832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263170.690055:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:3.0:1788263170.691816:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1788263170.691857:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788263170.691868:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eedc00/0x4b1103cba666f316 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f31d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263170.691881:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff398eedc00/0x4b1103cba666f316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f31d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263170.691891:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788263170.691894:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ff3b0028000 from 1 10000000:01000000:3.0:1788263170.691897:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788263170.691934:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263170.691943:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263170.691954:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f340 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263170.691975:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709673344:0@lo:101: 00000100:00100000:3.0:1788263170.692038:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263170.692073:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3832056c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263170.692308:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709673344 00000100:00100000:1.0:1788263170.692316:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709673344 00000100:00100000:1.0:1788263170.692370:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788263170.692380:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:6489:x1875129709673344:12345-0@lo:101: 00010000:00010000:1.0:1788263170.692394:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263170.692407:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3ae765e00/0x4b1103cba666f347 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f340 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263170.692429:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3ae765e00/0x4b1103cba666f347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f340 expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263170.692440:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3ae765e00/0x4b1103cba666f347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f340 expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263170.692448:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae765e00, rc 0) 00000100:00100000:1.0:1788263170.692520:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:6489:x1875129709673344:12345-0@lo:101: Request processed in 141us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263170.692528:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788263170.692686:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709673344:0@lo:101: 00010000:00010000:3.0:1788263170.692701:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f340 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f347 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263170.692711:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f340 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f347 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263170.692783:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709673472:0@lo:501: 00000100:00100000:3.0:1788263170.692808:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263170.692828:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3832056c0 going to sleep for 11 seconds 00010000:00080000:0.0:1788263170.693049:0:8413:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5635180 x1875129709671936/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788263186 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263170.693062:0:8413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5635180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8413:1875129709671936:0@lo:700: 40000000:02000000:0.0:1788263170.693071:0:8413:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:1.0:1788263170.693847:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709673472 00000100:00100000:1.0:1788263170.693856:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709673472 00000100:00100000:1.0:1788263170.693904:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788263170.693912:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:6489:x1875129709673472:12345-0@lo:501: 00000100:00100000:1.0:1788263170.694009:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:6489:x1875129709673472:12345-0@lo:501: Request processed in 97us (1199us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788263170.694016:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788263170.694277:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709673472:0@lo:501: 10000000:01000000:3.0:1788263170.694321:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788263170.694330:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f340 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f347 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263170.694339:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f347 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788263170.696228:0:6470:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788263170.699604:0:9889:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788263170.699636:0:9889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9889:1875129709673728:0@lo:7: 00000100:00100000:2.0:1788263170.699667:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709673600:0@lo:13: 00000100:00100000:2.0:1788263170.699702:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263170.699702:0:9889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263170.699843:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709673728 00000100:00100000:1.0:1788263170.699851:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709673728 00000100:00100000:1.0:1788263170.699916:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788263170.699925:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9889:x1875129709673728:12345-0@lo:7: 00000100:00080000:3.0:1788263170.700839:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788263170.701477:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709673600 00000100:00100000:0.0:1788263170.701485:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709673600 00000100:00100000:0.0:1788263170.701564:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788263170.701573:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1875129709673600:12345-0@lo:13: 00002000:00000024:0.0:1788263170.701624:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923910656 avail 3692388352 00000100:00100000:0.0:1788263170.701695:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1875129709673600:12345-0@lo:13: Request processed in 123us (1992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263170.701702:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788263170.701989:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28312ed80 x1875129709673600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263170.702010:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709673600:0@lo:13: 00000100:00100000:1.0:1788263170.702409:0:9889:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd14d6c0 going to sleep for 11 seconds 00000001:00100000:2.0:1788263170.705522:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788263170.705530:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00002000:00080000:3.0:1788263170.709248:0:8406:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788263170.709257:0:8406:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788263170.709332:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9889:x1875129709673728:12345-0@lo:7: Request processed in 9404us (9626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263170.709343:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788263170.709407:0:9889:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28312c000 x1875129709673728/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788263186 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263170.709421:0:9889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9889:1875129709673728:0@lo:7: 00000004:00080000:3.0:1788263170.709440:0:9889:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788263170.709475:0:9889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e3a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9889:1875129709673856:0@lo:5: 00000100:00100000:3.0:1788263170.709506:0:9889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263170.709538:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709673856 00000100:00100000:3.0:1788263170.709549:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709673856 00000100:00100000:3.0:1788263170.709609:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788263170.709618:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9889:x1875129709673856:12345-0@lo:5: 00002000:00080000:3.0:1788263170.709641:0:8404:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788263170.709644:0:8404:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788263170.709849:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9884:x1875129709671808:12345-0@lo:700: Request processed in 44924us (45134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263170.709862:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788263170.711413:0:9889:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff383205300 going to sleep for 11 seconds 00010000:00080000:2.0:1788263170.714020:0:9884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2831f0380 x1875129709671808/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788263186 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263170.714038:0:9884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9884:1875129709671808:0@lo:700: 00000100:00100000:3.0:1788263170.714315:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9889:x1875129709673856:12345-0@lo:5: Request processed in 4695us (4805us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788263170.714325:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788263170.715817:0:9889:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff281e3a300 x1875129709673856/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788263186 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263170.715837:0:9889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e3a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9889:1875129709673856:0@lo:5: 00000004:00080000:1.0:1788263170.715850:0:9889:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788263170.715884:0:9889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9889:1875129709673984:0@lo:700: 00000100:00100000:1.0:1788263170.715937:0:9889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263170.715964:0:9889:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd14d180 going to sleep for 11 seconds 00000100:00100000:2.0:1788263170.715986:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709673984 00000100:00100000:2.0:1788263170.715992:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709673984 00000100:00100000:2.0:1788263170.716036:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788263170.716044:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9889:x1875129709673984:12345-0@lo:700: 00000001:00080000:3.0:1788263170.718122:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1788263170.718389:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9889:x1875129709673984:12345-0@lo:700: Request processed in 2342us (2448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263170.718400:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788263170.719245:0:9889:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28312ea00 x1875129709673984/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788263186 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263170.719263:0:9889:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788263170.719279:0:9889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9889:1875129709673984:0@lo:700: 00000004:02000040:1.0:1788263170.721294:0:9889:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000004:00080000:2.0:1788263170.725709:0:9884:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788263170.725717:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709674112:0@lo:13: 00000100:00100000:2.0:1788263170.725733:0:9884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9884:1875129709674240:0@lo:7: 00000100:00100000:1.0:1788263170.729276:0:9889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9889:1875129709674368:0@lo:5: 00000100:00100000:2.0:1788263170.729402:0:9884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263170.729439:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709674240 00000100:00100000:0.0:1788263170.729446:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709674240 00000100:00100000:2.0:1788263170.729448:0:9884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3f9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263170.729492:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788263170.729501:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9884:x1875129709674240:12345-0@lo:7: 00000100:00100000:3.0:1788263170.730401:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263170.731739:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709674112 00000100:00100000:2.0:1788263170.731747:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709674112 00000100:00100000:2.0:1788263170.731787:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788263170.731795:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1875129709674112:12345-0@lo:13: 00002000:00000024:2.0:1788263170.731815:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923910656 avail 3692388352 00000100:00100000:2.0:1788263170.731890:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1875129709674112:12345-0@lo:13: Request processed in 95us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263170.731897:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788263170.731985:0:9889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263170.732017:0:9889:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd14d180 going to sleep for 11 seconds 00000100:00100000:2.0:1788263170.732319:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709674368 00000100:00100000:2.0:1788263170.732324:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709674368 00000100:00100000:2.0:1788263170.732365:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788263170.732373:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9889:x1875129709674368:12345-0@lo:5: 00010000:00080000:3.0:1788263170.732491:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2831f0380 x1875129709674112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263170.732511:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709674112:0@lo:13: 00002000:00080000:0.0:1788263170.733173:0:9885:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788263170.733179:0:9885:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788263170.733233:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9884:x1875129709674240:12345-0@lo:7: Request processed in 3733us (3831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263170.733240:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788263170.733295:0:9884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2831f3b80 x1875129709674240/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788263186 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263170.733318:0:9884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9884:1875129709674240:0@lo:7: 00000004:00080000:0.0:1788263170.733328:0:9884:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788263170.733356:0:9884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9884:1875129709674496:0@lo:5: 00000100:00100000:0.0:1788263170.733384:0:9884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263170.733417:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709674496 00000100:00100000:0.0:1788263170.733421:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709674496 00000100:00100000:0.0:1788263170.733453:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788263170.733467:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9884:x1875129709674496:12345-0@lo:5: 00002000:00080000:0.0:1788263170.733481:0:8406:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1788263170.733513:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9884:x1875129709674496:12345-0@lo:5: Request processed in 47us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263170.733663:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788263170.733683:0:9884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3f9c00 going to sleep for 11 seconds 00010000:00080000:0.0:1788263170.733696:0:9884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff282fdfb80 x1875129709674496/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788263186 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263170.733704:0:9884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9884:1875129709674496:0@lo:5: 00000004:00080000:0.0:1788263170.733711:0:9884:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788263170.733732:0:9884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9884:1875129709674624:0@lo:5: 00000100:00100000:0.0:1788263170.733754:0:9884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263170.733769:0:9884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3f9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263170.733779:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709674624 00000100:00100000:0.0:1788263170.733783:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709674624 00000100:00100000:0.0:1788263170.733805:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788263170.733812:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9884:x1875129709674624:12345-0@lo:5: 00002000:00080000:0.0:1788263170.733838:0:8406:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1788263170.737844:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9884:x1875129709674624:12345-0@lo:5: Request processed in 4025us (4082us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788263170.737856:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788263170.738115:0:9884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff282fdfb80 x1875129709674624/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788263186 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263170.738133:0:9884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9884:1875129709674624:0@lo:5: 00000004:00080000:1.0:1788263170.738146:0:9884:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788263170.738243:0:9884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9884:1875129709674752:0@lo:900: 00000100:00100000:1.0:1788263170.738286:0:9884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263170.738331:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709674752 00000100:00100000:1.0:1788263170.738336:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709674752 00000100:00100000:1.0:1788263170.738459:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788263170.738470:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9884:x1875129709674752:12345-0@lo:900: 00000100:00100000:0.0:1788263170.738621:0:9884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd14d000 going to sleep for 11 seconds 00000100:00100000:1.0:1788263170.738701:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9884:x1875129709674752:12345-0@lo:900: Request processed in 234us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263170.738709:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788263170.738766:0:9884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28312ce00 x1875129709674752/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788263186 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263170.738778:0:9884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9884:1875129709674752:0@lo:900: 00002000:00080000:2.0:1788263170.745550:0:8404:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788263170.745569:0:8404:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1788263170.748626:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9889:x1875129709674368:12345-0@lo:5: Request processed in 16248us (16635us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788263170.748639:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788263170.748657:0:9889:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28312ea00 x1875129709674368/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788263186 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263170.748675:0:9889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9889:1875129709674368:0@lo:5: 00000004:00080000:3.0:1788263170.748691:0:9889:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000020:00000004:1.0:1788263170.812885:0:9909:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788263170.813048:0:9909:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:0.0:1788263171.504499:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1788263171.504514:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1788263171.631890:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788263171.631912:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709674880:0@lo:13: 00000100:00100000:0.0:1788263171.631977:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263171.632041:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709674880 00000100:00100000:0.0:1788263171.632048:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709674880 00000100:00100000:0.0:1788263171.632099:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788263171.632109:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709674880:12345-0@lo:13: 00002000:00000024:0.0:1788263171.632151:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263171.632193:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709674880:12345-0@lo:13: Request processed in 87us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263171.632201:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788263171.632219:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788263171.632256:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff282fdd180 x1875129709674880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263171.632274:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709674880:0@lo:13: 00010000:00010000:3.0:1788263171.633829:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263171.634531:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709675008:0@lo:13: 00000100:00100000:2.0:1788263171.634607:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263171.634698:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709675008 00000100:00100000:3.0:1788263171.634705:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709675008 00000100:00100000:3.0:1788263171.634766:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788263171.634775:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709675008:12345-0@lo:13: 00002000:00000024:3.0:1788263171.634795:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788263171.634885:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788263171.643054:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709675008:12345-0@lo:13: Request processed in 8271us (8438us total) trans 0 rc 0/0 00010000:00080000:2.0:1788263171.643054:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff282fdd180 x1875129709675008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263171.643087:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709675008:0@lo:13: 00000100:00100000:3.0:1788263171.643094:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1788263172.658975:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788263173.235778:0:10010:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788263173.236031:0:10010:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788263173.680037:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788263174.085389:0:10059:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788263174.085404:0:10059:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1788263174.192736:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709675136:0@lo:41: 00000100:00100000:1.0:1788263174.192799:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263174.192926:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709675136 00000100:00100000:0.0:1788263174.192940:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709675136 00000100:00100000:0.0:1788263174.192990:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788263174.192999:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709675136:12345-0@lo:41: 00000004:00000024:0.0:1788263174.193028:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788263174.193075:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709675136:12345-0@lo:41: Request processed in 78us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263174.193082:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788263174.193120:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709675136:0@lo:41: 00000100:00100000:1.0:1788263174.198027:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788263174.201169:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709675264:0@lo:41: 00000100:00100000:0.0:1788263174.201238:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263174.202133:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709675264 00000100:00100000:1.0:1788263174.202143:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709675264 00000100:00100000:1.0:1788263174.202189:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788263174.202200:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709675264:12345-0@lo:41: 00000004:00000024:1.0:1788263174.202234:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788263174.202305:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709675264:12345-0@lo:41: Request processed in 106us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263174.202311:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788263174.203393:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709675264:0@lo:41: 00000100:00100000:1.0:1788263174.692097:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263174.692374:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699139712 00000100:00100000:2.0:1788263174.692383:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699139712 00000100:00100000:2.0:1788263174.692431:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 181 00000100:00100000:2.0:1788263174.692439:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0+-99:2385:x1875129699139712:12345-192.168.203.26@tcp:250: 00010000:00080000:2.0:1788263174.692466:0:8424:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2b76a18b-dd04-4b81-8dda-882bf3f4d7c6@192.168.203.26@tcp t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:2.0:1788263174.692494:0:8424:0:(genops.c:1385:class_connect()) connect: client 2b76a18b-dd04-4b81-8dda-882bf3f4d7c6, cookie 0x4b1103cba666f34e 00000100:00080000:2.0:1788263174.692670:0:8424:0:(import.c:65:import_set_state_nolock()) ffff9ff3bf661800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263174.692725:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+5:2385:x1875129699139712:12345-192.168.203.26@tcp:250: Request processed in 285us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263174.692733:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 181 00010000:00010000:3.0:1788263174.706116:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263174.706732:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263174.706814:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699139840 00000100:00100000:1.0:1788263174.706824:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699139840 00000100:00100000:1.0:1788263174.706887:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 182 00000100:00100000:1.0:1788263174.706898:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+5:6144:x1875129699139840:12345-192.168.203.26@tcp:101: 00010000:00010000:1.0:1788263174.706913:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263174.706930:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3ae764400/0x4b1103cba666f355 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd405f293d116fc79 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263174.706957:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3ae764400/0x4b1103cba666f355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fc79 expref: 6 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263174.706968:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3ae764400/0x4b1103cba666f355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fc79 expref: 6 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263174.706977:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae764400, rc 0) 00000100:00100000:1.0:1788263174.707035:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+6:6144:x1875129699139840:12345-192.168.203.26@tcp:101: Request processed in 138us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263174.709251:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 182 00000100:00100000:0.0:1788263174.712691:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263174.712899:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699139968 00000100:00100000:2.0:1788263174.712909:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699139968 00000100:00100000:2.0:1788263174.712961:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 183 00000100:00100000:2.0:1788263174.712972:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+6:6144:x1875129699139968:12345-192.168.203.26@tcp:501: 00000100:00100000:2.0:1788263174.713108:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+6:6144:x1875129699139968:12345-192.168.203.26@tcp:501: Request processed in 137us (425us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788263174.713116:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 183 00000100:00100000:0.0:1788263174.714880:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263174.714959:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699140096 00000100:00100000:2.0:1788263174.714966:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699140096 00000100:00100000:2.0:1788263174.715010:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 184 00000100:00100000:2.0:1788263174.715018:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+6:6144:x1875129699140096:12345-192.168.203.26@tcp:101: 00010000:00010000:2.0:1788263174.715030:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263174.715044:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff282f5de00/0x4b1103cba666f35c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd405f293d116fc80 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263174.715067:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff282f5de00/0x4b1103cba666f35c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fc80 expref: 7 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263174.715077:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff282f5de00/0x4b1103cba666f35c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fc80 expref: 7 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263174.715087:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff282f5de00, rc 0) 00000100:00100000:2.0:1788263174.715131:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+7:6144:x1875129699140096:12345-192.168.203.26@tcp:101: Request processed in 114us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263174.715137:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 184 00000100:00100000:0.0:1788263174.717028:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263174.718213:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699140224 00000100:00100000:2.0:1788263174.718223:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699140224 00000100:00100000:2.0:1788263174.718288:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 185 00000100:00100000:2.0:1788263174.718298:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+7:6144:x1875129699140224:12345-192.168.203.26@tcp:501: 00000100:00100000:2.0:1788263174.718437:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+8:6144:x1875129699140224:12345-192.168.203.26@tcp:501: Request processed in 140us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263174.718458:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 185 00000100:00100000:0.0:1788263174.721497:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263174.721600:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699140352 00000100:00100000:2.0:1788263174.721609:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699140352 00000100:00100000:2.0:1788263174.721658:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 186 00000100:00100000:2.0:1788263174.721666:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+8:6144:x1875129699140352:12345-192.168.203.26@tcp:503: 00000100:00100000:2.0:1788263174.721797:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+8:6144:x1875129699140352:12345-192.168.203.26@tcp:503: Request processed in 131us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263174.721806:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 186 00000100:00100000:0.0:1788263174.725550:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263174.725658:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699140480 00000100:00100000:2.0:1788263174.725667:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699140480 00000100:00100000:2.0:1788263174.725719:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 187 00000100:00100000:2.0:1788263174.725728:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+8:6163:x1875129699140480:12345-192.168.203.26@tcp:502: 00000100:00100000:2.0:1788263174.725869:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+8:6163:x1875129699140480:12345-192.168.203.26@tcp:502: Request processed in 142us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263174.725877:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 187 00000100:00100000:0.0:1788263174.756218:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263174.756322:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699140608 00000100:00100000:2.0:1788263174.756331:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699140608 00000100:00100000:2.0:1788263174.756430:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 188 00000100:00100000:2.0:1788263174.756440:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+8:6163:x1875129699140608:12345-192.168.203.26@tcp:502: 00000100:00100000:2.0:1788263174.756616:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+8:6163:x1875129699140608:12345-192.168.203.26@tcp:502: Request processed in 177us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263174.756625:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 188 00000100:00100000:0.0:1788263174.769524:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263174.769816:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699140736 00000100:00100000:2.0:1788263174.769826:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699140736 00000100:00100000:2.0:1788263174.769877:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 189 00000100:00100000:2.0:1788263174.769902:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+8:6144:x1875129699140736:12345-192.168.203.26@tcp:101: 00010000:00010000:2.0:1788263174.769919:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263174.769934:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff282f5c200/0x4b1103cba666f363 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd405f293d116fcb1 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263174.769962:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff282f5c200/0x4b1103cba666f363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcb1 expref: 9 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263174.769973:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff282f5c200/0x4b1103cba666f363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcb1 expref: 9 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263174.769981:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff282f5c200, rc 0) 00000100:00100000:2.0:1788263174.770041:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+9:6144:x1875129699140736:12345-192.168.203.26@tcp:101: Request processed in 141us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263174.770048:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 189 00000100:00100000:0.0:1788263174.777359:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263174.777455:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699140864 00000100:00100000:2.0:1788263174.777465:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699140864 00000100:00100000:2.0:1788263174.777521:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 190 00000100:00100000:2.0:1788263174.777530:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a2692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+9:6144:x1875129699140864:12345-192.168.203.26@tcp:256: 20000000:01000000:2.0:1788263174.777554:0:6484:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788263174.777601:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788263174.777606:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788263174.777609:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788263174.777611:0:6484:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788263174.777614:0:6484:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1788263174.782876:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a2692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+9:6144:x1875129699140864:12345-192.168.203.26@tcp:256: Request processed in 5340us (5519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263174.782887:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 190 00000100:00100000:0.0:1788263174.787814:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263174.787891:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699140992 00000100:00100000:2.0:1788263174.787901:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699140992 00000100:00100000:2.0:1788263174.787949:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 191 00000100:00100000:2.0:1788263174.787958:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a2692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+9:6144:x1875129699140992:12345-192.168.203.26@tcp:101: 00010000:00010000:2.0:1788263174.787972:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263174.787987:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff282f5cc00/0x4b1103cba666f36a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd405f293d116fcb8 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263174.788012:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff282f5cc00/0x4b1103cba666f36a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcb8 expref: 10 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263174.788023:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff282f5cc00/0x4b1103cba666f36a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcb8 expref: 10 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263174.788031:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff282f5cc00, rc 0) 00000100:00100000:2.0:1788263174.788084:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a2692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:6144:x1875129699140992:12345-192.168.203.26@tcp:101: Request processed in 127us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263174.788090:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 191 00000100:00100000:0.0:1788263174.790677:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263174.790766:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699141120 00000100:00100000:1.0:1788263174.790775:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699141120 00000100:00100000:1.0:1788263174.790833:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 192 00000100:00100000:1.0:1788263174.790843:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:6144:x1875129699141120:12345-192.168.203.26@tcp:501: 00000100:00100000:1.0:1788263174.790990:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:6144:x1875129699141120:12345-192.168.203.26@tcp:501: Request processed in 148us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263174.790996:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 192 00000100:00100000:3.0:1788263174.797546:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263174.797672:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699141248 00000100:00100000:2.0:1788263174.797681:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699141248 00000100:00100000:2.0:1788263174.797747:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 193 00000100:00100000:2.0:1788263174.797757:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:6144:x1875129699141248:12345-192.168.203.26@tcp:503: 00000100:00100000:2.0:1788263174.797916:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:6144:x1875129699141248:12345-192.168.203.26@tcp:503: Request processed in 159us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263174.797924:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 193 00000100:00100000:0.0:1788263174.803140:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263174.803984:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699141376 00000100:00100000:1.0:1788263174.803996:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699141376 00000100:00100000:1.0:1788263174.804054:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 194 00000100:00100000:1.0:1788263174.804064:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:6167:x1875129699141376:12345-192.168.203.26@tcp:502: 00000100:00100000:1.0:1788263174.804239:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:6167:x1875129699141376:12345-192.168.203.26@tcp:502: Request processed in 176us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263174.804248:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 194 00000100:00100000:1.0:1788263174.808350:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263174.809050:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699141504 00000100:00100000:2.0:1788263174.809061:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699141504 00000100:00100000:2.0:1788263174.809124:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 195 00000100:00100000:2.0:1788263174.809152:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:6167:x1875129699141504:12345-192.168.203.26@tcp:502: 00000100:00100000:2.0:1788263174.809303:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:6167:x1875129699141504:12345-192.168.203.26@tcp:502: Request processed in 153us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263174.809311:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 195 00000100:00100000:3.0:1788263174.814437:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263174.815297:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699141632 00000100:00100000:2.0:1788263174.815309:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699141632 00000100:00100000:2.0:1788263174.815402:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:2.0:1788263174.815411:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2385:x1875129699141632:12345-192.168.203.26@tcp:38: 00010000:00080000:2.0:1788263174.815441:0:6493:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:2.0:1788263174.815495:0:6493:0:(genops.c:1385:class_connect()) connect: client ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea, cookie 0x4b1103cba666f371 00000004:00100000:2.0:1788263174.815519:0:6493:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788263174.815784:0:6493:0:(import.c:65:import_set_state_nolock()) ffff9ff3bf662800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263174.815864:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2385:x1875129699141632:12345-192.168.203.26@tcp:38: Request processed in 444us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263174.815872:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:3.0:1788263174.815957:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263174.820740:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699141888 00000100:00100000:1.0:1788263174.820756:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699141888 00000100:00100000:2.0:1788263174.824799:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00100000:2.0:1788263174.824811:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2385:x1875129699141888:12345-192.168.203.26@tcp:38: 00010000:00080000:2.0:1788263174.824844:0:6491:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:2.0:1788263174.824898:0:6491:0:(genops.c:1385:class_connect()) connect: client ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea, cookie 0x4b1103cba666f378 00000004:00100000:2.0:1788263174.824921:0:6491:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788263174.825116:0:6491:0:(import.c:65:import_set_state_nolock()) ffff9ff3bd5b8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263174.825727:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2385:x1875129699141888:12345-192.168.203.26@tcp:38: Request processed in 913us (9766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263174.825736:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00100000:0.0:1788263175.728711:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709675392:0@lo:13: 00000100:00100000:0.0:1788263175.728780:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788263175.728821:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263175.728953:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788263175.728964:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875129709675648:0@lo:400: 00000100:00100000:3.0:1788263175.728995:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263175.729034:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709675776:0@lo:400: 00000100:00100000:3.0:1788263175.729060:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263175.729107:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263175.729121:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b55bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709675904:0@lo:400: 00000100:00100000:3.0:1788263175.729134:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788263175.729141:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b55bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875129709676160:0@lo:400: 00000100:00100000:0.0:1788263175.729146:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263175.729162:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709675520:0@lo:400: 00000100:00100000:3.0:1788263175.729164:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263175.729187:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263175.729206:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263175.729211:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b55bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709676032:0@lo:400: 00000100:00100000:0.0:1788263175.729250:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263175.729287:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709675776 00000100:00100000:0.0:1788263175.729295:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709675776 00000100:00100000:0.0:1788263175.729329:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709676032 00000100:00100000:0.0:1788263175.729332:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709676032 00000100:00100000:0.0:1788263175.729348:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788263175.729357:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709675776:12345-0@lo:400: 00000100:00100000:1.0:1788263175.729390:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709675392 00000100:00100000:1.0:1788263175.729394:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709675392 00000100:00100000:0.0:1788263175.729414:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709675776:12345-0@lo:400: Request processed in 58us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263175.729421:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788263175.729431:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788263175.729434:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788263175.729438:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709675392:12345-0@lo:13: 00000100:00100000:0.0:1788263175.729439:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709676032:12345-0@lo:400: 00002000:00000024:1.0:1788263175.729459:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263175.729480:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709676032:12345-0@lo:400: Request processed in 41us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263175.729487:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788263175.729491:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709675392:12345-0@lo:13: Request processed in 54us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263175.729496:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788263175.729517:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788263175.729534:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709675776:0@lo:400: 00000100:00100000:1.0:1788263175.729540:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709675520 00000100:00100000:1.0:1788263175.729542:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709675520 00000100:00100000:0.0:1788263175.729558:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b55bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709676032:0@lo:400: 00000100:00100000:1.0:1788263175.729565:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788263175.729571:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3618:x1875129709675520:12345-0@lo:400: 00010000:00080000:0.0:1788263175.729571:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff281e3b100 x1875129709675392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263175.729598:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1788263175.729620:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709675392:0@lo:13: 00000100:00100000:1.0:1788263175.729621:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3618:x1875129709675520:12345-0@lo:400: Request processed in 52us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263175.729627:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788263175.729635:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709675520:0@lo:400: 00000100:00100000:1.0:1788263175.730943:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263175.730960:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709676288:0@lo:400: 00000100:00100000:1.0:1788263175.731006:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263175.745907:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709675648 00000100:00100000:2.0:1788263175.745922:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709675648 00000100:00100000:2.0:1788263175.746726:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709675904 00000100:00100000:2.0:1788263175.746733:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709675904 00000100:00100000:2.0:1788263175.746753:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709676160 00000100:00100000:2.0:1788263175.746755:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709676160 00000100:00100000:2.0:1788263175.746931:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709676288 00000100:00100000:2.0:1788263175.746936:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709676288 00000100:00100000:2.0:1788263175.746959:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788263175.747100:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875129709675648:12345-0@lo:400: 00000100:00100000:2.0:1788263175.747259:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875129709675648:12345-0@lo:400: Request processed in 163us (18261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263175.747276:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788263175.747295:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788263175.747302:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709675904:12345-0@lo:400: 00000100:00100000:2.0:1788263175.747341:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709675904:12345-0@lo:400: Request processed in 40us (18194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263175.747347:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788263175.747357:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788263175.747362:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875129709676160:12345-0@lo:400: 00000100:00100000:2.0:1788263175.747390:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875129709676160:12345-0@lo:400: Request processed in 28us (18225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263175.747396:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788263175.747410:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788263175.747418:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709676288:12345-0@lo:400: 00000100:00100000:2.0:1788263175.747449:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709676288:12345-0@lo:400: Request processed in 33us (16443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263175.747455:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1788263175.747482:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788263175.747488:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788263175.747516:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b55bed80 x1875129709675904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263175.747533:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b55bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709675904:0@lo:400: 00010000:00080000:3.0:1788263175.747534:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b55bdc00 x1875129709676160/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263175.747548:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b55bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875129709676160:0@lo:400: 00010000:00080000:3.0:1788263175.747562:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff281e39500 x1875129709675648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263175.747572:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875129709675648:0@lo:400: 00000100:00100000:2.0:1788263175.747631:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709676416:0@lo:400: 00000100:00100000:2.0:1788263175.747665:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263175.747729:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709676544:0@lo:400: 00000100:00100000:2.0:1788263175.747753:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263175.748896:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709676416 00000100:00100000:3.0:1788263175.748904:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709676416 00000100:00100000:3.0:1788263175.748948:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709676544 00000100:00100000:3.0:1788263175.748951:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709676544 00000100:00100000:3.0:1788263175.749004:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788263175.749011:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709676416:12345-0@lo:400: 00000100:00100000:3.0:1788263175.749287:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709676416:12345-0@lo:400: Request processed in 276us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263175.749295:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788263175.749310:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788263175.749317:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709676544:12345-0@lo:400: 00000100:00100000:3.0:1788263175.749348:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709676544:12345-0@lo:400: Request processed in 33us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263175.749354:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788263175.749372:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788263175.749394:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2831f1880 x1875129709676544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263175.749406:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709676544:0@lo:400: 00010000:00080000:3.0:1788263175.749437:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2831f1f80 x1875129709676416/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263175.749445:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709676416:0@lo:400: 00000100:00100000:3.0:1788263175.749605:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875129709676800:0@lo:400: 00000100:00100000:3.0:1788263175.749640:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263175.749662:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788263175.749668:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875129709676672:0@lo:400: 00000100:00100000:3.0:1788263175.749692:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263175.749715:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709676800 00000100:00100000:3.0:1788263175.749718:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709676800 00000100:00100000:3.0:1788263175.749746:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709676672 00000100:00100000:3.0:1788263175.749748:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709676672 00000100:00100000:3.0:1788263175.749775:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788263175.749781:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875129709676800:12345-0@lo:400: 00000100:00100000:3.0:1788263175.750992:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875129709676800:12345-0@lo:400: Request processed in 1206us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263175.751002:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788263175.751035:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788263175.751045:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875129709676672:12345-0@lo:400: 00000100:00100000:3.0:1788263175.751073:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875129709676672:12345-0@lo:400: Request processed in 32us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263175.751079:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1788263175.751098:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788263175.751101:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788263175.751125:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2831f2300 x1875129709676672/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263175.751257:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875129709676672:0@lo:400: 00010000:00080000:3.0:1788263175.751281:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2831f0a80 x1875129709676800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263175.751290:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875129709676800:0@lo:400: 00010000:00080000:1.0:1788263175.752326:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28312fb80 x1875129709676288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263175.752341:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709676288:0@lo:400: 00000100:00100000:3.0:1788263175.757261:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709676928:0@lo:400: 00000100:00100000:3.0:1788263175.757335:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263175.758630:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709676928 00000100:00100000:2.0:1788263175.758639:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709676928 00000100:00100000:2.0:1788263175.758712:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788263175.758721:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709676928:12345-0@lo:400: 00000100:00080000:3.0:1788263175.758905:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788263175.758946:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709676928:12345-0@lo:400: Request processed in 225us (1610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263175.758953:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788263175.759134:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2831f2d80 x1875129709676928/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263175.759146:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788263175.759161:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709676928:0@lo:400: 00000100:00100000:0.0:1788263175.824562:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263175.824651:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263175.824788:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699142016 00000100:00100000:2.0:1788263175.824797:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699142016 00000100:00100000:2.0:1788263175.824863:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699141760 00000100:00100000:2.0:1788263175.824867:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699141760 00000100:00100000:2.0:1788263175.824893:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:1.0:1788263175.824910:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:1.0:1788263175.824923:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:0:x1875129699141760:12345-192.168.203.26@tcp:41: 00000004:00000024:1.0:1788263175.824960:0:6491:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00080000:0.0:1788263175.824986:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788263175.824992:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788263175.825046:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:0:x1875129699142016:12345-192.168.203.26@tcp:41: 00000100:00100000:1.0:1788263175.825049:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:0:x1875129699141760:12345-192.168.203.26@tcp:41: Request processed in 127us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263175.825060:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 10 00000004:00000024:2.0:1788263175.825071:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788263175.825099:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:0:x1875129699142016:12345-192.168.203.26@tcp:41: Request processed in 58us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263175.825106:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:3.0:1788263175.828804:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263175.831484:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699142144 00000100:00100000:0.0:1788263175.831500:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699142144 00000100:00100000:0.0:1788263175.831607:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:0.0:1788263175.831619:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:6144:x1875129699142144:12345-192.168.203.26@tcp:41: 00000004:00000024:0.0:1788263175.831659:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788263175.831737:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:6144:x1875129699142144:12345-192.168.203.26@tcp:41: Request processed in 120us (2942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263175.831743:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:0.0:1788263175.834233:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263175.834380:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699142272 00000100:00100000:3.0:1788263175.834388:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699142272 00000100:00100000:3.0:1788263175.834438:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:3.0:1788263175.834446:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:6144:x1875129699142272:12345-192.168.203.26@tcp:40: 00000100:00100000:3.0:1788263175.834542:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:6144:x1875129699142272:12345-192.168.203.26@tcp:40: Request processed in 95us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263175.834549:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:1.0:1788263175.837502:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263175.837576:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263175.838163:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699142400 00000100:00100000:3.0:1788263175.838177:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699142400 00000100:00100000:3.0:1788263175.838240:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699142528 00000100:00100000:3.0:1788263175.838243:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699142528 00000100:00100000:3.0:1788263175.838282:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:3.0:1788263175.838298:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2385:x1875129699142400:12345-192.168.203.26@tcp:8: 00010000:00080000:3.0:1788263175.838344:0:8406:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:3.0:1788263175.838388:0:8406:0:(genops.c:1385:class_connect()) connect: client ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea, cookie 0x4b1103cba666f37f 00002000:00100000:3.0:1788263175.838403:0:8406:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea/ffff9ff283214000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788263175.838435:0:8406:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788263175.838776:0:8406:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788263175.838806:0:8406:0:(import.c:65:import_set_state_nolock()) ffff9ff283215800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263175.838914:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:0.0:1788263175.838921:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2385:x1875129699142528:12345-192.168.203.26@tcp:8: 00010000:00080000:0.0:1788263175.838946:0:9885:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:0.0:1788263175.838965:0:9885:0:(genops.c:1385:class_connect()) connect: client ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea, cookie 0x4b1103cba666f386 00002000:00100000:0.0:1788263175.838970:0:9885:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea/ffff9ff283244800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788263175.838982:0:9885:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788263175.839110:0:9885:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:3.0:1788263175.839358:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2385:x1875129699142400:12345-192.168.203.26@tcp:8: Request processed in 1061us (1863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263175.839366:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00080000:0.0:1788263175.842116:0:9885:0:(import.c:65:import_set_state_nolock()) ffff9ff283241800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263175.842219:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2385:x1875129699142528:12345-192.168.203.26@tcp:8: Request processed in 3292us (4638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263175.842255:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:0.0:1788263175.847774:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263175.847828:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263175.847920:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699142656 00000100:00100000:2.0:1788263175.847929:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699142656 00000100:00100000:2.0:1788263175.847982:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 197 00000100:00100000:2.0:1788263175.848006:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:2389:x1875129699142656:12345-192.168.203.26@tcp:400: 00000100:00100000:2.0:1788263175.848079:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:2389:x1875129699142656:12345-192.168.203.26@tcp:400: Request processed in 76us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263175.848086:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 197 00000100:00100000:1.0:1788263175.848275:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699142784 00000100:00100000:1.0:1788263175.848280:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699142784 00000100:00100000:1.0:1788263175.848319:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:1.0:1788263175.848330:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:6144:x1875129699142784:12345-192.168.203.26@tcp:900: 00000100:00100000:1.0:1788263175.848366:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:6144:x1875129699142784:12345-192.168.203.26@tcp:900: Request processed in 41us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263175.848372:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:1.0:1788263175.858928:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263175.859072:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699142912 00000100:00100000:2.0:1788263175.859081:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699142912 00000100:00100000:2.0:1788263175.859146:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:2.0:1788263175.859156:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:6144:x1875129699142912:12345-192.168.203.26@tcp:33: 00000004:00080000:2.0:1788263175.887413:0:6494:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 28176us 00000004:00200000:2.0:1788263175.904008:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788263175.904122:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:6144:x1875129699142912:12345-192.168.203.26@tcp:33: Request processed in 44962us (45197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263175.904132:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:3.0:1788263176.077522:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263176.077654:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699143040 00000100:00100000:0.0:1788263176.077664:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699143040 00000100:00100000:0.0:1788263176.077723:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:0.0:1788263176.077734:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:6185:x1875129699143040:12345-192.168.203.26@tcp:101: 00010000:00010000:0.0:1788263176.077753:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263176.077832:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f38d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fce9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263176.077897:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ee00/0x4b1103cba666f394 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263176.077911:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ee00/0x4b1103cba666f394 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263176.077925:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ee00/0x4b1103cba666f394 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263176.077969:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788263176.077973:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788263176.077986:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ee00/0x4b1103cba666f394 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263176.078010:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f38d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fce9 expref: 8 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263176.078029:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ee00/0x4b1103cba666f394 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fce9 expref: 7 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263176.078051:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff28314fb00) 00010000:00010000:0.0:1788263176.078054:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788263176.078058:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17ee00, rc 0) 00000100:00100000:0.0:1788263176.078124:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:6185:x1875129699143040:12345-192.168.203.26@tcp:101: Request processed in 392us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263176.078132:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:3.0:1788263176.240144:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709677056:0@lo:13: 00000100:00100000:3.0:1788263176.240214:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263176.242471:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709677056 00000100:00100000:1.0:1788263176.242484:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709677056 00000100:00100000:1.0:1788263176.242620:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788263176.242631:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709677056:12345-0@lo:13: 00002000:00000024:1.0:1788263176.242655:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263176.243174:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709677056:12345-0@lo:13: Request processed in 543us (2958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263176.243183:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788263176.243250:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff281e3a300 x1875129709677056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263176.243280:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709677056:0@lo:13: 00010000:00010000:2.0:1788263176.752670:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263176.753171:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788263176.753219:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709677184:0@lo:13: 00000100:00100000:3.0:1788263176.753290:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263176.754145:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709677184 00000100:00100000:0.0:1788263176.754154:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709677184 00000100:00100000:0.0:1788263176.754208:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788263176.754218:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709677184:12345-0@lo:13: 00002000:00000024:0.0:1788263176.754242:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263176.754309:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709677184:12345-0@lo:13: Request processed in 91us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263176.754316:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788263176.754370:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff281e3b100 x1875129709677184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263176.754390:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709677184:0@lo:13: 00000100:00100000:1.0:1788263176.754855:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263176.754868:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709677312:0@lo:13: 00000100:00100000:1.0:1788263176.754905:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263176.754964:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709677312 00000100:00100000:1.0:1788263176.754969:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709677312 00000100:00100000:1.0:1788263176.754990:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788263176.754996:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709677312:12345-0@lo:13: 00002000:00000024:1.0:1788263176.755010:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263176.755044:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709677312:12345-0@lo:13: Request processed in 47us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263176.755064:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788263176.755094:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28312c700 x1875129709677312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263176.755107:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709677312:0@lo:13: 00010000:00010000:3.0:1788263177.780266:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263178.240431:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263178.242078:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699143168 00000100:00100000:0.0:1788263178.242093:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699143168 00000100:00100000:0.0:1788263178.242188:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:0.0:1788263178.242202:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:6237:x1875129699143168:12345-192.168.203.26@tcp:41: 00000100:00080000:3.0:1788263178.242213:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1788263178.242238:0:8884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788263178.242318:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:6237:x1875129699143168:12345-192.168.203.26@tcp:41: Request processed in 121us (1897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263178.242326:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:1.0:1788263178.246516:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263178.246608:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699143296 00000100:00100000:0.0:1788263178.246617:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699143296 00000100:00100000:0.0:1788263178.246691:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00100000:0.0:1788263178.246702:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:6237:x1875129699143296:12345-192.168.203.26@tcp:41: 00000004:00000024:0.0:1788263178.246737:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788263178.246802:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:6237:x1875129699143296:12345-192.168.203.26@tcp:41: Request processed in 101us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263178.246810:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00080000:3.0:1788263178.247435:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788263178.249726:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263178.249813:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699143424 00000100:00100000:1.0:1788263178.249821:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699143424 00000100:00100000:1.0:1788263178.249886:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:1.0:1788263178.249894:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:6237:x1875129699143424:12345-192.168.203.26@tcp:13: 00002000:00000024:1.0:1788263178.249921:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263178.249980:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:6237:x1875129699143424:12345-192.168.203.26@tcp:13: Request processed in 86us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263178.249987:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00080000:3.0:1788263178.250354:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263178.252835:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263178.252921:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699143552 00000100:00100000:1.0:1788263178.252930:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699143552 00000100:00100000:1.0:1788263178.253000:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:1.0:1788263178.253010:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:6237:x1875129699143552:12345-192.168.203.26@tcp:13: 00002000:00000024:1.0:1788263178.253038:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263178.253115:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:6237:x1875129699143552:12345-192.168.203.26@tcp:13: Request processed in 106us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263178.253122:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00080000:3.0:1788263178.253685:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788263178.799855:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263179.314150:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788263179.314175:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709677440:0@lo:41: 00000100:00100000:2.0:1788263179.314258:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263179.314320:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709677440 00000100:00100000:2.0:1788263179.314327:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709677440 00000100:00100000:2.0:1788263179.314371:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788263179.314381:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709677440:12345-0@lo:41: 00000004:00000024:2.0:1788263179.314414:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788263179.314457:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709677440:12345-0@lo:41: Request processed in 77us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263179.314475:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788263179.314521:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709677440:0@lo:41: 00000100:00100000:0.0:1788263179.315137:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263179.315149:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b55bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709677568:0@lo:41: 00000100:00100000:0.0:1788263179.315183:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263179.315408:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709677568 00000100:00100000:3.0:1788263179.315414:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709677568 00000100:00100000:3.0:1788263179.315455:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788263179.315463:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709677568:12345-0@lo:41: 00000004:00000024:3.0:1788263179.315483:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788263179.315520:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709677568:12345-0@lo:41: Request processed in 58us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263179.315527:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788263179.315675:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b55bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709677568:0@lo:41: 00010000:00010000:2.0:1788263179.823769:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788263179.825351:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea 00000100:00100000:2.0:1788263180.848750:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875129709677824:0@lo:400: 00000100:00100000:2.0:1788263180.848818:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263180.848871:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875129709678336:0@lo:400: 00000100:00100000:2.0:1788263180.848894:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263180.848925:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875129709678848:0@lo:400: 00000100:00100000:2.0:1788263180.848946:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263180.848971:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709679360:0@lo:13: 00000100:00100000:2.0:1788263180.848995:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263180.849012:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788263180.849018:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709677696:0@lo:400: 00000100:00100000:2.0:1788263180.849042:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263180.849059:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709678208:0@lo:400: 00000100:00100000:2.0:1788263180.849080:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263180.849098:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709678720:0@lo:400: 00000100:00100000:2.0:1788263180.849132:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263180.849149:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709679232:0@lo:400: 00000100:00100000:2.0:1788263180.849170:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263180.849186:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709677824 00000100:00100000:2.0:1788263180.849193:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709677952:0@lo:400: 00000100:00100000:0.0:1788263180.849193:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709677824 00000100:00100000:2.0:1788263180.849214:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263180.849242:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709678464:0@lo:400: 00000100:00100000:0.0:1788263180.849251:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709678336 00000100:00100000:0.0:1788263180.849254:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709678336 00000100:00100000:2.0:1788263180.849262:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263180.849276:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709678848 00000100:00100000:0.0:1788263180.849279:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709678848 00000100:00100000:2.0:1788263180.849282:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709678976:0@lo:400: 00000100:00100000:0.0:1788263180.849290:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709678464 00000100:00100000:0.0:1788263180.849292:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709678464 00000100:00100000:2.0:1788263180.849301:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263180.849303:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709678976 00000100:00100000:0.0:1788263180.849305:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709678976 00000100:00100000:2.0:1788263180.849313:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788263180.849318:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709678080:0@lo:400: 00000100:00100000:0.0:1788263180.849318:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788263180.849326:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875129709677824:12345-0@lo:400: 00000100:00100000:2.0:1788263180.849347:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263180.849358:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709678592:0@lo:400: 00000100:00100000:0.0:1788263180.849388:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875129709677824:12345-0@lo:400: Request processed in 62us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263180.849395:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788263180.849430:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709678080 00000100:00100000:0.0:1788263180.849433:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709678080 00000100:00100000:0.0:1788263180.849447:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788263180.849452:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5400e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875129709678336:12345-0@lo:400: 00000100:00100000:0.0:1788263180.849482:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5400e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875129709678336:12345-0@lo:400: Request processed in 29us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263180.849487:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788263180.849497:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788263180.849502:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875129709678848:12345-0@lo:400: 00000100:00100000:0.0:1788263180.849523:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875129709678848:12345-0@lo:400: Request processed in 22us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263180.849529:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788263180.849538:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788263180.849543:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709678464:12345-0@lo:400: 00000100:00100000:0.0:1788263180.849568:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709678464:12345-0@lo:400: Request processed in 25us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263180.849573:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788263180.849601:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788263180.849608:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875129709678976:12345-0@lo:400: 00000100:00100000:0.0:1788263180.849634:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875129709678976:12345-0@lo:400: Request processed in 27us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263180.849639:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788263180.849640:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709679360 00000100:00100000:1.0:1788263180.849644:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709679360 00000100:00100000:0.0:1788263180.849649:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788263180.849653:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709678080:12345-0@lo:400: 00000100:00100000:1.0:1788263180.849670:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788263180.849677:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709678080:12345-0@lo:400: Request processed in 24us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263180.849678:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709679360:12345-0@lo:13: 00000100:00100000:0.0:1788263180.849692:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00002000:00000024:1.0:1788263180.849706:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788263180.849720:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788263180.849723:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788263180.849725:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263180.849740:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709679360:12345-0@lo:13: Request processed in 65us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263180.849747:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788263180.849765:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709677696 00000100:00100000:1.0:1788263180.849768:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709677696 00000100:00100000:1.0:1788263180.849798:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788263180.849805:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3621:x1875129709677696:12345-0@lo:400: 00000100:00100000:1.0:1788263180.849833:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3621:x1875129709677696:12345-0@lo:400: Request processed in 29us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263180.849839:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788263180.849867:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709678720 00000100:00100000:1.0:1788263180.849871:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709678720 00000100:00100000:1.0:1788263180.849896:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709679232 00000100:00100000:1.0:1788263180.849899:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709679232 00000100:00100000:1.0:1788263180.849915:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788263180.849920:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283324e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709678720:12345-0@lo:400: 00000100:00100000:1.0:1788263180.849950:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283324e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709678720:12345-0@lo:400: Request processed in 30us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263180.849955:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788263180.849965:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788263180.849970:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709679232:12345-0@lo:400: 00000100:00100000:1.0:1788263180.849994:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709679232:12345-0@lo:400: Request processed in 23us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263180.849999:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788263180.850022:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263180.850053:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709678208 00000100:00100000:1.0:1788263180.850062:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709678208 00000100:00100000:1.0:1788263180.850080:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709677952 00000100:00100000:1.0:1788263180.850082:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709677952 00000100:00100000:1.0:1788263180.850094:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788263180.850100:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709678208:12345-0@lo:400: 00000100:00100000:1.0:1788263180.850132:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709678208:12345-0@lo:400: Request processed in 33us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263180.850138:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788263180.850149:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788263180.850154:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709677952:12345-0@lo:400: 00000100:00100000:1.0:1788263180.850179:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709677952:12345-0@lo:400: Request processed in 25us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263180.850183:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00010000:1.0:1788263180.850207:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263180.850268:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709677696:0@lo:400: 00000100:00100000:1.0:1788263180.850281:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709678208:0@lo:400: 00010000:00080000:1.0:1788263180.850292:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff387678a80 x1875129709678720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263180.850301:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709678720:0@lo:400: 00010000:00080000:1.0:1788263180.850311:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5401880 x1875129709679232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263180.850318:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709679232:0@lo:400: 00010000:00080000:1.0:1788263180.850326:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff281e39180 x1875129709679360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263180.850336:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709679360:0@lo:13: 00000100:00100000:1.0:1788263180.850359:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875129709677824:0@lo:400: 00000100:00100000:1.0:1788263180.850368:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875129709678336:0@lo:400: 00000100:00100000:1.0:1788263180.850575:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875129709678848:0@lo:400: 00000001:00100000:0.0:1788263180.852663:0:7422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea 00000100:00100000:2.0:1788263180.853287:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263180.853352:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5400700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709679104:0@lo:400: 00000100:00100000:0.0:1788263180.853381:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709678592 00000100:00100000:0.0:1788263180.853390:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709678592 00000100:00100000:0.0:1788263180.853448:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788263180.853458:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709678592:12345-0@lo:400: 00000100:00100000:2.0:1788263180.853488:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263180.854620:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709679104 00000100:00100000:1.0:1788263180.854629:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709679104 00000100:00100000:1.0:1788263180.854671:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788263180.854679:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709679104:12345-0@lo:400: 00000100:00100000:2.0:1788263180.854762:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709677952:0@lo:400: 00000100:00100000:0.0:1788263180.855556:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709678592:12345-0@lo:400: Request processed in 2096us (6176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263180.855566:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788263180.858844:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709679104:12345-0@lo:400: Request processed in 4158us (5349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263180.858859:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1788263180.858898:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788263180.858904:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788263180.858995:0:6470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea 00010000:00080000:2.0:1788263180.864525:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2831f0e00 x1875129709678464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263180.864545:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709678464:0@lo:400: 00010000:00080000:2.0:1788263180.864562:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5403b80 x1875129709678976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263180.864570:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709678976:0@lo:400: 00000100:00100000:2.0:1788263180.866553:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709678080:0@lo:400: 00010000:00080000:2.0:1788263180.866572:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff387679c00 x1875129709678592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263180.866610:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709678592:0@lo:400: 00010000:00080000:2.0:1788263180.866624:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5400700 x1875129709679104/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263180.866633:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5400700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709679104:0@lo:400: 00000100:00100000:3.0:1788263180.914547:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263180.914619:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263180.914654:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263180.914680:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263180.914722:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263180.914754:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699143808 00000100:00100000:3.0:1788263180.914762:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699143808 00000100:00100000:3.0:1788263180.914816:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699143936 00000100:00100000:3.0:1788263180.914819:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699143936 00000100:00100000:3.0:1788263180.914847:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:3.0:1788263180.914858:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2386:x1875129699143808:12345-192.168.203.26@tcp:400: 00000100:00100000:3.0:1788263180.914929:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2386:x1875129699143808:12345-192.168.203.26@tcp:400: Request processed in 74us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263180.914947:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:3.0:1788263180.914966:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:3.0:1788263180.914974:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699143936:12345-192.168.203.26@tcp:400: 00000100:00100000:3.0:1788263180.915003:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699143936:12345-192.168.203.26@tcp:400: Request processed in 30us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263180.915009:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:3.0:1788263180.915027:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699144064 00000100:00100000:3.0:1788263180.915031:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699144064 00000100:00100000:3.0:1788263180.915054:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699144192 00000100:00100000:3.0:1788263180.915057:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699144192 00000100:00100000:3.0:1788263180.915076:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:3.0:1788263180.915082:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2386:x1875129699144064:12345-192.168.203.26@tcp:400: 00000100:00100000:3.0:1788263180.915106:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2386:x1875129699144064:12345-192.168.203.26@tcp:400: Request processed in 25us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263180.915113:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:3.0:1788263180.915125:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:3.0:1788263180.915131:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699144192:12345-192.168.203.26@tcp:400: 00000100:00100000:3.0:1788263180.915153:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699144192:12345-192.168.203.26@tcp:400: Request processed in 23us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263180.915158:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00080000:3.0:1788263180.915173:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788263180.915176:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788263180.915178:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788263180.915180:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263180.918424:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699143680 00000100:00100000:3.0:1788263180.918451:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699143680 00000100:00100000:3.0:1788263180.918541:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 199 00000100:00100000:3.0:1788263180.918552:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:2386:x1875129699143680:12345-192.168.203.26@tcp:400: 00000100:00100000:3.0:1788263180.918657:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:2386:x1875129699143680:12345-192.168.203.26@tcp:400: Request processed in 107us (4003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263180.918665:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 199 00000001:02000400:1.0:1788263180.955064:0:10157:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788263181.365092:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788263181.372333:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709679488:0@lo:13: 00000100:00100000:1.0:1788263181.372409:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263181.372704:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709679488 00000100:00100000:2.0:1788263181.372712:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709679488 00000100:00100000:2.0:1788263181.372764:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788263181.372773:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709679488:12345-0@lo:13: 00002000:00000024:2.0:1788263181.372795:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263181.372854:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709679488:12345-0@lo:13: Request processed in 82us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263181.372862:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788263181.372945:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283325880 x1875129709679488/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263181.372965:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709679488:0@lo:13: 00000100:00100000:0.0:1788263181.871722:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263181.871745:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709679616:0@lo:13: 00000100:00100000:0.0:1788263181.871809:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263181.871924:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709679616 00000100:00100000:0.0:1788263181.871930:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709679616 00000100:00100000:0.0:1788263181.871973:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788263181.871982:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709679616:12345-0@lo:13: 00002000:00000024:0.0:1788263181.872023:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263181.872069:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709679616:12345-0@lo:13: Request processed in 87us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263181.872075:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788263181.872105:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709679744:0@lo:13: 00000100:00100000:0.0:1788263181.872130:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263181.872159:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709679744 00000100:00100000:0.0:1788263181.872163:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709679744 00000100:00100000:0.0:1788263181.872188:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788263181.872194:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709679744:12345-0@lo:13: 00002000:00000024:0.0:1788263181.872374:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263181.872411:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709679744:12345-0@lo:13: Request processed in 216us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263181.872418:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788263181.872447:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5635180 x1875129709679744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263181.872464:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709679744:0@lo:13: 00010000:00080000:0.0:1788263181.872492:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff281e39180 x1875129709679616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263181.872504:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709679616:0@lo:13: 00010000:00010000:2.0:1788263181.872782:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788263181.875197:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea 00010000:00010000:2.0:1788263182.895822:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263183.919961:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263184.432959:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263184.432981:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709679872:0@lo:41: 00000100:00100000:1.0:1788263184.433045:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263184.433187:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709679872 00000100:00100000:2.0:1788263184.433195:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709679872 00000100:00100000:2.0:1788263184.433248:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788263184.433256:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709679872:12345-0@lo:41: 00000004:00000024:2.0:1788263184.433286:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788263184.433335:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709679872:12345-0@lo:41: Request processed in 80us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263184.433341:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788263184.433444:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709679872:0@lo:41: 00000100:00100000:2.0:1788263184.435940:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788263184.435961:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709680000:0@lo:41: 00000100:00100000:2.0:1788263184.436018:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263184.436083:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709680000 00000100:00100000:2.0:1788263184.436090:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709680000 00000100:00100000:2.0:1788263184.436131:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788263184.436139:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709680000:12345-0@lo:41: 00000004:00000024:2.0:1788263184.436168:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788263184.436235:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709680000:12345-0@lo:41: Request processed in 96us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263184.436242:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788263184.436283:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709680000:0@lo:41: 00000020:00000080:2.0:1788263184.616985:0:10304:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe8c909eb0 20000000:00000080:2.0:1788263184.617001:0:10304:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ff283345800 uarg=0000000000000000 20000000:01000000:2.0:1788263184.617189:0:10304:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788263184.617192:0:10304:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788263184.617195:0:10304:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788263184.617199:0:10304:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788263184.617213:0:10304:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788263184.617268:0:10304:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788263184.617271:0:10304:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788263184.617988:0:10305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1788263184.618363:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1788263184.618392:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1788263184.618406:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:3.0:1788263184.618415:0:10304:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788263184.618417:0:10304:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788263184.618987:0:10306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1788263184.619271:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1788263184.619293:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1788263184.619308:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:3.0:1788263184.619316:0:10304:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788263184.619318:0:10304:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788263184.619897:0:10307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1788263184.620131:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1788263184.620153:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1788263184.620167:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:3.0:1788263184.620178:0:10304:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788263184.620180:0:10304:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788263184.620791:0:10308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1788263184.621158:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1788263184.621183:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1788263184.621197:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1788263184.621219:0:10304:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788263184.621221:0:10304:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788263184.621685:0:10309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1788263184.621847:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1788263184.621879:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1788263184.621895:0:10304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:3.0:1788263184.621910:0:10304:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788263184.621931:0:10304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ff3829e8600/0x4b1103cba666f39b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263184.621950:0:10304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff398eed800/0x4b1103cba666f236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f22f expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263184.621957:0:10304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff3829e8800/0x4b1103cba666f260 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f259 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263184.621963:0:10304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff3bd17f400/0x4b1103cba666f29f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f298 expref: 23 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263184.621969:0:10304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff3829e8a00/0x4b1103cba666f2ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f2a6 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263184.621976:0:10304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f2bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f2b4 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263184.621982:0:10304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff3bd17fc00/0x4b1103cba666f2d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f2d0 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263184.621989:0:10304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f2fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f2f3 expref: 23 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263184.621996:0:10304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff398eec000/0x4b1103cba666f31d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f316 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263184.622003:0:10304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff3ae765e00/0x4b1103cba666f347 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f340 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263184.622024:0:10304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff3ae764400/0x4b1103cba666f355 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fc79 expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263184.622031:0:10304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff282f5de00/0x4b1103cba666f35c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fc80 expref: 9 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263184.622038:0:10304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ff3829e8600/0x4b1103cba666f39b lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263184.622146:0:10304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff282f5de00/0x4b1103cba666f35c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fc80 expref: 9 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263184.622161:0:10304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ff282f5de00/0x4b1103cba666f35c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fc80 expref: 9 pid: 6485 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263184.622175:0:10304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b55bca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875129709680128:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263184.622323:0:10304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff3ae764400/0x4b1103cba666f355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fc79 expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263184.622332:0:10304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ff3ae764400/0x4b1103cba666f355 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fc79 expref: 9 pid: 6484 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263184.622341:0:10304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b55bdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875129709680256:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263184.622373:0:10304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff3ae765e00/0x4b1103cba666f347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f340 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263184.622381:0:10304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff3ae765e00/0x4b1103cba666f347 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f340 expref: 23 pid: 6486 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263184.622402:0:10304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b55bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875129709680384:0@lo:104: 00000100:00100000:3.0:1788263184.622444:0:10304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788263184.622505:0:10304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff398eec000/0x4b1103cba666f31d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f316 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263184.622514:0:10304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff398eec000/0x4b1103cba666f31d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f316 expref: 23 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263184.622522:0:10304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833be680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875129709680512:0@lo:104: 00000100:00100000:3.0:1788263184.622557:0:10304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788263184.622608:0:10304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f2fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f2f3 expref: 23 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263184.622615:0:10304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f2fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f2f3 expref: 23 pid: 8424 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263184.622622:0:10304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875129709680640:0@lo:104: 00000100:00100000:3.0:1788263184.622641:0:10304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788263184.622667:0:10304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff3bd17fc00/0x4b1103cba666f2d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f2d0 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263184.622675:0:10304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff3bd17fc00/0x4b1103cba666f2d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f2d0 expref: 23 pid: 6486 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263184.622683:0:10304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875129709680768:0@lo:104: 00000100:00100000:3.0:1788263184.622707:0:10304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788263184.622724:0:10304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f2bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f2b4 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263184.622742:0:10304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f2bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f2b4 expref: 23 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263184.622751:0:10304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833be300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875129709680896:0@lo:104: 00000100:00100000:3.0:1788263184.622774:0:10304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788263184.622791:0:10304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff3829e8a00/0x4b1103cba666f2ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f2a6 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263184.622799:0:10304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff3829e8a00/0x4b1103cba666f2ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f2a6 expref: 23 pid: 6486 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263184.622806:0:10304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875129709681024:0@lo:104: 00000100:00100000:3.0:1788263184.622824:0:10304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788263184.622839:0:10304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff3bd17f400/0x4b1103cba666f29f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f298 expref: 23 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263184.622847:0:10304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff3bd17f400/0x4b1103cba666f29f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f298 expref: 23 pid: 8424 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263184.622855:0:10304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875129709681152:0@lo:104: 00000100:00100000:3.0:1788263184.622872:0:10304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788263184.622887:0:10304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff3829e8800/0x4b1103cba666f260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f259 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263184.622894:0:10304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff3829e8800/0x4b1103cba666f260 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f259 expref: 23 pid: 6485 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263184.622901:0:10304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875129709681280:0@lo:104: 00000100:00100000:3.0:1788263184.622926:0:10304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788263184.622941:0:10304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff398eed800/0x4b1103cba666f236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f22f expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263184.622948:0:10304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff398eed800/0x4b1103cba666f236 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f22f expref: 23 pid: 6486 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263184.622956:0:10304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875129709681408:0@lo:104: 00000100:00100000:3.0:1788263184.622971:0:10304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263184.622980:0:10304:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3b4e0f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788263184.623271:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709680384 00000100:00100000:2.0:1788263184.623279:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709680384 00000100:00100000:2.0:1788263184.623311:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709680512 00000100:00100000:2.0:1788263184.623314:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709680512 00000100:00100000:2.0:1788263184.623323:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709680640 00000100:00100000:2.0:1788263184.623326:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709680640 00000100:00100000:2.0:1788263184.623335:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709680768 00000100:00100000:2.0:1788263184.623337:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709680768 00000100:00100000:2.0:1788263184.623345:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709680896 00000100:00100000:2.0:1788263184.623347:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709680896 00000100:00100000:2.0:1788263184.623354:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709681024 00000100:00100000:2.0:1788263184.623356:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709681024 00000100:00100000:2.0:1788263184.623364:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709681152 00000100:00100000:2.0:1788263184.623366:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709681152 00000100:00100000:2.0:1788263184.623374:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709681280 00000100:00100000:2.0:1788263184.623376:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709681280 00000100:00100000:2.0:1788263184.623384:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709681408 00000100:00100000:2.0:1788263184.623386:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709681408 00000100:00100000:2.0:1788263184.623398:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788263184.623414:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+11:10304:x1875129709680384:12345-0@lo:104: 00010000:00010000:2.0:1788263184.623427:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f347 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.623486:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788263184.623492:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+11:10304:x1875129709680384:12345-0@lo:104: Request processed in 80us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263184.623499:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788263184.623516:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788263184.623523:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+10:10304:x1875129709680512:12345-0@lo:104: 00010000:00010000:2.0:1788263184.623530:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff398eedc00/0x4b1103cba666f316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f31d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.623563:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788263184.623569:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+10:10304:x1875129709680512:12345-0@lo:104: Request processed in 47us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263184.623574:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788263184.623601:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788263184.623607:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+9:10304:x1875129709680640:12345-0@lo:104: 00010000:00010000:2.0:1788263184.623615:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff398eec200/0x4b1103cba666f2f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f2fa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.623647:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788263184.623652:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+9:10304:x1875129709680640:12345-0@lo:104: Request processed in 46us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263184.623658:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788263184.623669:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788263184.623680:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2820f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+8:10304:x1875129709680768:12345-0@lo:104: 00010000:00010000:2.0:1788263184.623687:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff398eeda00/0x4b1103cba666f2d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f2d7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.623710:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788263184.623714:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2820f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+8:10304:x1875129709680768:12345-0@lo:104: Request processed in 35us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263184.623719:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788263184.623756:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788263184.623761:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+7:10304:x1875129709680896:12345-0@lo:104: 00010000:00010000:2.0:1788263184.623768:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9200/0x4b1103cba666f2b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f2bb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.623788:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788263184.623792:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+7:10304:x1875129709680896:12345-0@lo:104: Request processed in 31us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263184.623796:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788263184.623806:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788263184.623810:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+6:10304:x1875129709681024:12345-0@lo:104: 00010000:00010000:2.0:1788263184.623816:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f2a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f2ad expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.623835:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788263184.623839:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+6:10304:x1875129709681024:12345-0@lo:104: Request processed in 29us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263184.623844:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788263184.623853:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788263184.623863:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+5:10304:x1875129709681152:12345-0@lo:104: 00010000:00010000:2.0:1788263184.623870:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f298 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f29f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.623892:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788263184.623896:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+5:10304:x1875129709681152:12345-0@lo:104: Request processed in 34us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263184.623901:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788263184.623911:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788263184.623916:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:10304:x1875129709681280:12345-0@lo:104: 00010000:00010000:2.0:1788263184.623922:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff398eec600/0x4b1103cba666f259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f260 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.623941:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:2.0:1788263184.623945:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:10304:x1875129709681280:12345-0@lo:104: Request processed in 29us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263184.623949:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788263184.623957:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788263184.623962:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:10304:x1875129709681408:12345-0@lo:104: 00010000:00010000:2.0:1788263184.623967:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f22f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f236 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.623984:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:2.0:1788263184.623988:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:10304:x1875129709681408:12345-0@lo:104: Request processed in 27us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263184.623992:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1788263184.624007:0:9492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1788263184.624020:0:9492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f347 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.624026:0:9492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9600 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:2.0:1788263184.624031:0:9492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f347 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.624136:0:9492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f347 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263184.624145:0:9492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f347 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263184.624151:0:9492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788263184.624177:0:9492:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f340 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f347 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.624183:0:9492:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788263184.624200:0:9492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f340 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f347 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.624216:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f340 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f347 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.624228:0:9492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1788263184.624231:0:9492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff398eedc00/0x4b1103cba666f316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f31d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.624236:0:9492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eedc00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:2.0:1788263184.624239:0:9492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eedc00/0x4b1103cba666f316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f31d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.624254:0:9492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff398eedc00/0x4b1103cba666f316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f31d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263184.624260:0:9492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eedc00/0x4b1103cba666f316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f31d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263184.624265:0:9492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788263184.624277:0:9492:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff398eedc00/0x4b1103cba666f316 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f31d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.624283:0:9492:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788263184.624296:0:9492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff398eedc00/0x4b1103cba666f316 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f31d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.624303:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff398eedc00/0x4b1103cba666f316 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f31d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.624311:0:9492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788263184.624314:0:9492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff398eec200/0x4b1103cba666f2f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f2fa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.624319:0:9492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eec200 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:2.0:1788263184.624321:0:9492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eec200/0x4b1103cba666f2f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f2fa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.624328:0:9492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff398eec200/0x4b1103cba666f2f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f2fa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263184.624334:0:9492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eec200/0x4b1103cba666f2f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f2fa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263184.624345:0:9492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788263184.624357:0:9492:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff398eec200/0x4b1103cba666f2f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f2fa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.624362:0:9492:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788263184.624367:0:9492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff398eec200/0x4b1103cba666f2f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f2fa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.624374:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff398eec200/0x4b1103cba666f2f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f2fa expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.624381:0:9492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788263184.624384:0:9492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff398eeda00/0x4b1103cba666f2d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f2d7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.624390:0:9492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eeda00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:2.0:1788263184.624392:0:9492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eeda00/0x4b1103cba666f2d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f2d7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.624398:0:9492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff398eeda00/0x4b1103cba666f2d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f2d7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263184.624403:0:9492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eeda00/0x4b1103cba666f2d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f2d7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263184.624408:0:9492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788263184.624417:0:9492:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff398eeda00/0x4b1103cba666f2d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f2d7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.624422:0:9492:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788263184.624433:0:9492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff398eeda00/0x4b1103cba666f2d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f2d7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.624440:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff398eeda00/0x4b1103cba666f2d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f2d7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.624448:0:9492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788263184.624564:0:9492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9200/0x4b1103cba666f2b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f2bb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.624572:0:9492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9200 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:2.0:1788263184.624575:0:9492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9200/0x4b1103cba666f2b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f2bb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.624619:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788263184.624625:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f2a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f2ad expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.624631:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eeca00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:0.0:1788263184.624634:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f2a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f2ad expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.624640:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f2a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f2ad expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263184.624657:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f2a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f2ad expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263184.624661:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788263184.624676:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f2a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f2ad expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.624681:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263184.624686:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f2a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f2ad expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.624692:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff398eeca00/0x4b1103cba666f2a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f2ad expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.624702:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788263184.624704:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f298 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f29f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.624710:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eed200 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:0.0:1788263184.624712:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f298 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f29f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.624718:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f29f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263184.624724:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f29f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263184.624730:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788263184.624749:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f298 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f29f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.624754:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263184.624758:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f298 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f29f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.624764:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f298 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f29f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.624772:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788263184.624775:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff398eec600/0x4b1103cba666f259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f260 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.624780:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eec600 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:0.0:1788263184.624782:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eec600/0x4b1103cba666f259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f260 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.624789:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff398eec600/0x4b1103cba666f259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f260 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263184.624795:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eec600/0x4b1103cba666f259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f260 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263184.624799:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788263184.624808:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff398eec600/0x4b1103cba666f259 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f260 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.624813:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263184.624817:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff398eec600/0x4b1103cba666f259 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f260 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.624832:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff398eec600/0x4b1103cba666f259 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f260 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.624840:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263184.624843:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f22f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f236 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.624847:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17f000 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:0.0:1788263184.624850:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f22f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f236 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.624856:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f22f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f236 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263184.624861:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f22f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f236 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263184.624866:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788263184.624878:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f22f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f236 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.624884:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263184.624888:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f22f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f236 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.624893:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f22f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f236 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.624901:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263184.624907:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263184.624909:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263184.624958:0:9492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9200/0x4b1103cba666f2b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f2bb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263184.624964:0:9492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9200/0x4b1103cba666f2b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f2bb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263184.624969:0:9492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788263184.624982:0:9492:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9200/0x4b1103cba666f2b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f2bb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.624988:0:9492:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788263184.624992:0:9492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9200/0x4b1103cba666f2b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f2bb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.624998:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9200/0x4b1103cba666f2b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f2bb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.625011:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263184.625018:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263184.625020:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263184.625027:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263184.625105:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709681536:0@lo:103: 00000100:00100000:2.0:1788263184.625150:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263184.625193:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709682048:0@lo:103: 00000100:00100000:2.0:1788263184.625225:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263184.625242:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709682560:0@lo:103: 00000100:00100000:2.0:1788263184.625259:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263184.625279:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788263184.625285:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709681920:0@lo:103: 00000100:00100000:2.0:1788263184.625304:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263184.625326:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709682432:0@lo:103: 00000100:00100000:2.0:1788263184.625344:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263184.625364:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709681664:0@lo:103: 00000100:00100000:2.0:1788263184.625383:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263184.625392:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709682176:0@lo:103: 00000100:00100000:2.0:1788263184.625407:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263184.625417:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788263184.625422:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709681792:0@lo:103: 00000100:00100000:2.0:1788263184.625439:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263184.625447:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709682304:0@lo:103: 00000100:00100000:3.0:1788263184.625678:0:10304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b55bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875129709680384:0@lo:104: 00000100:00100000:3.0:1788263184.625689:0:10304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833be680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875129709680512:0@lo:104: 00000100:00100000:3.0:1788263184.625696:0:10304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875129709680640:0@lo:104: 00000100:00100000:3.0:1788263184.625704:0:10304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875129709680768:0@lo:104: 00000100:00100000:3.0:1788263184.625711:0:10304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833be300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875129709680896:0@lo:104: 00000100:00100000:3.0:1788263184.625718:0:10304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875129709681024:0@lo:104: 00000100:00100000:3.0:1788263184.625725:0:10304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875129709681152:0@lo:104: 00000100:00100000:3.0:1788263184.625731:0:10304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875129709681280:0@lo:104: 00000100:00100000:3.0:1788263184.625738:0:10304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875129709681408:0@lo:104: 00000100:00100000:2.0:1788263184.625909:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263184.625945:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709681536 00000100:00100000:2.0:1788263184.625951:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709681536 00000100:00100000:0.0:1788263184.626064:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709682048 00000100:00100000:0.0:1788263184.626069:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709682048 00010000:00010000:0.0:1788263184.626094:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff3829e8a00/0x4b1103cba666f2ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f2a6 expref: 25 pid: 6486 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263184.626114:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709682560 00000100:00100000:0.0:1788263184.626117:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709682560 00010000:00010000:0.0:1788263184.626128:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f2bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f2b4 expref: 26 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263184.626137:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709681920 00000100:00100000:0.0:1788263184.626140:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709681920 00010000:00010000:0.0:1788263184.626149:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff3bd17fc00/0x4b1103cba666f2d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f2d0 expref: 27 pid: 6486 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263184.626157:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709682432 00000100:00100000:0.0:1788263184.626159:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709682432 00010000:00010000:0.0:1788263184.626168:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff398eed800/0x4b1103cba666f236 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f22f expref: 28 pid: 6486 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263184.626176:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709681664 00000100:00100000:0.0:1788263184.626178:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709681664 00010000:00010000:0.0:1788263184.626187:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff398eec000/0x4b1103cba666f31d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f316 expref: 29 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263184.626196:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709682176 00000100:00100000:0.0:1788263184.626198:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709682176 00010000:00010000:0.0:1788263184.626224:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff3bd17f400/0x4b1103cba666f29f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f298 expref: 30 pid: 8424 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263184.626234:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709681792 00000100:00100000:0.0:1788263184.626243:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709681792 00010000:00010000:0.0:1788263184.626253:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f2fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f2f3 expref: 31 pid: 8424 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263184.626262:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709682304 00000100:00100000:0.0:1788263184.626264:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709682304 00010000:00010000:0.0:1788263184.626272:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff3829e8800/0x4b1103cba666f260 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f259 expref: 32 pid: 6485 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263184.626282:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788263184.626288:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283324380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+32:3619:x1875129709682048:12345-0@lo:103: 00010000:00010000:0.0:1788263184.626300:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263184.626305:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff3829e8a00/0x4b1103cba666f2ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f2a6 expref: 32 pid: 6486 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.626314:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff3829e8a00/0x4b1103cba666f2ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f2a6 expref: 32 pid: 6486 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.626329:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3829e8a00/0x4b1103cba666f2ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f2a6 expref: 32 pid: 6486 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.626343:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263184.626377:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283324380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+31:3619:x1875129709682048:12345-0@lo:103: Request processed in 89us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263184.626384:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788263184.626400:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788263184.626405:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283327800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+30:3619:x1875129709682560:12345-0@lo:103: 00010000:00010000:0.0:1788263184.626412:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263184.626416:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f2bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f2b4 expref: 30 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.626433:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f2bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f2b4 expref: 30 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.626441:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f2bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f2b4 expref: 30 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.626450:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263184.626482:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283327800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+29:3619:x1875129709682560:12345-0@lo:103: Request processed in 77us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263184.626488:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788263184.626502:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788263184.626508:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283327100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+28:3619:x1875129709681920:12345-0@lo:103: 00010000:00010000:0.0:1788263184.626515:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263184.626519:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff3bd17fc00/0x4b1103cba666f2d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f2d0 expref: 28 pid: 6486 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.626527:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff3bd17fc00/0x4b1103cba666f2d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f2d0 expref: 28 pid: 6486 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.626547:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3bd17fc00/0x4b1103cba666f2d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f2d0 expref: 28 pid: 6486 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.626556:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263184.626599:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283327100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+27:3619:x1875129709681920:12345-0@lo:103: Request processed in 70us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263184.626605:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788263184.626617:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788263184.626622:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283325880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+26:3619:x1875129709682432:12345-0@lo:103: 00010000:00010000:0.0:1788263184.626634:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263184.626638:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff398eed800/0x4b1103cba666f236 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f22f expref: 26 pid: 6486 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.626646:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff398eed800/0x4b1103cba666f236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f22f expref: 26 pid: 6486 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.626654:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff398eed800/0x4b1103cba666f236 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f22f expref: 26 pid: 6486 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.626662:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263184.626680:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283325880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+25:3619:x1875129709682432:12345-0@lo:103: Request processed in 59us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263184.626685:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788263184.626697:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788263184.626702:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5473800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3620:x1875129709681664:12345-0@lo:103: 00010000:00010000:0.0:1788263184.626708:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263184.626712:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff398eec000/0x4b1103cba666f31d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f316 expref: 24 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.626719:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff398eec000/0x4b1103cba666f31d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f316 expref: 24 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.626727:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff398eec000/0x4b1103cba666f31d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f316 expref: 24 pid: 6484 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.626734:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263184.626757:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5473800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:3620:x1875129709681664:12345-0@lo:103: Request processed in 54us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263184.626771:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788263184.626781:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788263184.626786:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:3620:x1875129709682176:12345-0@lo:103: 00010000:00010000:0.0:1788263184.626792:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263184.626796:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff3bd17f400/0x4b1103cba666f29f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f298 expref: 22 pid: 8424 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.626804:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff3bd17f400/0x4b1103cba666f29f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f298 expref: 22 pid: 8424 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.626814:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3bd17f400/0x4b1103cba666f29f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f298 expref: 22 pid: 8424 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.626822:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263184.626845:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:3620:x1875129709682176:12345-0@lo:103: Request processed in 58us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263184.626851:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788263184.626863:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788263184.626869:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a9662850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:3620:x1875129709681792:12345-0@lo:103: 00010000:00010000:0.0:1788263184.626876:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263184.626880:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f2fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f2f3 expref: 20 pid: 8424 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.626888:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f2fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f2f3 expref: 20 pid: 8424 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.626897:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f2fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f2f3 expref: 20 pid: 8424 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.626915:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263184.626938:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a9662850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:3620:x1875129709681792:12345-0@lo:103: Request processed in 69us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263184.626943:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788263184.626976:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788263184.626982:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:3620:x1875129709682304:12345-0@lo:103: 00010000:00010000:0.0:1788263184.626988:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263184.626992:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff3829e8800/0x4b1103cba666f260 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f259 expref: 18 pid: 6485 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.627000:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff3829e8800/0x4b1103cba666f260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f259 expref: 18 pid: 6485 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.627010:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3829e8800/0x4b1103cba666f260 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f259 expref: 18 pid: 6485 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.627018:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263184.627039:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:3620:x1875129709682304:12345-0@lo:103: Request processed in 57us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263184.627044:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1788263184.627312:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff3ae765e00/0x4b1103cba666f347 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f340 expref: 16 pid: 6486 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263184.627347:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788263184.627353:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a9662450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:3619:x1875129709681536:12345-0@lo:103: 00010000:00010000:2.0:1788263184.627361:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263184.627365:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff3ae765e00/0x4b1103cba666f347 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f340 expref: 16 pid: 6486 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.627374:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff3ae765e00/0x4b1103cba666f347 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f340 expref: 16 pid: 6486 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.627383:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3ae765e00/0x4b1103cba666f347 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f340 expref: 16 pid: 6486 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.627392:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263184.627420:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a9662450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:3619:x1875129709681536:12345-0@lo:103: Request processed in 67us (2269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263184.627425:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788263184.627623:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709681792:0@lo:103: 00000100:00100000:2.0:1788263184.627634:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709682304:0@lo:103: 00000100:00100000:2.0:1788263184.627641:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709681664:0@lo:103: 00000100:00100000:2.0:1788263184.627648:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709682176:0@lo:103: 00000100:00100000:3.0:1788263184.627738:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709681920:0@lo:103: 00000100:00100000:3.0:1788263184.627746:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709682432:0@lo:103: 00000100:00100000:3.0:1788263184.627752:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709681536:0@lo:103: 00000100:00100000:3.0:1788263184.627759:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709682048:0@lo:103: 00000100:00100000:3.0:1788263184.627766:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709682560:0@lo:103: 00000100:00100000:3.0:1788263184.631528:0:10304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b55bca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875129709680128:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788263184.631874:0:10304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b55bdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10304:1875129709680256:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263184.631927:0:10304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ff3829e8600/0x4b1103cba666f39b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263184.634292:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263184.634331:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263184.634639:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699144320 00000100:00100000:2.0:1788263184.634650:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699144320 00010000:00010000:2.0:1788263184.634687:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff282f5de00/0x4b1103cba666f35c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fc80 expref: 10 pid: 6485 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263184.634726:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699144448 00000100:00100000:2.0:1788263184.634745:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699144448 00010000:00010000:2.0:1788263184.634759:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff3ae764400/0x4b1103cba666f355 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fc79 expref: 11 pid: 6484 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263184.634783:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:2.0:1788263184.634792:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+11:2387:x1875129699144320:12345-192.168.203.26@tcp:103: 00010000:00010000:2.0:1788263184.634806:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263184.634812:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff282f5de00/0x4b1103cba666f35c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fc80 expref: 11 pid: 6485 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263184.634824:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 34 00010000:00010000:2.0:1788263184.634827:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff282f5de00/0x4b1103cba666f35c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fc80 expref: 11 pid: 6485 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263184.634839:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+11:2386:x1875129699144448:12345-192.168.203.26@tcp:103: 00010000:00010000:2.0:1788263184.634848:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff282f5de00/0x4b1103cba666f35c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fc80 expref: 11 pid: 6485 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.634863:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263184.634913:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:2387:x1875129699144320:12345-192.168.203.26@tcp:103: Request processed in 121us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263184.634921:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 33 00010000:00010000:2.0:1788263184.635355:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263184.635363:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff3ae764400/0x4b1103cba666f355 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fc79 expref: 9 pid: 6484 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.635375:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff3ae764400/0x4b1103cba666f355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fc79 expref: 9 pid: 6484 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.635387:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3ae764400/0x4b1103cba666f355 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fc79 expref: 9 pid: 6484 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.635411:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ff3829e8600/0x4b1103cba666f39b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.635419:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3829e8600/0x4b1103cba666f39b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.635433:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff3829e8600/0x4b1103cba666f39b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.635510:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff3829e8600/0x4b1103cba666f39b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.635517:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ff3829e8600/0x4b1103cba666f39b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.635524:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ff3829e8600/0x4b1103cba666f39b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.635647:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e8600 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:2.0:1788263184.635651:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ff3829e8600/0x4b1103cba666f39b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.635659:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ff3829e8600/0x4b1103cba666f39b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.635670:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ff3829e8600/0x4b1103cba666f39b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263184.635680:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263184.635705:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+8:2386:x1875129699144448:12345-192.168.203.26@tcp:103: Request processed in 871us (1373us total) trans 0 rc 0/0 00010000:00010000:3.0:1788263184.635719:0:10304:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ff3829e8600/0x4b1103cba666f39b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263184.635719:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 34 00010000:00010000:3.0:1788263184.635731:0:10304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ff3829e8600/0x4b1103cba666f39b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263184.635739:0:10304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3829e8600/0x4b1103cba666f39b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263184.668246:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263184.668321:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699144576 00000100:00100000:1.0:1788263184.668331:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699144576 00000100:00100000:1.0:1788263184.668385:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 200 00000100:00100000:1.0:1788263184.668395:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+8:6158:x1875129699144576:12345-192.168.203.26@tcp:101: 00010000:00010000:1.0:1788263184.668423:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263184.668440:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3ae765000/0x4b1103cba666f3a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd405f293d116fcf0 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263184.668467:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3ae765000/0x4b1103cba666f3a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcf0 expref: 9 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263184.668477:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3ae765000/0x4b1103cba666f3a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcf0 expref: 9 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263184.668486:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae765000, rc 0) 00000100:00100000:1.0:1788263184.668551:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+9:6158:x1875129699144576:12345-192.168.203.26@tcp:101: Request processed in 157us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263184.668557:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 200 00000100:00100000:1.0:1788263184.678061:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263184.678135:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699144704 00000100:00100000:2.0:1788263184.678145:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699144704 00000100:00100000:2.0:1788263184.678213:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 201 00000100:00100000:2.0:1788263184.678224:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+9:6158:x1875129699144704:12345-192.168.203.26@tcp:501: 00000100:00100000:2.0:1788263184.678369:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+9:6158:x1875129699144704:12345-192.168.203.26@tcp:501: Request processed in 147us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263184.678377:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 201 00000100:00100000:1.0:1788263184.683758:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263184.684569:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699144832 00000100:00100000:2.0:1788263184.685714:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699144832 00000100:00100000:2.0:1788263184.685784:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 202 00000100:00100000:2.0:1788263184.685795:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+9:6158:x1875129699144832:12345-192.168.203.26@tcp:503: 00000100:00100000:2.0:1788263184.685942:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+9:6158:x1875129699144832:12345-192.168.203.26@tcp:503: Request processed in 149us (2193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263184.685950:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 202 00000100:00100000:2.0:1788263184.690148:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263184.690220:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699144960 00000100:00100000:0.0:1788263184.690229:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699144960 00000100:00100000:0.0:1788263184.690284:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 203 00000100:00100000:0.0:1788263184.690293:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+9:6625:x1875129699144960:12345-192.168.203.26@tcp:502: 00000100:00100000:0.0:1788263184.690444:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+9:6625:x1875129699144960:12345-192.168.203.26@tcp:502: Request processed in 151us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263184.690461:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 203 00000100:00100000:3.0:1788263184.693303:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263184.693492:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699145088 00000100:00100000:2.0:1788263184.693500:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699145088 00000100:00100000:2.0:1788263184.693562:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 204 00000100:00100000:2.0:1788263184.693572:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+9:6625:x1875129699145088:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788263184.693720:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+9:6625:x1875129699145088:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 150us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263184.693729:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 204 00000100:00100000:3.0:1788263184.713063:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263184.713137:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699145216 00000100:00100000:0.0:1788263184.713146:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699145216 00000100:00100000:0.0:1788263184.713209:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 205 00000100:00100000:0.0:1788263184.713220:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+9:6158:x1875129699145216:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263184.713236:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263184.713254:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3bd17f400/0x4b1103cba666f3a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd405f293d116fcf7 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.713280:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3bd17f400/0x4b1103cba666f3a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcf7 expref: 10 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.713291:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3bd17f400/0x4b1103cba666f3a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcf7 expref: 10 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263184.713300:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17f400, rc 0) 00000100:00100000:0.0:1788263184.713353:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:6158:x1875129699145216:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 135us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263184.713360:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 205 00000100:00100000:0.0:1788263184.724557:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263184.724737:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699145344 00000100:00100000:3.0:1788263184.724746:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699145344 00000100:00100000:3.0:1788263184.724793:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 206 00000100:00100000:3.0:1788263184.724802:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:6158:x1875129699145344:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263184.725072:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:6158:x1875129699145344:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 269us (523us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788263184.725082:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 206 00010000:00010000:0.0:1788263184.943801:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788263185.524933:0:10357:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe26220e30 20000000:00000080:0.0:1788263185.524950:0:10357:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ff283282400 uarg=0000000000000000 20000000:01000000:0.0:1788263185.524988:0:10357:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788263185.524995:0:10357:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788263185.524999:0:10357:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788263185.529911:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788263185.530574:0:10357:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788263185.537278:0:10357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788263185.537312:0:10357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788263185.537344:0:10357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788263185.537360:0:10357:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788263185.537378:0:10357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ff3ae764600/0x4b1103cba666f3b0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263185.537396:0:10357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff381681a00/0x4b1103cba666f0ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f0c3 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263185.537404:0:10357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff3bd17e200/0x4b1103cba666f0d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f0d1 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263185.537418:0:10357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff381681600/0x4b1103cba666f12c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f125 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263185.537439:0:10357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f252 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f24b expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263185.537448:0:10357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff282f5cc00/0x4b1103cba666f36a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcb8 expref: 9 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263185.537456:0:10357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ff3ae764600/0x4b1103cba666f3b0 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263185.537494:0:10357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff282f5cc00/0x4b1103cba666f36a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcb8 expref: 9 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263185.537510:0:10357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ff282f5cc00/0x4b1103cba666f36a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcb8 expref: 9 pid: 8424 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263185.537524:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1875129709682688:192.168.203.26@tcp:104: 00010000:00010000:1.0:1788263185.537644:0:10357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f252 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f24b expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263185.537654:0:10357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f252 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f24b expref: 14 pid: 6484 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263185.537663:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1875129709682816:0@lo:104: 00000100:00100000:1.0:1788263185.537698:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788263185.537738:0:10357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff381681600/0x4b1103cba666f12c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f125 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263185.537747:0:10357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff381681600/0x4b1103cba666f12c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f125 expref: 14 pid: 6485 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263185.537749:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709682816 00000100:00100000:2.0:1788263185.537758:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709682816 00000100:00100000:1.0:1788263185.537766:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1875129709682944:0@lo:104: 00000100:00100000:1.0:1788263185.537799:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788263185.538513:0:10357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff3bd17e200/0x4b1103cba666f0d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f0d1 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263185.538524:0:10357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff3bd17e200/0x4b1103cba666f0d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f0d1 expref: 14 pid: 6485 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263185.538535:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5403100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1875129709683072:0@lo:104: 00010000:00010000:1.0:1788263185.538564:0:10357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff381681a00/0x4b1103cba666f0ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f0c3 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263185.538572:0:10357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff381681a00/0x4b1103cba666f0ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f0c3 expref: 14 pid: 6485 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263185.539216:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5403480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1875129709683200:0@lo:104: 00000100:00100000:1.0:1788263185.539254:0:10357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384df6000 going to sleep for 11 seconds 00000100:00100000:2.0:1788263185.541758:0:6475:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788263185.541936:0:6475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263185.541965:0:6475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263185.541975:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709682944 00000100:00100000:2.0:1788263185.541982:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709682944 00000100:00100000:2.0:1788263185.542019:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709683072 00000100:00100000:2.0:1788263185.542022:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709683072 00000100:00100000:2.0:1788263185.542030:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709683200 00000100:00100000:2.0:1788263185.542032:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709683200 00000100:00100000:2.0:1788263185.542042:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788263185.542049:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+6:10357:x1875129709682816:12345-0@lo:104: 00010000:00010000:2.0:1788263185.542239:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f24b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f252 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263185.542327:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788263185.542334:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+6:10357:x1875129709682816:12345-0@lo:104: Request processed in 284us (4635us total) trans 0 rc 0/0 00010000:00010000:0.0:1788263185.542439:0:9492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263185.542458:0:9492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f24b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f252 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.542467:0:9492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765800 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:0.0:1788263185.542471:0:9492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f24b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f252 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.542479:0:9492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f24b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f252 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263185.542486:0:9492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f24b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f252 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263185.542491:0:9492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788263185.542502:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788263185.542523:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788263185.542530:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b54bf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+5:10357:x1875129709682944:12345-0@lo:104: 00010000:00010000:0.0:1788263185.542535:0:9492:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f24b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f252 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263185.542540:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f125 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f12c expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.542548:0:9492:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263185.542570:0:9492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f24b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f252 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.542595:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f24b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f252 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.542607:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263185.542609:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263185.542611:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263185.542666:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788263185.542672:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b54bf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+5:10357:x1875129709682944:12345-0@lo:104: Request processed in 144us (4874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263185.542678:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788263185.542706:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1788263185.542709:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788263185.542716:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:10357:x1875129709683072:12345-0@lo:104: 00010000:00010000:0.0:1788263185.542717:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f125 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f12c expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263185.542736:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f0d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f0d8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.542739:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17ea00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:0.0:1788263185.542745:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f125 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f12c expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.542754:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f125 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f12c expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263185.542761:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f125 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f12c expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263185.542766:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788263185.542784:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f125 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f12c expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.542790:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263185.542796:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f125 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f12c expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.542801:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f125 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f12c expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.542810:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263185.542814:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f0d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f0d8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.542819:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17ec00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:0.0:1788263185.542821:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f0d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f0d8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.542837:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f0d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f0d8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263185.542843:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f0d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f0d8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263185.542848:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788263185.542862:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f0d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f0d8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.542868:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263185.542884:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f0d1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f0d8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.542891:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f0d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f0d8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.542899:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263185.542901:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263185.542902:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263185.542915:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709683584:0@lo:103: 00010000:00010000:2.0:1788263185.542940:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788263185.542949:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:10357:x1875129709683072:12345-0@lo:104: Request processed in 235us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.542957:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263185.542961:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788263185.542982:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788263185.542992:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:10357:x1875129709683200:12345-0@lo:104: 00010000:00010000:2.0:1788263185.543000:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff398eede00/0x4b1103cba666f0c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f0ca expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263185.543036:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788263185.543041:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:10357:x1875129709683200:12345-0@lo:104: Request processed in 53us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263185.543046:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788263185.543236:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1875129709682816:0@lo:104: 00000100:00100000:1.0:1788263185.543246:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1875129709682944:0@lo:104: 00000100:00100000:1.0:1788263185.543252:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5403100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1875129709683072:0@lo:104: 00000100:00100000:1.0:1788263185.543259:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5403480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1875129709683200:0@lo:104: 00000100:00100000:0.0:1788263185.543649:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709683584 00000100:00100000:0.0:1788263185.543655:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709683584 00010000:00010000:0.0:1788263185.543679:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff3bd17e200/0x4b1103cba666f0d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f0d1 expref: 15 pid: 6485 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263185.543701:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788263185.543707:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283326a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:3618:x1875129709683584:12345-0@lo:103: 00010000:00010000:0.0:1788263185.543725:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263185.543730:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff3bd17e200/0x4b1103cba666f0d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f0d1 expref: 15 pid: 6485 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.543739:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff3bd17e200/0x4b1103cba666f0d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f0d1 expref: 15 pid: 6485 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.543755:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3bd17e200/0x4b1103cba666f0d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f0d1 expref: 15 pid: 6485 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.543768:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263185.543804:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283326a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:3618:x1875129709683584:12345-0@lo:103: Request processed in 97us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.543811:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1788263185.543828:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263185.543833:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff398eede00/0x4b1103cba666f0c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f0ca expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.543840:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eede00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:0.0:1788263185.543843:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eede00/0x4b1103cba666f0c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f0ca expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.543850:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff398eede00/0x4b1103cba666f0c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f0ca expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263185.543856:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eede00/0x4b1103cba666f0c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f0ca expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263185.543861:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788263185.543878:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff398eede00/0x4b1103cba666f0c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f0ca expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.543889:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263185.543901:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff398eede00/0x4b1103cba666f0c3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f0ca expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.543907:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff398eede00/0x4b1103cba666f0c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f0ca expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.543919:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263185.543921:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263185.543923:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263185.543935:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709683456:0@lo:103: 00000100:00100000:0.0:1788263185.543966:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263185.544499:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788263185.544508:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709683328:0@lo:103: 00000100:00100000:0.0:1788263185.544535:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263185.544736:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709683456 00000100:00100000:2.0:1788263185.544742:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709683456 00000100:00100000:0.0:1788263185.544756:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709683328 00000100:00100000:0.0:1788263185.544762:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709683328 00010000:00010000:2.0:1788263185.544766:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff381681600/0x4b1103cba666f12c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f125 expref: 14 pid: 6485 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.544782:0:9493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f252 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f24b expref: 15 pid: 6484 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263185.544797:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788263185.544804:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788263185.544808:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283325c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:3621:x1875129709683456:12345-0@lo:103: 00000100:00100000:0.0:1788263185.544817:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283326d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:3621:x1875129709683328:12345-0@lo:103: 00010000:00010000:2.0:1788263185.544820:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263185.544827:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff381681600/0x4b1103cba666f12c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f125 expref: 15 pid: 6485 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.544827:0:9493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263185.544835:0:9493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f252 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f24b expref: 15 pid: 6484 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263185.544845:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff381681600/0x4b1103cba666f12c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f125 expref: 15 pid: 6485 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.546709:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263185.551274:0:9493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f252 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f24b expref: 15 pid: 6484 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263185.551327:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff381681600/0x4b1103cba666f12c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f125 expref: 15 pid: 6485 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263185.552306:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788263185.552306:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff398eed400/0x4b1103cba666f252 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f24b expref: 14 pid: 6484 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.552334:0:9493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263185.552537:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283325c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+13:3621:x1875129709683456:12345-0@lo:103: Request processed in 7727us (8564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.552537:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283326d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:15f48257-b19e-4792-92d2-a48eb49d0ad1+13:3621:x1875129709683328:12345-0@lo:103: Request processed in 7716us (7994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263185.552557:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788263185.552642:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709683328:0@lo:103: 00000100:00100000:1.0:1788263185.552653:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709683456:0@lo:103: 00000100:00100000:0.0:1788263185.553611:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788263185.553724:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10357:1875129709682688:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788263185.553754:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00010000:00010000:1.0:1788263185.553760:0:10357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ff3ae764600/0x4b1103cba666f3b0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263185.553806:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709683712:0@lo:103: 00000100:00100000:0.0:1788263185.553846:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263185.553904:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709683584:0@lo:103: 00000100:00100000:0.0:1788263185.553925:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699145472 00000100:00100000:0.0:1788263185.553930:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699145472 00010000:00010000:0.0:1788263185.553957:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff282f5cc00/0x4b1103cba666f36a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcb8 expref: 10 pid: 8424 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263185.554081:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709683712 00000100:00100000:3.0:1788263185.554086:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709683712 00010000:00010000:3.0:1788263185.554106:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff381681a00/0x4b1103cba666f0ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f0c3 expref: 12 pid: 6485 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263185.554125:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 38 00000100:00100000:3.0:1788263185.554133:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a9663850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:2386:x1875129699145472:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263185.554146:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263185.554151:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff282f5cc00/0x4b1103cba666f36a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcb8 expref: 10 pid: 8424 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.554162:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff282f5cc00/0x4b1103cba666f36a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcb8 expref: 10 pid: 8424 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.554177:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff282f5cc00/0x4b1103cba666f36a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcb8 expref: 10 pid: 8424 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.554190:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263185.554250:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a9663850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+9:2386:x1875129699145472:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 117us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.554258:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 38 00000100:00100000:3.0:1788263185.554294:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788263185.554300:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283324000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:3619:x1875129709683712:12345-0@lo:103: 00010000:00010000:3.0:1788263185.554314:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263185.554319:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff381681a00/0x4b1103cba666f0ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f0c3 expref: 12 pid: 6485 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.554340:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff381681a00/0x4b1103cba666f0ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f0c3 expref: 12 pid: 6485 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.554350:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff381681a00/0x4b1103cba666f0ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f0c3 expref: 12 pid: 6485 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.554362:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ff3ae764600/0x4b1103cba666f3b0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.554369:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3ae764600/0x4b1103cba666f3b0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.554384:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff3ae764600/0x4b1103cba666f3b0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.554391:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff3ae764600/0x4b1103cba666f3b0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.554397:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ff3ae764600/0x4b1103cba666f3b0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.554403:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ff3ae764600/0x4b1103cba666f3b0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.554409:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae764600 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263185.554413:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ff3ae764600/0x4b1103cba666f3b0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.554420:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ff3ae764600/0x4b1103cba666f3b0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.554444:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ff3ae764600/0x4b1103cba666f3b0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.554467:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263185.554506:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283324000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f48257-b19e-4792-92d2-a48eb49d0ad1+11:3619:x1875129709683712:12345-0@lo:103: Request processed in 205us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.554513:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788263185.554571:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709683712:0@lo:103: 00010000:00010000:1.0:1788263185.555093:0:10357:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ff3ae764600/0x4b1103cba666f3b0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263185.555104:0:10357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ff3ae764600/0x4b1103cba666f3b0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263185.555111:0:10357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3ae764600/0x4b1103cba666f3b0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263185.722122:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788263185.722130:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ff281faf000 from 48 10000000:01000000:3.0:1788263185.722136:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788263185.722179:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8600/0x4b1103cba666f3b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.722191:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8600/0x4b1103cba666f3b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.722213:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8600/0x4b1103cba666f3b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263185.722237:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709683840:0@lo:101: 00000100:00100000:3.0:1788263185.722317:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.722369:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3b4e0f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.722393:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709683840 00000100:00100000:3.0:1788263185.722400:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709683840 00000100:00100000:3.0:1788263185.722453:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788263185.722461:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+11:6489:x1875129709683840:12345-0@lo:101: 00010000:00010000:3.0:1788263185.722474:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263185.722486:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3829e8400/0x4b1103cba666f3be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f3b7 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.722521:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3829e8400/0x4b1103cba666f3be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f3b7 expref: 12 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.722531:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3829e8400/0x4b1103cba666f3be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f3b7 expref: 12 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.722540:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3829e8400, rc 0) 00000100:00100000:3.0:1788263185.722594:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:6489:x1875129709683840:12345-0@lo:101: Request processed in 116us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.722601:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788263185.722644:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709683840:0@lo:101: 00010000:00010000:3.0:1788263185.722657:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8600/0x4b1103cba666f3b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f3be expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.722665:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8600/0x4b1103cba666f3b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f3be expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263185.722716:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709683968:0@lo:501: 00000100:00100000:3.0:1788263185.722740:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.722759:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3b4e0f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.722772:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709683968 00000100:00100000:3.0:1788263185.722777:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709683968 00000100:00100000:3.0:1788263185.722799:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788263185.722805:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:6489:x1875129709683968:12345-0@lo:501: 00000100:00100000:3.0:1788263185.722903:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:6489:x1875129709683968:12345-0@lo:501: Request processed in 98us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.722909:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788263185.722947:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709683968:0@lo:501: 00000100:00100000:3.0:1788263185.722970:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709684096:0@lo:503: 00000100:00100000:3.0:1788263185.723372:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.723387:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3b4e0f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.723399:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709684096 00000100:00100000:3.0:1788263185.723403:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709684096 00000100:00100000:3.0:1788263185.723480:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788263185.723486:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:6489:x1875129709684096:12345-0@lo:503: 00000100:00100000:3.0:1788263185.723562:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:6489:x1875129709684096:12345-0@lo:503: Request processed in 75us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.723569:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788263185.723630:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709684096:0@lo:503: 00000100:00100000:3.0:1788263185.725526:0:10370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10370:1875129709684224:0@lo:502: 00000100:00100000:3.0:1788263185.725614:0:10370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.725650:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709684224 00000100:00100000:3.0:1788263185.725656:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709684224 00000100:00100000:3.0:1788263185.725694:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788263185.725702:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:10370:x1875129709684224:12345-0@lo:502: 00000100:00100000:3.0:1788263185.725816:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:10370:x1875129709684224:12345-0@lo:502: Request processed in 114us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.725823:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788263185.725871:0:10370:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3c05bc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.725890:0:10370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10370:1875129709684224:0@lo:502: 00000100:00100000:3.0:1788263185.725930:0:10370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10370:1875129709684352:0@lo:502: 00000100:00100000:3.0:1788263185.725963:0:10370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.726108:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709684352 00000100:00100000:3.0:1788263185.726112:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709684352 00000100:00100000:3.0:1788263185.726135:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788263185.726141:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:10370:x1875129709684352:12345-0@lo:502: 00000100:00100000:3.0:1788263185.726208:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:10370:x1875129709684352:12345-0@lo:502: Request processed in 67us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.726215:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788263185.726244:0:10370:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3c05bc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.726255:0:10370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10370:1875129709684352:0@lo:502: 00000040:00080000:3.0:1788263185.726272:0:10370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788263185.727548:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788263185.727572:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788263185.727594:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8600/0x4b1103cba666f3b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f3be expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.727606:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8600/0x4b1103cba666f3b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f3be expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263185.727616:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788263185.727618:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788263185.727621:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788263185.727653:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9000/0x4b1103cba666f3c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.727660:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9000/0x4b1103cba666f3c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.727671:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9000/0x4b1103cba666f3c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263185.727701:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709684480:0@lo:101: 00000100:00100000:3.0:1788263185.727749:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.727780:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3c05bc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.727799:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709684480 00000100:00100000:3.0:1788263185.727804:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709684480 00000100:00100000:3.0:1788263185.727838:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788263185.727846:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+12:6489:x1875129709684480:12345-0@lo:101: 00010000:00010000:3.0:1788263185.727856:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263185.727868:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3829e9800/0x4b1103cba666f3cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f3c5 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.727889:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3829e9800/0x4b1103cba666f3cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f3c5 expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.727899:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3829e9800/0x4b1103cba666f3cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f3c5 expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.727908:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3829e9800, rc 0) 00000100:00100000:3.0:1788263185.727942:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+13:6489:x1875129709684480:12345-0@lo:101: Request processed in 96us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.727948:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788263185.730100:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709684480:0@lo:101: 00010000:00010000:3.0:1788263185.730124:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9000/0x4b1103cba666f3c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f3cc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.730135:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9000/0x4b1103cba666f3c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f3cc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263185.730230:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709684608:0@lo:501: 00000100:00100000:3.0:1788263185.730277:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.731122:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3c05bc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.731143:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709684608 00000100:00100000:3.0:1788263185.731149:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709684608 00000100:00100000:3.0:1788263185.731188:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788263185.731206:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+13:6489:x1875129709684608:12345-0@lo:501: 00000100:00100000:0.0:1788263185.731498:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709684608:0@lo:501: 00000100:00100000:3.0:1788263185.731870:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+13:6489:x1875129709684608:12345-0@lo:501: Request processed in 213us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.731881:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788263185.732213:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283326300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709684736:0@lo:503: 00000100:00100000:0.0:1788263185.732259:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263185.732292:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2822bb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.732384:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709684736 00000100:00100000:3.0:1788263185.732389:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709684736 00000100:00100000:3.0:1788263185.732485:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788263185.732494:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+13:6489:x1875129709684736:12345-0@lo:503: 00000100:00100000:3.0:1788263185.732611:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+13:6489:x1875129709684736:12345-0@lo:503: Request processed in 118us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.732618:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788263185.732659:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283326300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709684736:0@lo:503: 00000100:00100000:3.0:1788263185.732815:0:10371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10371:1875129709684864:0@lo:502: 00000100:00100000:3.0:1788263185.732848:0:10371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.732867:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709684864 00000100:00100000:3.0:1788263185.732871:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709684864 00000100:00100000:3.0:1788263185.732892:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788263185.732898:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+13:10371:x1875129709684864:12345-0@lo:502: 00000100:00100000:3.0:1788263185.732963:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+13:10371:x1875129709684864:12345-0@lo:502: Request processed in 65us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.732988:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788263185.733631:0:10371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3b4e0f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263185.733651:0:10371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10371:1875129709684864:0@lo:502: 00000020:01000000:2.0:1788263185.733674:0:10371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263185.733682:0:10371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263185.733684:0:10371:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788263185.733690:0:10371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788263185.733716:0:10371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10371:1875129709684992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263185.733755:0:10371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263185.733772:0:10371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2822396c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.734552:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709684992 00000100:00100000:3.0:1788263185.734558:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709684992 00000100:00100000:3.0:1788263185.734602:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788263185.734610:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+13:10371:x1875129709684992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263185.734711:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+13:10371:x1875129709684992:12345-0@lo:502:llog_process_th.0 Request processed in 101us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.734718:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788263185.735161:0:10371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10371:1875129709684992:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788263185.735188:0:10371:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263185.735205:0:10371:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263185.735207:0:10371:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788263185.735211:0:10371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:3.0:1788263185.736101:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788263185.736122:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788263185.736132:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9000/0x4b1103cba666f3c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f3cc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.736144:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9000/0x4b1103cba666f3c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f3cc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263185.736153:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788263185.736156:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff281faf000 from 4 10000000:01000000:3.0:1788263185.736158:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788263185.736189:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9400/0x4b1103cba666f3d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.736209:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9400/0x4b1103cba666f3d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.736218:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9400/0x4b1103cba666f3d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263185.736237:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709685120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.736290:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.736552:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39873b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.736902:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709685120 00000100:00100000:3.0:1788263185.736908:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709685120 00000100:00100000:3.0:1788263185.736945:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788263185.736952:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+13:6489:x1875129709685120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263185.736963:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263185.737379:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3829e8800/0x4b1103cba666f3da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f3d3 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.737403:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3829e8800/0x4b1103cba666f3da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f3d3 expref: 14 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.738087:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3829e8800/0x4b1103cba666f3da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f3d3 expref: 14 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.738098:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3829e8800, rc 0) 00000100:00100000:3.0:1788263185.738159:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:6489:x1875129709685120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1206us (1868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.738167:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788263185.738283:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709685120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263185.738362:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9400/0x4b1103cba666f3d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f3da expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263185.738372:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9400/0x4b1103cba666f3d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f3da expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263185.738512:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709685248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263185.738544:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263185.738569:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2822396c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.738653:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709685248 00000100:00100000:3.0:1788263185.738658:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709685248 00000100:00100000:3.0:1788263185.738696:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788263185.738703:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:6489:x1875129709685248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.738812:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:6489:x1875129709685248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.738819:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788263185.738962:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709685248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263185.739105:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709685376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263185.739143:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263185.739168:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2822396c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.739213:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709685376 00000100:00100000:3.0:1788263185.739223:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709685376 00000100:00100000:3.0:1788263185.739426:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788263185.739434:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:6489:x1875129709685376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.739515:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:6489:x1875129709685376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.739521:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788263185.743918:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709685376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.744876:0:10372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10372:1875129709685504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263185.744948:0:10372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.745122:0:10372:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff282311a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263185.745625:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709685504 00000100:00100000:0.0:1788263185.745633:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709685504 00000100:00100000:0.0:1788263185.745680:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788263185.745690:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:10372:x1875129709685504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263185.745842:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:10372:x1875129709685504:12345-0@lo:502:llog_process_th.0 Request processed in 153us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.745850:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788263185.745927:0:10372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10372:1875129709685504:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788263185.745953:0:10372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788263185.745962:0:10372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263185.745964:0:10372:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788263185.746089:0:10372:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ff281faf000 00000020:00000080:1.0:1788263185.746095:0:10372:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788263185.746213:0:10372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5403480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10372:1875129709685632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263185.746251:0:10372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263185.746280:0:10372:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384df6000 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.747447:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709685632 00000100:00100000:3.0:1788263185.747457:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709685632 00000100:00100000:3.0:1788263185.747504:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788263185.747513:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:10372:x1875129709685632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263185.747772:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:10372:x1875129709685632:12345-0@lo:502:llog_process_th.0 Request processed in 261us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.747781:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788263185.747864:0:10372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5403480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10372:1875129709685632:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788263185.747892:0:10372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263185.747898:0:10372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263185.747900:0:10372:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788263185.747903:0:10372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788263185.748109:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788263185.748128:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788263185.748137:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9400/0x4b1103cba666f3d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f3da expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.748147:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9400/0x4b1103cba666f3d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f3da expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263185.748157:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788263185.748159:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ff3ae569800 from 48 10000000:01000000:3.0:1788263185.748162:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788263185.748186:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8a00/0x4b1103cba666f3e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.748214:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8a00/0x4b1103cba666f3e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.748223:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8a00/0x4b1103cba666f3e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263185.748242:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709685760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.748274:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.748340:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff282311840 going to sleep for 11 seconds 00000100:00100000:1.0:1788263185.751722:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709685760 00000100:00100000:1.0:1788263185.751734:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709685760 00000100:00100000:1.0:1788263185.751816:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788263185.751827:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+14:6489:x1875129709685760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263185.751851:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263185.751867:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3ae764600/0x4b1103cba666f3e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f3e1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263185.751893:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3ae764600/0x4b1103cba666f3e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f3e1 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263185.751903:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3ae764600/0x4b1103cba666f3e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f3e1 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263185.751912:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae764600, rc 0) 00000100:00100000:1.0:1788263185.751986:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:6489:x1875129709685760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (3710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263185.752064:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788263185.756205:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709685760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263185.756234:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8a00/0x4b1103cba666f3e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f3e8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263185.756246:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8a00/0x4b1103cba666f3e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f3e8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263185.756329:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709685888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263185.756389:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263185.756430:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2822396c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263185.756451:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709685888 00000100:00100000:2.0:1788263185.756456:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709685888 00000100:00100000:2.0:1788263185.756495:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788263185.756503:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:6489:x1875129709685888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263185.756703:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:6489:x1875129709685888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 199us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263185.756716:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788263185.756756:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709685888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263185.757012:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709686016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263185.757050:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263185.757066:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2822396c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263185.757079:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709686016 00000100:00100000:2.0:1788263185.757083:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709686016 00000100:00100000:2.0:1788263185.757105:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788263185.757110:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:6489:x1875129709686016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263185.757182:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:6489:x1875129709686016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263185.757189:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788263185.757239:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709686016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263185.757988:0:10374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10374:1875129709686144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263185.758030:0:10374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263185.758055:0:10374:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff282239780 going to sleep for 11 seconds 00000100:00100000:0.0:1788263185.758096:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709686144 00000100:00100000:0.0:1788263185.758101:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709686144 00000100:00100000:0.0:1788263185.758136:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788263185.758145:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:10374:x1875129709686144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263185.758245:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:10374:x1875129709686144:12345-0@lo:502:llog_process_th.0 Request processed in 101us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.758252:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788263185.758327:0:10374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10374:1875129709686144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263185.758365:0:10374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10374:1875129709686272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263185.758402:0:10374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263185.758424:0:10374:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff282239780 going to sleep for 11 seconds 00000100:00100000:0.0:1788263185.758462:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709686272 00000100:00100000:0.0:1788263185.758465:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709686272 00000100:00100000:0.0:1788263185.758493:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788263185.758501:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:10374:x1875129709686272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263185.758687:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:10374:x1875129709686272:12345-0@lo:502:llog_process_th.0 Request processed in 187us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.758693:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788263185.758918:0:10374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10374:1875129709686272:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788263185.758939:0:10374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788263185.759073:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788263185.759092:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788263185.759101:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8a00/0x4b1103cba666f3e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f3e8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.759112:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8a00/0x4b1103cba666f3e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f3e8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263185.759120:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788263185.759123:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788263185.759133:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788263185.759159:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f3ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.759167:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f3ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.759177:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f3ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263185.759203:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283324380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709686400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788263185.759234:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263185.759266:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2822bb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263185.759313:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709686400 00000100:00100000:2.0:1788263185.759324:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709686400 00000100:00100000:2.0:1788263185.759355:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788263185.759363:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0499450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+15:6489:x1875129709686400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263185.759372:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263185.759383:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff282f5c000/0x4b1103cba666f3f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f3ef expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263185.759405:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff282f5c000/0x4b1103cba666f3f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f3ef expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263185.759415:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff282f5c000/0x4b1103cba666f3f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f3ef expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263185.759423:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff282f5c000, rc 0) 00000100:00100000:2.0:1788263185.759465:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0499450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:6489:x1875129709686400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263185.759471:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788263185.759511:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283324380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709686400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263185.759523:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f3ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f3f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.759532:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f3ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f3f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263185.759607:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709686528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.759635:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.759661:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff282311e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788263185.759671:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709686528 00000100:00100000:0.0:1788263185.759675:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709686528 00000100:00100000:0.0:1788263185.759702:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788263185.759708:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:6489:x1875129709686528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263185.759887:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:6489:x1875129709686528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.759894:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788263185.760023:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709686528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.760049:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709686656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.760081:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.760101:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff282311e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788263185.760113:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709686656 00000100:00100000:2.0:1788263185.760117:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709686656 00000100:00100000:2.0:1788263185.760144:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788263185.760150:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:6489:x1875129709686656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263185.760235:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:6489:x1875129709686656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263185.760242:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788263185.760398:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709686656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.762605:0:10375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10375:1875129709686784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263185.762680:0:10375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.762722:0:10375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff282311000 going to sleep for 11 seconds 00000100:00100000:0.0:1788263185.762729:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709686784 00000100:00100000:0.0:1788263185.762735:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709686784 00000100:00100000:0.0:1788263185.762874:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788263185.762885:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:10375:x1875129709686784:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263185.763002:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:10375:x1875129709686784:12345-0@lo:502:llog_process_th.0 Request processed in 119us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.763011:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788263185.763100:0:10375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10375:1875129709686784:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788263185.763125:0:10375:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788263185.763133:0:10375:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263185.763135:0:10375:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788263185.763140:0:10375:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788263185.763161:0:10375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10375:1875129709686912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263185.763192:0:10375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.771138:0:10375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff282311000 going to sleep for 11 seconds 00000100:00100000:2.0:1788263185.777438:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709686912 00000100:00100000:2.0:1788263185.777451:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709686912 00000100:00100000:2.0:1788263185.777849:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788263185.777860:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:10375:x1875129709686912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263185.778022:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:10375:x1875129709686912:12345-0@lo:502:llog_process_th.0 Request processed in 164us (14828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263185.778030:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788263185.778089:0:10375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10375:1875129709686912:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788263185.778121:0:10375:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263185.778127:0:10375:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263185.778130:0:10375:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788263185.778134:0:10375:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1788263185.778414:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788263185.778441:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788263185.778449:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f3ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f3f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.778460:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f3ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f3f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263185.778468:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788263185.778471:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff3ae569800 from 4 10000000:01000000:0.0:1788263185.778474:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788263185.778501:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f3fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.778508:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f3fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.778683:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f3fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263185.778705:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283327800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709687040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788263185.778742:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263185.778775:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae55f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788263185.778790:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709687040 00000100:00100000:0.0:1788263185.778794:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709687040 00000100:00100000:0.0:1788263185.778815:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788263185.778821:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+16:6489:x1875129709687040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263185.778835:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263185.778846:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3bd17f600/0x4b1103cba666f404 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f3fd expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.778875:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3bd17f600/0x4b1103cba666f404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f3fd expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.778886:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3bd17f600/0x4b1103cba666f404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f3fd expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.778895:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17f600, rc 0) 00000100:00100000:0.0:1788263185.778923:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709687040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.778929:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788263185.778951:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283327800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709687040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263185.778961:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f3fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f404 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.778971:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f3fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f404 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263185.779015:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283327800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709687168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263185.779037:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263185.779046:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae55f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788263185.779060:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709687168 00000100:00100000:0.0:1788263185.779063:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709687168 00000100:00100000:0.0:1788263185.779091:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788263185.779097:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709687168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263185.779191:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709687168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.779216:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788263185.779249:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283327800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709687168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263185.779276:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5403480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709687296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263185.779495:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263185.779516:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384df6600 going to sleep for 11 seconds 00000100:00100000:0.0:1788263185.781670:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709687296 00000100:00100000:0.0:1788263185.781681:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709687296 00000100:00100000:0.0:1788263185.781734:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788263185.781744:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709687296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263185.781878:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709687296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (2383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.781886:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788263185.782082:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5403480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709687296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263185.782681:0:10377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5403480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10377:1875129709687424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263185.782732:0:10377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263185.782767:0:10377:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384df6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263185.786319:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709687424 00000100:00100000:0.0:1788263185.786333:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709687424 00000100:00100000:0.0:1788263185.786399:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788263185.786410:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:10377:x1875129709687424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263185.786611:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:10377:x1875129709687424:12345-0@lo:502:llog_process_th.0 Request processed in 203us (3878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.786619:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788263185.786658:0:10377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5403480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10377:1875129709687424:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788263185.786691:0:10377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788263185.786701:0:10377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263185.786708:0:10377:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788263185.786715:0:10377:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ff3ae569800 00000020:00000080:1.0:1788263185.786718:0:10377:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788263185.786809:0:10377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5403480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10377:1875129709687552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263185.786850:0:10377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263185.786874:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709687552 00000100:00100000:1.0:1788263185.786877:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709687552 00000100:00100000:1.0:1788263185.786897:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788263185.786902:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:10377:x1875129709687552:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263185.786959:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:10377:x1875129709687552:12345-0@lo:502:llog_process_th.0 Request processed in 55us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263185.786965:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788263185.787128:0:10377:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384df6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788263185.787141:0:10377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5403480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10377:1875129709687552:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788263185.787157:0:10377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263185.787161:0:10377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263185.787162:0:10377:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788263185.787166:0:10377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788263185.787386:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788263185.787406:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788263185.787416:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f3fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f404 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.787426:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f3fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f404 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263185.787435:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788263185.787437:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ff38769d000 from 48 10000000:01000000:0.0:1788263185.787440:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788263185.787464:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f40b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.787477:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f40b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.787488:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f40b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263185.787503:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283327100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709687680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788263185.787627:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263185.787651:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae55f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.787708:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709687680 00000100:00100000:3.0:1788263185.787714:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709687680 00000100:00100000:3.0:1788263185.787744:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788263185.787750:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+17:6489:x1875129709687680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263185.787758:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263185.787768:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3829e9200/0x4b1103cba666f412 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f40b expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.787786:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3829e9200/0x4b1103cba666f412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f40b expref: 18 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.787796:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3829e9200/0x4b1103cba666f412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f40b expref: 18 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.787804:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3829e9200, rc 0) 00000100:00100000:3.0:1788263185.787840:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:6489:x1875129709687680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.787846:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788263185.787912:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283327100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709687680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263185.787923:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f40b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f412 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263185.787932:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f40b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f412 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263185.787983:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5403480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709687808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263185.788014:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263185.788049:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384e23180 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.788151:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709687808 00000100:00100000:3.0:1788263185.788155:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709687808 00000100:00100000:3.0:1788263185.788185:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788263185.788191:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:6489:x1875129709687808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.788310:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:6489:x1875129709687808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.788317:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788263185.788342:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5403480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709687808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.788365:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709687936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.788399:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.788423:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2823116c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.788434:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709687936 00000100:00100000:3.0:1788263185.788437:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709687936 00000100:00100000:3.0:1788263185.788459:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788263185.788465:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:6489:x1875129709687936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.788540:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:6489:x1875129709687936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.788547:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788263185.788603:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709687936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263185.789641:0:10378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5403100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10378:1875129709688064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263185.789686:0:10378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263185.789718:0:10378:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384e23840 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.789865:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709688064 00000100:00100000:3.0:1788263185.789871:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709688064 00000100:00100000:3.0:1788263185.789895:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788263185.789902:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:10378:x1875129709688064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263185.790002:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:10378:x1875129709688064:12345-0@lo:502:llog_process_th.0 Request processed in 99us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.790017:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788263185.790153:0:10378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5403100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10378:1875129709688064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263185.790189:0:10378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5403100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10378:1875129709688192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263185.790228:0:10378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263185.790247:0:10378:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384e23840 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.790375:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709688192 00000100:00100000:3.0:1788263185.790379:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709688192 00000100:00100000:3.0:1788263185.790407:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788263185.791126:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:10378:x1875129709688192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263185.791234:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:10378:x1875129709688192:12345-0@lo:502:llog_process_th.0 Request processed in 114us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.791241:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788263185.791435:0:10378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5403100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10378:1875129709688192:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788263185.791461:0:10378:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788263185.791862:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788263185.791882:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788263185.791891:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f40b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f412 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.791902:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f40b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f412 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263185.791910:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788263185.791913:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1788263185.791916:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788263185.791941:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f419 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.791949:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f419 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.791957:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f419 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263185.791985:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709688320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.792094:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.792128:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff282311480 going to sleep for 11 seconds 00000100:00100000:0.0:1788263185.793910:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709688320 00000100:00100000:0.0:1788263185.793920:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709688320 00000100:00100000:0.0:1788263185.793974:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788263185.793983:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+18:6489:x1875129709688320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263185.793996:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263185.794012:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3bd17fc00/0x4b1103cba666f420 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f419 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.794036:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3bd17fc00/0x4b1103cba666f420 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f419 expref: 19 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.794045:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3bd17fc00/0x4b1103cba666f420 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f419 expref: 19 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.794054:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17fc00, rc 0) 00000100:00100000:0.0:1788263185.794110:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:6489:x1875129709688320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (2016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.794117:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788263185.796323:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709688320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263185.796347:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f419 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f420 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.796359:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f419 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f420 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263185.796447:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709688448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.796499:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.796537:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff282311480 going to sleep for 11 seconds 00000100:00100000:1.0:1788263185.796837:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709688448 00000100:00100000:1.0:1788263185.796842:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709688448 00000100:00100000:1.0:1788263185.796875:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788263185.796883:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:6489:x1875129709688448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263185.797154:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:6489:x1875129709688448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 270us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263185.797161:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788263185.797257:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709688448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.797285:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709688576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.797333:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.797359:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff282311480 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.797372:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709688576 00000100:00100000:3.0:1788263185.797375:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709688576 00000100:00100000:3.0:1788263185.797401:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788263185.797407:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:6489:x1875129709688576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.797632:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:6489:x1875129709688576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 224us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.797639:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788263185.797677:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709688576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263185.798839:0:10380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5401f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10380:1875129709688704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263185.798890:0:10380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263185.798965:0:10380:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384df6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.799170:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709688704 00000100:00100000:3.0:1788263185.799180:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709688704 00000100:00100000:3.0:1788263185.799260:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788263185.799268:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:10380:x1875129709688704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263185.799377:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:10380:x1875129709688704:12345-0@lo:502:llog_process_th.0 Request processed in 108us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.799385:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788263185.799619:0:10380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5401f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10380:1875129709688704:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788263185.799645:0:10380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788263185.799653:0:10380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263185.799656:0:10380:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788263185.799662:0:10380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788263185.799682:0:10380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5401f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10380:1875129709688832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263185.799717:0:10380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263185.799741:0:10380:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384df6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.799785:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709688832 00000100:00100000:3.0:1788263185.799790:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709688832 00000100:00100000:3.0:1788263185.799846:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788263185.799852:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:10380:x1875129709688832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263185.799917:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:10380:x1875129709688832:12345-0@lo:502:llog_process_th.0 Request processed in 65us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.799923:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788263185.800421:0:10380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5401f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10380:1875129709688832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788263185.800444:0:10380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263185.800449:0:10380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263185.800451:0:10380:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788263185.800454:0:10380:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1788263185.800693:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1788263185.800712:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788263185.800721:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f419 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f420 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263185.800732:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f419 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f420 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263185.800741:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788263185.800743:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff38769d000 from 4 10000000:01000000:1.0:1788263185.800746:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788263185.800769:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764e00/0x4b1103cba666f427 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263185.800778:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764e00/0x4b1103cba666f427 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263185.800786:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764e00/0x4b1103cba666f427 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263185.800801:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5401f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709688960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788263185.800834:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263185.800865:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384df6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263185.800872:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709688960 00000100:00100000:0.0:1788263185.800877:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709688960 00000100:00100000:0.0:1788263185.800906:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788263185.800913:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:6489:x1875129709688960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263185.800922:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263185.800933:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3bd17e000/0x4b1103cba666f42e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f427 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.800953:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3bd17e000/0x4b1103cba666f42e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f427 expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.800963:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3bd17e000/0x4b1103cba666f42e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f427 expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.800972:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17e000, rc 0) 00000100:00100000:0.0:1788263185.801007:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:6489:x1875129709688960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.801013:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788263185.801268:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5401f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709688960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263185.801286:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764e00/0x4b1103cba666f427 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f42e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263185.801295:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764e00/0x4b1103cba666f427 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f42e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263185.801398:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5401f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709689088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263185.801485:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263185.801539:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384df6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263185.804129:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709689088 00000100:00100000:0.0:1788263185.804142:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709689088 00000100:00100000:0.0:1788263185.804189:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788263185.804207:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:6489:x1875129709689088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263185.805134:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:6489:x1875129709689088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 933us (3644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.805145:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788263185.808160:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5401f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709689088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.808235:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709689216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.808524:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.808558:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff282311a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.808597:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709689216 00000100:00100000:3.0:1788263185.808603:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709689216 00000100:00100000:3.0:1788263185.808652:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788263185.808660:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:6489:x1875129709689216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.808754:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:6489:x1875129709689216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.808761:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788263185.808800:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709689216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263185.813965:0:10381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10381:1875129709689344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263185.814052:0:10381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263185.814090:0:10381:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae55f480 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.814202:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709689344 00000100:00100000:3.0:1788263185.814209:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709689344 00000100:00100000:3.0:1788263185.814248:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788263185.814257:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:10381:x1875129709689344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263185.814369:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:10381:x1875129709689344:12345-0@lo:502:llog_process_th.0 Request processed in 112us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.814376:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788263185.814629:0:10381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10381:1875129709689344:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788263185.814656:0:10381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263185.814667:0:10381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263185.814669:0:10381:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788263185.814677:0:10381:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ff38769d000 00000020:00000080:0.0:1788263185.814679:0:10381:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788263185.814735:0:10381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10381:1875129709689472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263185.814765:0:10381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263185.814785:0:10381:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae55f480 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.814849:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709689472 00000100:00100000:3.0:1788263185.814853:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709689472 00000100:00100000:3.0:1788263185.814876:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788263185.814881:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:10381:x1875129709689472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263185.814938:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:10381:x1875129709689472:12345-0@lo:502:llog_process_th.0 Request processed in 55us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.814944:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788263185.815083:0:10381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10381:1875129709689472:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788263185.815099:0:10381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263185.815103:0:10381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263185.815105:0:10381:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788263185.815108:0:10381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788263185.815308:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788263185.815332:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788263185.815341:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764e00/0x4b1103cba666f427 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f42e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.815352:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764e00/0x4b1103cba666f427 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f42e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263185.815361:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788263185.815364:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ff3888e6000 from 48 10000000:01000000:3.0:1788263185.815366:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788263185.815389:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eed400/0x4b1103cba666f435 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.815407:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff398eed400/0x4b1103cba666f435 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.815424:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff398eed400/0x4b1103cba666f435 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263185.815439:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709689600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.815465:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.815485:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3c05bc900 going to sleep for 11 seconds 00000100:00100000:0.0:1788263185.815732:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709689600 00000100:00100000:0.0:1788263185.815737:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709689600 00000100:00100000:0.0:1788263185.815762:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788263185.815769:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:6489:x1875129709689600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263185.815777:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263185.815788:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3bd17fe00/0x4b1103cba666f43c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f435 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.815808:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3bd17fe00/0x4b1103cba666f43c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f435 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.815817:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3bd17fe00/0x4b1103cba666f43c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f435 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.815825:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17fe00, rc 0) 00000100:00100000:0.0:1788263185.815857:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709689600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.815863:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788263185.815933:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709689600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263185.815945:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff398eed400/0x4b1103cba666f435 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f43c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.815954:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff398eed400/0x4b1103cba666f435 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f43c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263185.816063:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709689728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.816088:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.816422:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3c05bc900 going to sleep for 11 seconds 00000100:00100000:0.0:1788263185.819317:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709689728 00000100:00100000:0.0:1788263185.819339:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709689728 00000100:00100000:0.0:1788263185.819394:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788263185.819404:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709689728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263185.819601:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709689728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (3490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.819610:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788263185.819664:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709689728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263185.819714:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709689856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263185.819762:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263185.819789:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae55f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788263185.819803:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709689856 00000100:00100000:0.0:1788263185.819806:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709689856 00000100:00100000:0.0:1788263185.819831:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788263185.819838:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a2692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709689856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263185.819914:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a2692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709689856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.819920:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788263185.819963:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709689856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263185.824645:0:10383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5400700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10383:1875129709689984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263185.824724:0:10383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263185.824801:0:10383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384df6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788263185.826389:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709689984 00000100:00100000:0.0:1788263185.826399:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709689984 00000100:00100000:1.0:1788263185.826672:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788263185.826682:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a2692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:10383:x1875129709689984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263185.826846:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a2692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:10383:x1875129709689984:12345-0@lo:502:llog_process_th.0 Request processed in 164us (2122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263185.826854:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788263185.826955:0:10383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5400700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10383:1875129709689984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263185.827023:0:10383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833be680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10383:1875129709690112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263185.827064:0:10383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.828006:0:10383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3c05bc900 going to sleep for 11 seconds 00000100:00100000:0.0:1788263185.828081:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709690112 00000100:00100000:0.0:1788263185.828087:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709690112 00000100:00100000:0.0:1788263185.828131:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788263185.828138:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:10383:x1875129709690112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263185.828235:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:10383:x1875129709690112:12345-0@lo:502:llog_process_th.0 Request processed in 96us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.828241:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788263185.828403:0:10383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833be680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10383:1875129709690112:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788263185.828433:0:10383:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788263185.828804:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788263185.828823:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788263185.828831:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eed400/0x4b1103cba666f435 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f43c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.828841:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff398eed400/0x4b1103cba666f435 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f43c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263185.828850:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788263185.828852:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1788263185.828855:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788263185.828882:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f443 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.828889:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f443 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.828897:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f443 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263185.828914:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709690240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788263185.828948:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263185.828966:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae55f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.829025:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709690240 00000100:00100000:3.0:1788263185.829522:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709690240 00000100:00100000:3.0:1788263185.829565:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788263185.829573:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709690240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263185.829603:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263185.829618:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff398eede00/0x4b1103cba666f44a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f443 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.829639:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff398eede00/0x4b1103cba666f44a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f443 expref: 22 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.829648:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff398eede00/0x4b1103cba666f44a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f443 expref: 22 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.829657:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eede00, rc 0) 00000100:00100000:3.0:1788263185.829694:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:6489:x1875129709690240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.829700:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788263185.829782:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709690240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263185.829805:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f443 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f44a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.829814:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f443 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f44a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263185.829860:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709690368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263185.829884:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263185.829904:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae55f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.829939:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709690368 00000100:00100000:3.0:1788263185.829942:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709690368 00000100:00100000:3.0:1788263185.829967:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788263185.829973:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:6489:x1875129709690368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.830065:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:6489:x1875129709690368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.830072:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788263185.830123:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709690368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263185.830145:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709690496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263185.830176:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263185.830187:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae55f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788263185.830207:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709690496 00000100:00100000:0.0:1788263185.830211:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709690496 00000100:00100000:0.0:1788263185.830233:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788263185.830239:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:6489:x1875129709690496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263185.830403:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:6489:x1875129709690496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.830416:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788263185.830449:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709690496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263185.830748:0:10385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10385:1875129709690624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263185.830780:0:10385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263185.831027:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709690624 00000100:00100000:0.0:1788263185.831032:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709690624 00000100:00100000:0.0:1788263185.831062:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788263185.831069:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:10385:x1875129709690624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263185.831153:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:10385:x1875129709690624:12345-0@lo:502:llog_process_th.0 Request processed in 84us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.831160:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788263185.831191:0:10385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae55f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788263185.831215:0:10385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10385:1875129709690624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788263185.831237:0:10385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263185.831245:0:10385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263185.831248:0:10385:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788263185.831254:0:10385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788263185.831273:0:10385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10385:1875129709690752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263185.831571:0:10385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263185.831612:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709690752 00000100:00100000:0.0:1788263185.831615:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709690752 00000100:00100000:0.0:1788263185.831636:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788263185.831641:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:10385:x1875129709690752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263185.831701:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:10385:x1875129709690752:12345-0@lo:502:llog_process_th.0 Request processed in 59us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.831708:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788263185.831736:0:10385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3861bbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263185.831747:0:10385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10385:1875129709690752:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788263185.831766:0:10385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263185.831771:0:10385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263185.831772:0:10385:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788263185.831776:0:10385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788263185.831819:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1788263185.831842:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788263185.831850:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f443 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f44a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.831859:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f443 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f44a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263185.831867:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788263185.831870:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff3888e6000 from 4 10000000:01000000:0.0:1788263185.831872:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788263185.831890:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f451 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.831897:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f451 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.831905:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f451 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263185.831917:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709690880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788263185.831940:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263185.831952:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3861bbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263185.831961:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709690880 00000100:00100000:0.0:1788263185.831964:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709690880 00000100:00100000:0.0:1788263185.831980:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788263185.831985:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:6489:x1875129709690880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263185.831991:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263185.832000:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3bd17f800/0x4b1103cba666f458 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f451 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.832026:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3bd17f800/0x4b1103cba666f458 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f451 expref: 23 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.832034:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3bd17f800/0x4b1103cba666f458 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f451 expref: 23 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.832043:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17f800, rc 0) 00000100:00100000:0.0:1788263185.832070:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:6489:x1875129709690880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.832075:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788263185.832102:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709690880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263185.832113:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f451 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f458 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263185.832120:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f451 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f458 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263185.832154:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709691008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263185.832175:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263185.832186:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3861bbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.832539:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709691008 00000100:00100000:3.0:1788263185.832545:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709691008 00000100:00100000:3.0:1788263185.832573:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788263185.832594:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:6489:x1875129709691008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.832690:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:6489:x1875129709691008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.832696:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788263185.832729:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709691008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.832755:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709691136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.832788:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.832802:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28222bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788263185.832812:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709691136 00000100:00100000:3.0:1788263185.832815:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709691136 00000100:00100000:3.0:1788263185.832834:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788263185.832838:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:6489:x1875129709691136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.832901:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:6489:x1875129709691136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.832907:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788263185.832940:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709691136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263185.834141:0:10386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5403b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10386:1875129709691264:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263185.834206:0:10386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263185.834240:0:10386:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2831a6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788263185.840068:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709691264 00000100:00100000:2.0:1788263185.840083:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709691264 00000100:00100000:2.0:1788263185.840139:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788263185.840149:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:10386:x1875129709691264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263185.840301:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:10386:x1875129709691264:12345-0@lo:502:llog_process_th.0 Request processed in 153us (6106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263185.840309:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788263185.841509:0:10386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5403b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10386:1875129709691264:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788263185.841545:0:10386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788263185.841554:0:10386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263185.841556:0:10386:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788263185.841564:0:10386:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ff3888e6000 00000020:00000080:1.0:1788263185.841566:0:10386:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788263185.841678:0:10386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5403b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10386:1875129709691392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263185.841728:0:10386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263185.841765:0:10386:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2831a6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788263185.841857:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709691392 00000100:00100000:2.0:1788263185.841863:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709691392 00000100:00100000:2.0:1788263185.841897:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788263185.841904:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:10386:x1875129709691392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263185.841981:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:10386:x1875129709691392:12345-0@lo:502:llog_process_th.0 Request processed in 77us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263185.841988:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788263185.842061:0:10386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5403b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:10386:1875129709691392:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788263185.842080:0:10386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263185.842084:0:10386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263185.842086:0:10386:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788263185.842089:0:10386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788263185.842241:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788263185.842266:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788263185.842275:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f451 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f458 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263185.842284:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f451 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f458 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263185.842293:0:6489:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788263185.842295:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ff3b0028000 from 1 10000000:01000000:2.0:1788263185.842307:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788263185.842480:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d600/0x4b1103cba666f45f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263185.842489:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d600/0x4b1103cba666f45f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263185.842499:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d600/0x4b1103cba666f45f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263185.842513:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709691520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788263185.842541:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263185.842562:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff282239600 going to sleep for 11 seconds 00000100:00100000:2.0:1788263185.842574:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709691520 00000100:00100000:2.0:1788263185.842608:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709691520 00000100:00100000:2.0:1788263185.842635:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788263185.842642:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:6489:x1875129709691520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263185.842649:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263185.842660:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff282f5c600/0x4b1103cba666f466 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f45f expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263185.842690:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff282f5c600/0x4b1103cba666f466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f45f expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263185.842700:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff282f5c600/0x4b1103cba666f466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f45f expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263185.842709:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff282f5c600, rc 0) 00000100:00100000:2.0:1788263185.842737:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:6489:x1875129709691520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263185.842743:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788263185.842781:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709691520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263185.842791:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d600/0x4b1103cba666f45f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f466 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263185.842799:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d600/0x4b1103cba666f45f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f466 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263185.842840:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709691648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263185.842862:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263185.842875:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff282239600 going to sleep for 11 seconds 00000100:00100000:2.0:1788263185.842886:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709691648 00000100:00100000:2.0:1788263185.842889:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709691648 00000100:00100000:2.0:1788263185.842909:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788263185.842915:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:6489:x1875129709691648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263185.842966:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:6489:x1875129709691648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 51us (102us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788263185.842981:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788263185.843009:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709691648:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788263185.843026:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788263185.843031:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d600/0x4b1103cba666f45f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f466 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263185.843039:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d600/0x4b1103cba666f45f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f466 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263185.877245:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263185.877352:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699145600 00000100:00100000:3.0:1788263185.877363:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699145600 00000100:00100000:3.0:1788263185.877416:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 269 00000100:00100000:3.0:1788263185.877426:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+9:6158:x1875129699145600:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263185.877441:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263185.877467:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f46d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd405f293d116fcfe expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.877493:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f46d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcfe expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.877521:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f46d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcfe expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263185.877531:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eece00, rc 0) 00000100:00100000:3.0:1788263185.877625:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:6158:x1875129699145600:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 200us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.877631:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 269 00000100:00100000:0.0:1788263185.883144:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263185.883246:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699145728 00000100:00100000:2.0:1788263185.883255:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699145728 00000100:00100000:2.0:1788263185.883311:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 270 00000100:00100000:2.0:1788263185.883320:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:6158:x1875129699145728:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263185.883470:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:6158:x1875129699145728:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 150us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263185.883477:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 270 00000100:00100000:1.0:1788263185.889060:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263185.889138:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699145856 00000100:00100000:3.0:1788263185.889147:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699145856 00000100:00100000:3.0:1788263185.889212:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 271 00000100:00100000:3.0:1788263185.889222:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:6158:x1875129699145856:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263185.889358:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:6158:x1875129699145856:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 136us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.889367:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 271 00000100:00100000:3.0:1788263185.895812:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263185.895880:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699145984 00000100:00100000:2.0:1788263185.895890:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699145984 00000100:00100000:2.0:1788263185.895946:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 272 00000100:00100000:2.0:1788263185.895956:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:6671:x1875129699145984:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788263185.896102:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:6671:x1875129699145984:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 147us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263185.896110:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 272 00000100:00100000:1.0:1788263185.899891:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263185.901942:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699146112 00000100:00100000:3.0:1788263185.901955:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699146112 00000100:00100000:3.0:1788263185.902010:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 273 00000100:00100000:3.0:1788263185.902020:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:6671:x1875129699146112:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788263185.902233:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:6671:x1875129699146112:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 212us (2348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.902242:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 273 00000100:00100000:1.0:1788263185.968438:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709691776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263185.968510:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.969084:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709691904:0@lo:400:kworker.0 00000100:00100000:3.0:1788263185.969133:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263185.969167:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709691904 00000100:00100000:2.0:1788263185.969174:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709691904 00000100:00100000:3.0:1788263185.969175:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709692416:0@lo:400:kworker.0 00000100:00100000:3.0:1788263185.969217:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263185.969239:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788263185.969245:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709692928:0@lo:400:kworker.0 00000100:00100000:2.0:1788263185.969252:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3621:x1875129709691904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263185.969274:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.969301:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788263185.969308:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875129709692288:0@lo:400:kworker.0 00000100:00100000:3.0:1788263185.969333:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.969350:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709692800:0@lo:400:kworker.0 00000100:00100000:3.0:1788263185.969369:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.969382:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709693312:0@lo:400:kworker.0 00000100:00100000:3.0:1788263185.969401:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.969426:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709691904:0@lo:400:kworker.0 00000100:00100000:2.0:1788263185.969450:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3621:x1875129709691904:12345-0@lo:400:kworker.0 Request processed in 200us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263185.969458:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788263185.969464:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709692416 00000100:00100000:3.0:1788263185.969469:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709692416 00000100:00100000:0.0:1788263185.969554:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709691776 00000100:00100000:0.0:1788263185.969559:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709691776 00000100:00100000:1.0:1788263185.969625:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709692928 00000100:00100000:1.0:1788263185.969629:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709692928 00000100:00100000:2.0:1788263185.969678:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709692288 00000100:00100000:2.0:1788263185.969682:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709692288 00000100:00100000:3.0:1788263185.973153:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788263185.973175:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709692416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263185.973275:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709692416:12345-0@lo:400:kworker.0 Request processed in 109us (4057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.973282:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788263185.973314:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709692800 00000100:00100000:3.0:1788263185.973320:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709692800 00000100:00100000:0.0:1788263185.973557:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788263185.973566:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709691776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263185.974170:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263185.974243:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709691776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 678us (5732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.974250:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788263185.974282:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709692032:0@lo:400:kworker.0 00000100:00100000:0.0:1788263185.974315:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263185.974386:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709693312 00000100:00100000:1.0:1788263185.974390:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709693312 00000100:00100000:1.0:1788263185.974407:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788263185.974413:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709692928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263185.974451:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709692928:12345-0@lo:400:kworker.0 Request processed in 38us (5178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263185.974457:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788263185.974469:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788263185.974475:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709693312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263185.974514:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709693312:12345-0@lo:400:kworker.0 Request processed in 39us (5112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263185.974521:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788263185.974604:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283325880 x1875129709691776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263185.974622:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709691776:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788263185.974665:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263185.974675:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709692160:0@lo:400:kworker.0 00000100:00100000:1.0:1788263185.974702:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263185.974726:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875129709692672:0@lo:400:kworker.0 00000100:00100000:1.0:1788263185.974751:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709692160 00000100:00100000:1.0:1788263185.974755:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709692160 00000100:00100000:1.0:1788263185.974773:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788263185.974791:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709692160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263185.974825:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709692160:12345-0@lo:400:kworker.0 Request processed in 36us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263185.974832:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1788263185.974877:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788263185.974881:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788263185.974904:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833da300 x1875129709693312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263185.974914:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709693312:0@lo:400:kworker.0 00010000:00080000:1.0:1788263185.974923:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833d8700 x1875129709692928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263185.974930:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709692928:0@lo:400:kworker.0 00000100:00100000:1.0:1788263185.974940:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709692416:0@lo:400:kworker.0 00000100:00100000:0.0:1788263185.975956:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709692544:0@lo:400:kworker.0 00000100:00100000:0.0:1788263185.975993:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263185.976290:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788263185.976299:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709692800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263185.976349:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709692800:12345-0@lo:400:kworker.0 Request processed in 51us (6979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263185.976356:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788263185.982678:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709692032 00000100:00100000:2.0:1788263185.982694:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709692032 00000100:00100000:2.0:1788263185.982763:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709692544 00000100:00100000:2.0:1788263185.982766:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709692544 00000100:00100000:2.0:1788263185.982788:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788263185.982797:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875129709692288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263185.982864:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875129709692288:12345-0@lo:400:kworker.0 Request processed in 69us (13531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.982864:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875129709693056:0@lo:400:kworker.0 00000100:00100000:2.0:1788263185.982871:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788263185.982886:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788263185.982891:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709692032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263185.982897:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263185.982914:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709692032:12345-0@lo:400:kworker.0 Request processed in 23us (8599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263185.982920:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788263185.982928:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709693056 00000100:00100000:0.0:1788263185.982928:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709692032:0@lo:400:kworker.0 00000100:00100000:2.0:1788263185.982931:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709693056 00000100:00100000:0.0:1788263185.982963:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263185.982980:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709693184:0@lo:400:kworker.0 00000100:00100000:0.0:1788263185.983004:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263185.983027:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709692160:0@lo:400:kworker.0 00000100:00100000:1.0:1788263185.983097:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709692672 00000100:00100000:1.0:1788263185.983113:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709692672 00000100:00100000:1.0:1788263185.983133:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709693184 00000100:00100000:1.0:1788263185.983136:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709693184 00000100:00100000:1.0:1788263185.983148:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788263185.983750:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788263185.983762:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875129709692672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263185.983818:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875129709692672:12345-0@lo:400:kworker.0 Request processed in 60us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.984040:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788263185.984050:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875129709693184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263185.984085:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875129709693184:12345-0@lo:400:kworker.0 Request processed in 37us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263185.984091:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788263185.984333:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788263185.984340:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1788263185.984542:0:6491:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788263185.984551:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788263185.986915:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709692544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263185.987041:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709692544:12345-0@lo:400:kworker.0 Request processed in 3886us (11047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263185.987052:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1788263185.987114:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788263185.987118:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788263185.987150:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833da680 x1875129709692672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263185.987164:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875129709692672:0@lo:400:kworker.0 00010000:00080000:1.0:1788263185.987177:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833db100 x1875129709693184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263185.987185:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709693184:0@lo:400:kworker.0 00000100:00100000:1.0:1788263185.987237:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875129709692288:0@lo:400:kworker.0 00010000:00080000:1.0:1788263185.987250:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833d9f80 x1875129709692800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263185.987257:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709692800:0@lo:400:kworker.0 00000100:00100000:0.0:1788263185.987345:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709692544:0@lo:400:kworker.0 00000100:00100000:3.0:1788263185.987638:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788263185.987841:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875129709693056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263185.987901:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875129709693056:12345-0@lo:400:kworker.0 Request processed in 3343us (5003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263185.987916:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788263185.989290:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875129709693056:0@lo:400:kworker.0 00000100:00100000:0.0:1788263186.036261:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263186.036306:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263186.036347:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263186.036418:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263186.036443:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263186.036474:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699146752 00000100:00100000:0.0:1788263186.036482:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699146752 00000100:00100000:3.0:1788263186.036629:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699146240 00000100:00100000:3.0:1788263186.036634:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699146240 00000100:00100000:3.0:1788263186.036670:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 275 00000100:00100000:3.0:1788263186.036678:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:2387:x1875129699146240:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263186.036737:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:2387:x1875129699146240:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 59us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263186.036743:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 275 00000100:00100000:3.0:1788263186.036778:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699146496 00000100:00100000:3.0:1788263186.036781:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699146496 00000100:00100000:3.0:1788263186.036808:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699146368 00000100:00100000:3.0:1788263186.036811:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699146368 00000100:00100000:3.0:1788263186.036833:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 63 00000100:00100000:3.0:1788263186.036839:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699146496:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263186.036867:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699146496:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 28us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263186.036873:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 63 00000100:00100000:3.0:1788263186.036884:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:3.0:1788263186.036889:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2387:x1875129699146368:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263186.036912:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2387:x1875129699146368:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 23us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263186.036924:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:0.0:1788263186.037107:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699146624 00000100:00100000:0.0:1788263186.037111:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699146624 00000100:00080000:1.0:1788263186.037170:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788263186.037175:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788263186.037177:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788263186.037179:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788263186.038121:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:2.0:1788263186.038189:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699146752:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263186.038251:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699146752:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 121us (1902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263186.038258:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:2.0:1788263186.038276:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:2.0:1788263186.038282:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699146624:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263186.038303:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699146624:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 22us (1860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263186.038309:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:1.0:1788263186.482692:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709693440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788263186.482767:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263186.482886:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709693440 00000100:00100000:2.0:1788263186.482894:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709693440 00000100:00100000:2.0:1788263186.483411:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788263186.483422:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709693440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788263186.483562:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263186.483640:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709693440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 219us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263186.483648:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788263186.483736:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833d8a80 x1875129709693440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263202 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263186.483755:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709693440:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788263187.004236:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263187.004326:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b55bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709693568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788263187.004389:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263187.004438:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263187.004444:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b55bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709693696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263187.004469:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263187.004501:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709693568 00000100:00100000:0.0:1788263187.004508:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709693568 00000100:00100000:0.0:1788263187.004545:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709693696 00000100:00100000:0.0:1788263187.004548:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709693696 00000100:00100000:0.0:1788263187.004563:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788263187.004571:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709693568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788263187.004609:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263187.004649:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709693568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263187.004656:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788263187.004673:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788263187.004679:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709693696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788263187.004688:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263187.004711:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709693696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 33us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263187.004716:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788263187.004744:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788263187.005214:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b55bca80 x1875129709693696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263187.005233:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b55bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709693696:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788263187.005244:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b55bdf80 x1875129709693568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263187.005254:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b55bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709693568:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788263188.016070:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263189.041887:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263189.553288:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788263189.553308:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709693824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788263189.553371:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263189.553443:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709693824 00000100:00100000:2.0:1788263189.553451:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709693824 00000100:00100000:2.0:1788263189.553494:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788263189.553513:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709693824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788263189.553548:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788263189.553604:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709693824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263189.553611:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788263189.553649:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709693824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788263189.553891:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263189.553900:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709693952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788263189.553928:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263189.553987:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709693952 00000100:00100000:3.0:1788263189.553992:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709693952 00000100:00100000:3.0:1788263189.554019:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788263189.554025:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709693952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788263189.554039:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788263189.554083:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709693952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263189.554089:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788263189.554114:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709693952:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788263190.067741:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263191.088479:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263191.088827:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709694080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788263191.088888:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263191.089019:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709694080 00000100:00100000:3.0:1788263191.089027:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709694080 00000100:00100000:3.0:1788263191.089076:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788263191.089085:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709694080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788263191.089113:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263191.089155:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709694080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263191.089187:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788263191.089206:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788263191.089245:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833bf100 x1875129709694080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263191.089261:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709694080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263191.091988:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b55bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709694336:0@lo:400:kworker.0 00000100:00100000:0.0:1788263191.092047:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263191.092084:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709694848:0@lo:400:kworker.0 00000100:00100000:0.0:1788263191.092106:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263191.092127:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875129709695360:0@lo:400:kworker.0 00000100:00100000:0.0:1788263191.092146:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263191.092181:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788263191.092188:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709694464:0@lo:400:kworker.0 00000100:00100000:0.0:1788263191.092212:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263191.092229:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709694976:0@lo:400:kworker.0 00000100:00100000:0.0:1788263191.092249:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263191.092264:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875129709695488:0@lo:400:kworker.0 00000100:00100000:0.0:1788263191.092284:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263191.092309:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709694336 00000100:00100000:0.0:1788263191.092315:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709694336 00000100:00100000:0.0:1788263191.092347:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709694848 00000100:00100000:0.0:1788263191.092350:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709694848 00000100:00100000:0.0:1788263191.092382:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709695360 00000100:00100000:0.0:1788263191.092385:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709695360 00000100:00100000:0.0:1788263191.092396:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709694976 00000100:00100000:0.0:1788263191.092398:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709694976 00000100:00100000:0.0:1788263191.092408:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709695488 00000100:00100000:0.0:1788263191.092411:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709695488 00000100:00100000:0.0:1788263191.092425:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788263191.092433:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709694336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263191.092477:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709694336:12345-0@lo:400:kworker.0 Request processed in 44us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263191.092484:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788263191.092499:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788263191.092505:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709694848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263191.092531:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709694848:12345-0@lo:400:kworker.0 Request processed in 26us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263191.092537:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788263191.092548:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788263191.092553:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875129709695360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263191.092603:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875129709695360:12345-0@lo:400:kworker.0 Request processed in 24us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263191.092610:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788263191.092622:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788263191.092629:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709694976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263191.092654:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709694976:12345-0@lo:400:kworker.0 Request processed in 27us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263191.092660:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788263191.092670:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788263191.092794:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709694592:0@lo:400:kworker.0 00000100:00100000:1.0:1788263191.092823:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263191.092841:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709695104:0@lo:400:kworker.0 00000100:00100000:1.0:1788263191.092862:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263191.092879:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709695616:0@lo:400:kworker.0 00000100:00100000:1.0:1788263191.092898:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263191.092985:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788263191.092992:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b55bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709694208:0@lo:400:kworker.0 00000100:00100000:1.0:1788263191.093020:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263191.093038:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709694720:0@lo:400:kworker.0 00000100:00100000:1.0:1788263191.093056:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263191.093071:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709695232:0@lo:400:kworker.0 00000100:00100000:1.0:1788263191.093089:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263191.093114:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709695104 00000100:00100000:1.0:1788263191.093119:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709695104 00000100:00100000:1.0:1788263191.093145:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709695616 00000100:00100000:1.0:1788263191.093148:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709695616 00000100:00100000:2.0:1788263191.094453:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709695232 00000100:00100000:2.0:1788263191.094460:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709695232 00000100:00100000:1.0:1788263191.095019:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788263191.095030:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709695104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263191.095104:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709695104:12345-0@lo:400:kworker.0 Request processed in 77us (2240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263191.095120:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788263191.097592:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875129709695488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263191.097669:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875129709695488:12345-0@lo:400:kworker.0 Request processed in 4988us (5385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263191.097678:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788263191.097702:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709694592 00000100:00100000:0.0:1788263191.097708:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709694592 00000100:00100000:0.0:1788263191.097731:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788263191.097737:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709694592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263191.097761:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709694592:12345-0@lo:400:kworker.0 Request processed in 24us (4937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263191.097766:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788263191.097794:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709694464 00000100:00100000:0.0:1788263191.097798:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709694464 00000100:00100000:0.0:1788263191.097812:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709694720 00000100:00100000:0.0:1788263191.097814:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709694720 00000100:00100000:0.0:1788263191.097824:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788263191.097829:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709694464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263191.097855:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709694464:12345-0@lo:400:kworker.0 Request processed in 26us (5644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263191.097861:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788263191.097870:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788263191.097875:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709694720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263191.097895:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709694720:12345-0@lo:400:kworker.0 Request processed in 20us (4838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263191.097900:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1788263191.097928:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788263191.097933:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788263191.097945:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788263191.097947:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263191.097980:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709694464:0@lo:400:kworker.0 00010000:00080000:0.0:1788263191.097995:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28387ed80 x1875129709694976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263191.098005:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709694976:0@lo:400:kworker.0 00010000:00080000:0.0:1788263191.098014:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28387c380 x1875129709695488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263191.098022:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875129709695488:0@lo:400:kworker.0 00000100:00100000:0.0:1788263191.098032:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b55bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709694336:0@lo:400:kworker.0 00000100:00100000:0.0:1788263191.098041:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709694848:0@lo:400:kworker.0 00000100:00100000:0.0:1788263191.098051:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875129709695360:0@lo:400:kworker.0 00000100:00100000:2.0:1788263191.099019:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788263191.099030:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709695616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263191.099080:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709695616:12345-0@lo:400:kworker.0 Request processed in 54us (6181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263191.099086:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788263191.099097:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788263191.099103:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709695232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263191.099124:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709695232:12345-0@lo:400:kworker.0 Request processed in 22us (6035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263191.099129:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788263191.099147:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709694208 00000100:00100000:2.0:1788263191.099152:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709694208 00000100:00100000:2.0:1788263191.099197:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788263191.099204:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3618:x1875129709694208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263191.099231:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3618:x1875129709694208:12345-0@lo:400:kworker.0 Request processed in 29us (6211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263191.099236:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788263191.104491:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b55bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709694208:0@lo:400:kworker.0 00000100:00100000:1.0:1788263191.104513:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709694720:0@lo:400:kworker.0 00010000:00080000:1.0:1788263191.104527:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28387dc00 x1875129709695232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263191.104537:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709695232:0@lo:400:kworker.0 00000100:00100000:1.0:1788263191.104550:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709694592:0@lo:400:kworker.0 00010000:00080000:1.0:1788263191.104561:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28387c000 x1875129709695104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263191.104568:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709695104:0@lo:400:kworker.0 00010000:00080000:1.0:1788263191.104619:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28387f800 x1875129709695616/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263191.104629:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709695616:0@lo:400:kworker.0 00000100:00100000:3.0:1788263191.158673:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263191.158707:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263191.158735:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263191.158754:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263191.158779:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263191.158806:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699147008 00000100:00100000:3.0:1788263191.158816:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699147008 00000100:00100000:3.0:1788263191.158868:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699147136 00000100:00100000:3.0:1788263191.158871:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699147136 00000100:00100000:3.0:1788263191.158892:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 71 00000100:00100000:3.0:1788263191.158901:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2387:x1875129699147008:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263191.159034:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2387:x1875129699147008:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 133us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263191.159042:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 71 00000100:00100000:3.0:1788263191.159057:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 72 00000100:00100000:3.0:1788263191.159064:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699147136:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263191.159087:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699147136:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 24us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263191.159093:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 72 00000100:00100000:3.0:1788263191.159108:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699147264 00000100:00100000:3.0:1788263191.159111:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699147264 00000100:00100000:3.0:1788263191.159132:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699147392 00000100:00100000:3.0:1788263191.159134:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699147392 00000100:00100000:3.0:1788263191.159177:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:3.0:1788263191.159184:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699147264:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263191.159208:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699147264:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 25us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263191.159213:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:3.0:1788263191.159223:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:3.0:1788263191.159229:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699147392:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263191.159250:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699147392:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 21us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263191.159255:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:3.0:1788263191.159273:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699146880 00000100:00100000:3.0:1788263191.159276:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699146880 00000100:00100000:3.0:1788263191.159300:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 277 00000100:00100000:3.0:1788263191.159307:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:2387:x1875129699146880:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263191.159346:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:2387:x1875129699146880:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 39us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263191.159352:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 277 00000100:00080000:3.0:1788263191.159380:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788263191.159384:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788263191.159386:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788263191.159388:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1788263191.367283:0:10667:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1788263191.599916:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709695744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788263191.599987:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263191.609926:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709695744 00000100:00100000:3.0:1788263191.609941:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709695744 00000100:00100000:3.0:1788263191.610003:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788263191.610013:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709695744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788263191.610046:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263191.611173:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709695744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1158us (11183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263191.611185:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788263191.613373:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28387ea00 x1875129709695744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263191.613399:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709695744:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788263192.111768:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263192.112753:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709695872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788263192.112820:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263192.112901:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709695872 00000100:00100000:0.0:1788263192.112908:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709695872 00000100:00100000:0.0:1788263192.112963:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788263192.112972:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709695872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788263192.113011:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263192.113056:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709695872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263192.113070:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1788263192.113105:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28387c380 x1875129709695872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263192.113124:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709695872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788263192.113612:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709696000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788263192.113646:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263192.113679:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709696000 00000100:00100000:2.0:1788263192.113683:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709696000 00000100:00100000:2.0:1788263192.113705:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788263192.113711:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709696000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788263192.113724:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263192.113754:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709696000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263192.113760:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788263192.113783:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833dad80 x1875129709696000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263192.113797:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709696000:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788263193.135752:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263194.162469:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263194.674300:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709696256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788263194.674312:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709696128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788263194.674381:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263194.674429:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709696256 00000100:00100000:0.0:1788263194.674436:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709696256 00000100:00100000:2.0:1788263194.674465:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263194.674491:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709696128 00000100:00100000:0.0:1788263194.674495:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709696128 00000100:00100000:2.0:1788263194.674519:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788263194.674534:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709696256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788263194.674567:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788263194.674626:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709696256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263194.674650:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788263194.674669:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788263194.674675:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709696128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788263194.674691:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788263194.674724:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709696128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 49us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263194.674730:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788263194.674766:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709696256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788263194.674793:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709696128:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788263195.185820:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263196.207698:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263196.209537:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709696384:0@lo:400:kworker.0 00000100:00100000:0.0:1788263196.209616:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263196.209660:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709696896:0@lo:400:kworker.0 00000100:00100000:0.0:1788263196.209759:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263196.209782:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709697408:0@lo:400:kworker.0 00000100:00100000:0.0:1788263196.209811:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263196.209895:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709697920:0@lo:400:kworker.0 00000100:00100000:0.0:1788263196.209919:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263196.209942:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788263196.209947:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709696512:0@lo:400:kworker.0 00000100:00100000:0.0:1788263196.209972:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263196.209990:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709697024:0@lo:400:kworker.0 00000100:00100000:0.0:1788263196.210009:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263196.210022:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875129709697536:0@lo:400:kworker.0 00000100:00100000:0.0:1788263196.210050:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263196.210085:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709696896 00000100:00100000:0.0:1788263196.210092:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709696896 00000100:00100000:0.0:1788263196.210146:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788263196.210156:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709696896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263196.210206:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709696896:12345-0@lo:400:kworker.0 Request processed in 52us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263196.210213:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788263196.210234:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709696512 00000100:00100000:0.0:1788263196.210237:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709696512 00000100:00100000:0.0:1788263196.210257:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709697024 00000100:00100000:0.0:1788263196.210260:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709697024 00000100:00100000:0.0:1788263196.210279:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709697536 00000100:00100000:0.0:1788263196.210281:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709697536 00000100:00100000:0.0:1788263196.210297:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788263196.210303:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709696512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263196.210336:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709696512:12345-0@lo:400:kworker.0 Request processed in 33us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263196.210343:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788263196.210349:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709697408 00000100:00100000:3.0:1788263196.210355:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709697408 00000100:00100000:0.0:1788263196.210358:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788263196.210367:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709697024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263196.210396:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709697920 00000100:00100000:0.0:1788263196.210398:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709697024:12345-0@lo:400:kworker.0 Request processed in 31us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263196.210401:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709697920 00000100:00100000:0.0:1788263196.210408:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788263196.210425:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788263196.210434:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709697408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263196.210483:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709697408:12345-0@lo:400:kworker.0 Request processed in 51us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263196.210490:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788263196.210501:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788263196.210507:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709697920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263196.210533:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709697920:12345-0@lo:400:kworker.0 Request processed in 27us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263196.210539:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788263196.210560:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788263196.210566:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875129709697536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263196.210609:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875129709697536:12345-0@lo:400:kworker.0 Request processed in 44us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263196.210615:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1788263196.210637:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788263196.210641:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788263196.210643:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263196.211991:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709698048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263196.212040:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263196.212135:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709696768:0@lo:400:kworker.0 00000100:00100000:3.0:1788263196.212180:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263196.212210:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709696512:0@lo:400:kworker.0 00000100:00100000:3.0:1788263196.212212:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709697280:0@lo:400:kworker.0 00000100:00100000:0.0:1788263196.212242:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709697024:0@lo:400:kworker.0 00000100:00100000:0.0:1788263196.212267:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875129709697536:0@lo:400:kworker.0 00000100:00100000:0.0:1788263196.212278:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709696896:0@lo:400:kworker.0 00010000:00080000:0.0:1788263196.212289:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2831f0380 x1875129709697408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263196.212299:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709697408:0@lo:400:kworker.0 00010000:00080000:0.0:1788263196.212309:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833e2d80 x1875129709697920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263196.212317:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709697920:0@lo:400:kworker.0 00000100:00100000:3.0:1788263196.212531:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263196.212561:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709697792:0@lo:400:kworker.0 00000100:00100000:3.0:1788263196.212605:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263196.212626:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788263196.212633:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709696640:0@lo:400:kworker.0 00000100:00100000:3.0:1788263196.212656:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263196.212671:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875129709697152:0@lo:400:kworker.0 00000100:00100000:3.0:1788263196.212691:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263196.212708:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709697664:0@lo:400:kworker.0 00000100:00100000:3.0:1788263196.212726:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263196.212763:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709696768 00000100:00100000:3.0:1788263196.212768:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709696768 00000100:00100000:3.0:1788263196.212791:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709697152 00000100:00100000:3.0:1788263196.212793:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709697152 00000100:00100000:3.0:1788263196.212805:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709697664 00000100:00100000:3.0:1788263196.212807:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709697664 00000100:00100000:3.0:1788263196.212815:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788263196.212820:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709696768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263196.212850:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709696768:12345-0@lo:400:kworker.0 Request processed in 31us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263196.212854:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788263196.212863:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788263196.212866:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875129709697152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263196.212879:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875129709697152:12345-0@lo:400:kworker.0 Request processed in 14us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263196.212889:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788263196.213776:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788263196.213797:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875129709697664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263196.213844:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875129709697664:12345-0@lo:400:kworker.0 Request processed in 54us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263196.213850:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788263196.213888:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709697280 00000100:00100000:3.0:1788263196.213892:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709697280 00000100:00100000:3.0:1788263196.213930:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709697792 00000100:00100000:3.0:1788263196.213934:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709697792 00000100:00100000:3.0:1788263196.213952:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788263196.213968:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709697280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263196.214130:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709697280:12345-0@lo:400:kworker.0 Request processed in 163us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263196.214138:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788263196.214151:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788263196.214157:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709697792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263196.214185:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709697792:12345-0@lo:400:kworker.0 Request processed in 29us (1580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263196.214191:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788263196.214212:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788263196.214215:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788263196.214218:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788263196.215604:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2831f1180 x1875129709697152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263196.215621:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875129709697152:0@lo:400:kworker.0 00010000:00080000:3.0:1788263196.215646:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833e2300 x1875129709697664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263196.215656:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709697664:0@lo:400:kworker.0 00000100:00100000:3.0:1788263196.215668:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709696768:0@lo:400:kworker.0 00010000:00080000:3.0:1788263196.215677:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2831f1f80 x1875129709697280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263196.215685:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709697280:0@lo:400:kworker.0 00010000:00080000:3.0:1788263196.215695:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833e0a80 x1875129709697792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263196.215703:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709697792:0@lo:400:kworker.0 00000100:00100000:0.0:1788263196.215868:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709696640 00000100:00100000:0.0:1788263196.215875:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709696640 00000100:00100000:0.0:1788263196.215919:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788263196.215927:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709696640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263196.215999:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709696640:12345-0@lo:400:kworker.0 Request processed in 72us (3341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263196.216006:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788263196.216043:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709696640:0@lo:400:kworker.0 00000100:00100000:2.0:1788263196.216221:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709696384 00000100:00100000:2.0:1788263196.216227:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709696384 00000100:00100000:2.0:1788263196.216258:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788263196.216265:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3620:x1875129709696384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263196.216304:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3620:x1875129709696384:12345-0@lo:400:kworker.0 Request processed in 39us (6688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263196.216310:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788263196.216339:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709698048 00000100:00100000:2.0:1788263196.216343:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709698048 00000100:00100000:2.0:1788263196.216369:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788263196.216377:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709698048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788263196.216398:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263196.216463:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709698048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (4423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263196.216470:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788263196.216510:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833bce00 x1875129709698048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263196.216526:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709698048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263196.216668:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709696384:0@lo:400:kworker.0 00000100:00100000:0.0:1788263196.274888:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263196.274924:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263196.274945:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263196.274961:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263196.274992:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263196.275015:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699147904 00000100:00100000:0.0:1788263196.275030:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699147904 00000100:00100000:0.0:1788263196.275076:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699148032 00000100:00100000:0.0:1788263196.275078:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699148032 00000100:00100000:3.0:1788263196.275190:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699147648 00000100:00100000:3.0:1788263196.275195:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699147648 00000100:00100000:3.0:1788263196.275223:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699147776 00000100:00100000:3.0:1788263196.275226:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699147776 00000100:00100000:3.0:1788263196.275246:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 79 00000100:00100000:3.0:1788263196.275255:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2386:x1875129699147648:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263196.275322:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2386:x1875129699147648:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 67us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263196.275330:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 79 00000100:00100000:3.0:1788263196.275418:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 80 00000100:00100000:3.0:1788263196.275426:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699147776:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263196.275451:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699147776:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 28us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263196.275464:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 80 00000100:00100000:0.0:1788263196.275711:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:0.0:1788263196.275722:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699147904:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263196.275764:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699147904:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 44us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263196.275770:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:0.0:1788263196.275887:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00100000:0.0:1788263196.275892:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699148032:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263196.275909:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699148032:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 18us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263196.275912:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00100000:0.0:1788263196.275925:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699147520 00000100:00100000:0.0:1788263196.275927:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699147520 00000100:00100000:0.0:1788263196.275950:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 279 00000100:00100000:0.0:1788263196.275957:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:2386:x1875129699147520:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263196.275979:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:2386:x1875129699147520:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 24us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263196.275986:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 279 00000100:00080000:0.0:1788263196.276010:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788263196.276014:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788263196.276016:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788263196.276018:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1788263196.582679:0:10910:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing yml_node 00000100:00100000:1.0:1788263196.738677:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788263196.738698:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709698176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788263196.738762:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263196.738824:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709698176 00000100:00100000:1.0:1788263196.738831:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709698176 00000100:00100000:1.0:1788263196.738875:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788263196.738884:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709698176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788263196.738919:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263196.738964:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709698176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263196.738971:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788263196.739013:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833e0000 x1875129709698176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263196.739030:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709698176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788263197.237739:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709698304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788263197.237805:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263197.237877:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709698304 00000100:00100000:3.0:1788263197.237883:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709698304 00000100:00100000:3.0:1788263197.237928:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788263197.237937:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709698304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788263197.237963:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263197.238006:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709698304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263197.238013:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788263197.238052:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833e0000 x1875129709698304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263197.238082:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709698304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788263197.240737:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709698432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788263197.240799:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263197.240858:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709698432 00000100:00100000:3.0:1788263197.240864:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709698432 00000100:00100000:3.0:1788263197.240910:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788263197.240919:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709698432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788263197.240942:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263197.240985:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709698432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263197.240992:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788263197.241042:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833bf480 x1875129709698432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263197.241060:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709698432:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788263197.248521:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263198.258229:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263199.279745:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263199.793488:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263199.793511:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709698560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788263199.793605:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263199.793878:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709698688:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788263199.793915:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263199.794252:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709698560 00000100:00100000:0.0:1788263199.794261:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709698560 00000100:00100000:0.0:1788263199.794322:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709698688 00000100:00100000:0.0:1788263199.794326:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709698688 00000100:00100000:0.0:1788263199.794339:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788263199.794347:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709698560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788263199.794381:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788263199.794435:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709698560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263199.794442:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788263199.794457:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788263199.794464:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709698688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788263199.794478:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788263199.794516:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709698688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263199.794522:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788263199.794653:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709698688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788263199.795924:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709698560:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788263200.305068:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263201.330195:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709698816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263201.332459:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263201.332538:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709698816 00000100:00100000:2.0:1788263201.332547:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709698816 00000100:00100000:2.0:1788263201.332612:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788263201.332623:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709698816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788263201.332651:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263201.332694:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709698816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263201.332701:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788263201.332737:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833bd500 x1875129709698816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263201.332755:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709698816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788263201.337563:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709698944:0@lo:400:kworker.0 00010000:00010000:0.0:1788263201.337626:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788263201.337635:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788263201.337644:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263201.337663:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709699328:0@lo:400:kworker.0 00000100:00100000:3.0:1788263201.337689:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709699456:0@lo:400:kworker.0 00000100:00100000:2.0:1788263201.338209:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709699200:0@lo:400:kworker.0 00000100:00100000:0.0:1788263201.340531:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263201.340536:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263201.340571:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709699968:0@lo:400:kworker.0 00000100:00100000:0.0:1788263201.340571:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709699840:0@lo:400:kworker.0 00000100:00100000:0.0:1788263201.340623:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263201.340636:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709698944 00000100:00100000:3.0:1788263201.340643:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709698944 00000100:00100000:0.0:1788263201.340643:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709700352:0@lo:400:kworker.0 00000100:00100000:0.0:1788263201.340662:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263201.340686:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788263201.340696:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3620:x1875129709698944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263201.340749:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3620:x1875129709698944:12345-0@lo:400:kworker.0 Request processed in 54us (3103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263201.340756:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788263201.340789:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709699456 00000100:00100000:3.0:1788263201.340793:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709699456 00000100:00100000:3.0:1788263201.340817:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788263201.340823:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709699456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263201.340857:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709699456:12345-0@lo:400:kworker.0 Request processed in 34us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263201.340862:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709699328 00000100:00100000:0.0:1788263201.340866:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709699328 00000100:00100000:3.0:1788263201.340873:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788263201.340897:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788263201.340904:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709699328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263201.340955:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709699328:12345-0@lo:400:kworker.0 Request processed in 51us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263201.342518:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263201.342607:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709698944:0@lo:400:kworker.0 00000100:00100000:3.0:1788263201.342641:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709699456:0@lo:400:kworker.0 00000100:00100000:3.0:1788263201.342651:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788263201.342660:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709699072:0@lo:400:kworker.0 00000100:00100000:3.0:1788263201.342698:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263201.342716:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709699584:0@lo:400:kworker.0 00000100:00100000:3.0:1788263201.342737:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263201.342752:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875129709700096:0@lo:400:kworker.0 00000100:00100000:3.0:1788263201.342770:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263201.342794:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709699840 00000100:00100000:3.0:1788263201.342800:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709699840 00000100:00100000:3.0:1788263201.342836:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709700352 00000100:00100000:3.0:1788263201.342839:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709700352 00000100:00100000:3.0:1788263201.342851:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709699968 00000100:00100000:3.0:1788263201.342853:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709699968 00000100:00100000:3.0:1788263201.342866:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788263201.342873:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283324e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709699840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263201.342913:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283324e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709699840:12345-0@lo:400:kworker.0 Request processed in 41us (2289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263201.342919:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788263201.342945:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788263201.342951:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709700352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263201.342977:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709700352:12345-0@lo:400:kworker.0 Request processed in 27us (2314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263201.342989:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788263201.343000:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788263201.343006:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709699968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263201.343035:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709699968:12345-0@lo:400:kworker.0 Request processed in 29us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263201.343041:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788263201.343058:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709699072 00000100:00100000:3.0:1788263201.343061:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709699072 00000100:00100000:3.0:1788263201.343079:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709699584 00000100:00100000:3.0:1788263201.343082:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709699584 00000100:00100000:3.0:1788263201.343106:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709700096 00000100:00100000:3.0:1788263201.343108:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709700096 00000100:00100000:3.0:1788263201.343118:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788263201.343123:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709699072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263201.343148:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709699072:12345-0@lo:400:kworker.0 Request processed in 25us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263201.343154:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788263201.343163:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788263201.343168:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709699584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263201.343186:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709699584:12345-0@lo:400:kworker.0 Request processed in 19us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263201.343191:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788263201.343199:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788263201.343203:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875129709700096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263201.343225:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875129709700096:12345-0@lo:400:kworker.0 Request processed in 21us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263201.343239:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788263201.343261:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788263201.343266:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788263201.343268:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788263201.343292:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709699072:0@lo:400:kworker.0 00000100:00100000:3.0:1788263201.343300:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709699584:0@lo:400:kworker.0 00000100:00100000:3.0:1788263201.343307:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875129709700096:0@lo:400:kworker.0 00010000:00080000:3.0:1788263201.343317:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff387684e00 x1875129709699968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263201.343326:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709699968:0@lo:400:kworker.0 00000100:00100000:2.0:1788263201.343771:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263201.343803:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709699712:0@lo:400:kworker.0 00000100:00100000:2.0:1788263201.343827:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263201.343842:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709700224:0@lo:400:kworker.0 00000100:00100000:2.0:1788263201.343872:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263201.343943:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709699200 00000100:00100000:3.0:1788263201.343948:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709699200 00000100:00100000:3.0:1788263201.343979:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788263201.343987:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709699200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263201.344026:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709699200:12345-0@lo:400:kworker.0 Request processed in 40us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263201.344032:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788263201.344049:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709699712 00000100:00100000:3.0:1788263201.344051:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709699712 00000100:00100000:3.0:1788263201.344072:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709700224 00000100:00100000:3.0:1788263201.344075:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709700224 00000100:00100000:3.0:1788263201.344103:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788263201.344110:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709699712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263201.344143:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709699712:12345-0@lo:400:kworker.0 Request processed in 34us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263201.344158:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788263201.344175:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788263201.344181:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875129709700224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263201.344210:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875129709700224:12345-0@lo:400:kworker.0 Request processed in 30us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263201.344216:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1788263201.344236:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788263201.344409:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709699200:0@lo:400:kworker.0 00010000:00080000:2.0:1788263201.344426:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff387685500 x1875129709699712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263201.344435:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709699712:0@lo:400:kworker.0 00010000:00080000:2.0:1788263201.344445:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff282fdca80 x1875129709700224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263201.344453:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709700224:0@lo:400:kworker.0 00000100:00100000:0.0:1788263201.345368:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788263201.345426:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709699328:0@lo:400:kworker.0 00010000:00080000:0.0:1788263201.345441:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff387685880 x1875129709699840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263201.345451:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709699840:0@lo:400:kworker.0 00010000:00080000:0.0:1788263201.345464:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff282fdd500 x1875129709700352/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263201.345472:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709700352:0@lo:400:kworker.0 00000100:00100000:0.0:1788263201.402989:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263201.403024:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263201.403045:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263201.403064:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263201.403097:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263201.403120:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699148416 00000100:00100000:0.0:1788263201.403128:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699148416 00000100:00100000:0.0:1788263201.403172:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699148288 00000100:00100000:0.0:1788263201.403175:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699148288 00000100:00100000:0.0:1788263201.403193:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 87 00000100:00100000:0.0:1788263201.403201:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699148416:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263201.403264:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699148416:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 63us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263201.403270:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 87 00000100:00100000:0.0:1788263201.403285:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 88 00000100:00100000:0.0:1788263201.403300:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2386:x1875129699148288:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263201.403322:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2386:x1875129699148288:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 23us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263201.403328:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 88 00000100:00100000:0.0:1788263201.403343:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699148544 00000100:00100000:0.0:1788263201.403346:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699148544 00000100:00100000:0.0:1788263201.403367:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699148672 00000100:00100000:0.0:1788263201.403369:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699148672 00000100:00100000:0.0:1788263201.403386:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:0.0:1788263201.403392:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2385:x1875129699148544:12345-192.168.203.26@tcp:9:kworker.0 00000020:00000080:0.0:1788263201.403413:0:8405:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f37f 00000100:00080000:0.0:1788263201.403422:0:8405:0:(import.c:65:import_set_state_nolock()) ffff9ff283215800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788263201.403460:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788263201.403554:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+2:2385:x1875129699148544:12345-192.168.203.26@tcp:9:kworker.0 Request processed in 161us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263201.403561:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:0.0:1788263201.403571:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:0.0:1788263201.403598:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2385:x1875129699148672:12345-192.168.203.26@tcp:9:kworker.0 00000020:00000080:0.0:1788263201.403609:0:8405:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f386 00000100:00080000:0.0:1788263201.403614:0:8405:0:(import.c:65:import_set_state_nolock()) ffff9ff283241800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788263201.403631:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788263201.403682:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+2:2385:x1875129699148672:12345-192.168.203.26@tcp:9:kworker.0 Request processed in 105us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263201.403688:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00080000:0.0:1788263201.403705:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788263201.403708:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788263201.403716:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788263201.403719:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788263201.403828:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263201.403925:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699148160 00000100:00100000:2.0:1788263201.403929:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699148160 00000100:00100000:2.0:1788263201.403960:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 281 00000100:00100000:2.0:1788263201.403966:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:2386:x1875129699148160:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263201.403993:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:2386:x1875129699148160:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 28us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263201.403998:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 281 00010000:00010000:1.0:1788263201.405028:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788263201.451500:0:11094:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.103 00000100:00100000:1.0:1788263201.849888:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5470380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709700480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788263201.849955:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263201.850037:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709700480 00000100:00100000:2.0:1788263201.850045:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709700480 00000100:00100000:2.0:1788263201.850101:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788263201.850110:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709700480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788263201.850129:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263201.854720:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709700480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4601us (4754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263201.854851:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788263201.855387:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5470380 x1875129709700480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263201.855410:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5470380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709700480:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788263202.352001:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263202.358948:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709700608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788263202.359017:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263202.361790:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709700608 00000100:00100000:1.0:1788263202.361802:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709700608 00000100:00100000:1.0:1788263202.361858:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788263202.361868:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709700608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788263202.361914:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263202.361999:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709700608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (2982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263202.362007:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1788263202.362049:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833e3800 x1875129709700608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263202.362068:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709700608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788263202.362118:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709700736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263202.362150:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263202.362179:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709700736 00000100:00100000:1.0:1788263202.362182:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709700736 00000100:00100000:1.0:1788263202.362199:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788263202.362216:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709700736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788263202.362229:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263202.362258:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709700736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263202.362264:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788263202.362286:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833d8e00 x1875129709700736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263202.362659:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709700736:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788263203.375705:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788263203.996435:0:11192:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.103 00010000:00010000:1.0:1788263204.401469:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263204.913281:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788263204.913302:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709700864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788263204.913377:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263204.913461:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709700864 00000100:00100000:3.0:1788263204.913468:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709700864 00000100:00100000:3.0:1788263204.913522:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788263204.913531:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709700864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788263204.913562:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788263204.913658:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709700864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263204.913665:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788263204.913730:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709700864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788263204.924027:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788263204.924049:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709700992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788263204.924126:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263204.924192:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709700992 00000100:00100000:0.0:1788263204.924199:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709700992 00000100:00100000:0.0:1788263204.924241:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788263204.924251:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709700992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788263204.924279:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788263204.924517:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709700992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 266us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263204.924525:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788263204.924571:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709700992:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788263205.428017:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263206.448030:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709701504:0@lo:400:kworker.0 00000100:00100000:2.0:1788263206.448106:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263206.448165:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709702016:0@lo:400:kworker.0 00000100:00100000:2.0:1788263206.448204:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263206.448221:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709702528:0@lo:400:kworker.0 00000100:00100000:2.0:1788263206.448240:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263206.448266:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788263206.448271:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709701120:0@lo:400:kworker.0 00000100:00100000:2.0:1788263206.448299:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263206.448322:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709701632:0@lo:400:kworker.0 00000100:00100000:2.0:1788263206.448347:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263206.448362:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709702144:0@lo:400:kworker.0 00000100:00100000:2.0:1788263206.448381:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263206.448395:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709702656:0@lo:400:kworker.0 00000100:00100000:2.0:1788263206.448414:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263206.448436:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709701248:0@lo:400:kworker.0 00000100:00100000:2.0:1788263206.448457:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263206.448471:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709701760:0@lo:400:kworker.0 00000100:00100000:2.0:1788263206.448489:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263206.448501:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875129709702272:0@lo:400:kworker.0 00000100:00100000:2.0:1788263206.448517:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263206.448531:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788263206.448536:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709701376:0@lo:400:kworker.0 00000100:00100000:2.0:1788263206.448553:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263206.448621:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709701888:0@lo:400:kworker.0 00000100:00100000:2.0:1788263206.448644:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263206.448661:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709702400:0@lo:400:kworker.0 00000100:00100000:2.0:1788263206.448691:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263206.448718:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709701120 00000100:00100000:2.0:1788263206.448725:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709701120 00000100:00100000:2.0:1788263206.448768:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788263206.448777:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3620:x1875129709701120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263206.448824:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3620:x1875129709701120:12345-0@lo:400:kworker.0 Request processed in 48us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263206.448831:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788263206.448865:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709701504 00000100:00100000:2.0:1788263206.448868:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709701504 00000100:00100000:2.0:1788263206.448886:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709701248 00000100:00100000:2.0:1788263206.448888:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709701248 00000100:00100000:2.0:1788263206.448898:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709701760 00000100:00100000:2.0:1788263206.448900:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709701760 00000100:00100000:2.0:1788263206.448919:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709702272 00000100:00100000:2.0:1788263206.448921:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709702272 00000100:00100000:2.0:1788263206.448930:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709701888 00000100:00100000:2.0:1788263206.448932:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709701888 00000100:00100000:2.0:1788263206.448941:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709702400 00000100:00100000:2.0:1788263206.448944:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709702400 00000100:00100000:2.0:1788263206.448956:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788263206.448962:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709701504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263206.448994:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709701504:12345-0@lo:400:kworker.0 Request processed in 32us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263206.449000:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788263206.449012:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788263206.449025:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709701248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263206.449070:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709701248:12345-0@lo:400:kworker.0 Request processed in 47us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263206.449076:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788263206.449088:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788263206.449093:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709701760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263206.449118:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709701760:12345-0@lo:400:kworker.0 Request processed in 25us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263206.449123:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788263206.449136:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788263206.449141:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875129709702272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263206.449165:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875129709702272:12345-0@lo:400:kworker.0 Request processed in 25us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263206.449170:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788263206.449180:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788263206.449186:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709701888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263206.449212:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709701888:12345-0@lo:400:kworker.0 Request processed in 26us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263206.449217:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788263206.449227:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788263206.449232:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875129709702400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263206.449255:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875129709702400:12345-0@lo:400:kworker.0 Request processed in 23us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263206.449261:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:2.0:1788263206.449294:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833d9f80 x1875129709701888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263206.449314:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709701888:0@lo:400:kworker.0 00010000:00080000:2.0:1788263206.449327:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28312e680 x1875129709702400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263206.449335:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709702400:0@lo:400:kworker.0 00000100:00100000:2.0:1788263206.449344:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709701248:0@lo:400:kworker.0 00000100:00100000:2.0:1788263206.449352:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709701760:0@lo:400:kworker.0 00000100:00100000:2.0:1788263206.449361:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875129709702272:0@lo:400:kworker.0 00000100:00100000:2.0:1788263206.449393:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709701120:0@lo:400:kworker.0 00000100:00100000:2.0:1788263206.449404:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709701504:0@lo:400:kworker.0 00010000:00010000:0.0:1788263206.449640:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263206.449649:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788263206.449661:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709702784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263206.449693:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263206.449737:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709702016 00000100:00100000:0.0:1788263206.449741:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709702016 00000100:00100000:0.0:1788263206.449763:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709702528 00000100:00100000:0.0:1788263206.449765:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709702528 00000100:00100000:0.0:1788263206.449776:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709702144 00000100:00100000:0.0:1788263206.449778:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709702144 00000100:00100000:0.0:1788263206.449789:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709702656 00000100:00100000:0.0:1788263206.449791:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709702656 00000100:00100000:0.0:1788263206.449815:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788263206.449820:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709702016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263206.449868:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709702016:12345-0@lo:400:kworker.0 Request processed in 47us (1662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263206.449874:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788263206.449885:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788263206.449891:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709702528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263206.449916:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709702528:12345-0@lo:400:kworker.0 Request processed in 26us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263206.449922:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788263206.449932:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788263206.449938:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709702144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263206.449965:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709702144:12345-0@lo:400:kworker.0 Request processed in 27us (1583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263206.449971:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788263206.449988:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788263206.449994:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387615f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709702656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263206.450018:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387615f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709702656:12345-0@lo:400:kworker.0 Request processed in 25us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263206.450022:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788263206.450044:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709701632 00000100:00100000:0.0:1788263206.450048:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709701632 00000100:00100000:0.0:1788263206.450076:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709701376 00000100:00100000:0.0:1788263206.450079:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709701376 00000100:00100000:0.0:1788263206.450091:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788263206.450097:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709701632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263206.450138:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709701632:12345-0@lo:400:kworker.0 Request processed in 41us (1790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263206.450144:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788263206.450157:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788263206.450163:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709701376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263206.450188:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709701376:12345-0@lo:400:kworker.0 Request processed in 26us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263206.450193:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1788263206.450227:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788263206.450231:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788263206.450233:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788263206.450235:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263206.450296:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709702784 00000100:00100000:1.0:1788263206.450300:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709702784 00000100:00100000:1.0:1788263206.450335:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788263206.450342:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709702784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788263206.450368:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263206.450408:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709702784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263206.450415:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788263206.450444:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff282fdca80 x1875129709702784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263206.450458:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709702784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788263206.450536:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709701632:0@lo:400:kworker.0 00010000:00080000:3.0:1788263206.450548:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28312f800 x1875129709702144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263206.450557:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709702144:0@lo:400:kworker.0 00010000:00080000:3.0:1788263206.450611:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28312ed80 x1875129709702656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263206.450619:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709702656:0@lo:400:kworker.0 00010000:00080000:3.0:1788263206.450631:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28312dc00 x1875129709702016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263206.450638:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709702016:0@lo:400:kworker.0 00010000:00080000:3.0:1788263206.450647:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28312ea00 x1875129709702528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263206.450654:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709702528:0@lo:400:kworker.0 00000100:00100000:2.0:1788263206.455012:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709701376:0@lo:400:kworker.0 00000100:00100000:0.0:1788263206.519333:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263206.519371:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263206.519402:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263206.519430:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699149056 00000100:00100000:0.0:1788263206.519438:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699149056 00000100:00100000:0.0:1788263206.519489:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699148928 00000100:00100000:0.0:1788263206.519492:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699148928 00000100:00100000:0.0:1788263206.519516:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 95 00000100:00100000:0.0:1788263206.519525:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2388:x1875129699149056:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263206.519717:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699148800 00000100:00100000:2.0:1788263206.519721:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699148800 00000100:00100000:2.0:1788263206.519750:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 283 00000100:00100000:2.0:1788263206.519757:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:2388:x1875129699148800:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263206.530219:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:2388:x1875129699148800:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 10451us (10884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263206.530233:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 283 00000100:00100000:0.0:1788263206.530523:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2388:x1875129699149056:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 10997us (11148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263206.530532:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 95 00000100:00100000:0.0:1788263206.530554:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 96 00000100:00100000:0.0:1788263206.530752:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2388:x1875129699148928:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263206.530822:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2388:x1875129699148928:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 259us (11418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263206.530828:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 96 00000100:00080000:0.0:1788263206.530853:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788263206.530857:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:3.0:1788263206.676786:0:11289:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.103 00000100:00100000:1.0:1788263206.961573:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709702912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788263206.961657:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263206.961782:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709702912 00000100:00100000:3.0:1788263206.961790:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709702912 00000100:00100000:3.0:1788263206.961826:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788263206.961834:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709702912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788263206.961853:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263206.961890:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709702912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263206.961897:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788263206.962115:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff281e38380 x1875129709702912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263206.962132:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709702912:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1788263206.967494:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea 00000020:00000080:1.0:1788263206.967503:0:9482:0:(genops.c:885:class_export_put()) final put ffff9ff283244800/ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea 00000020:00000080:2.0:1788263206.967849:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff283244800/ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea for lustre-OST0001 00000020:00000080:2.0:1788263206.967898:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff283241800 for lustre-OST0001 00000001:00100000:1.0:1788263206.977674:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea 00000020:00000080:1.0:1788263206.977683:0:8398:0:(genops.c:885:class_export_put()) final put ffff9ff283214000/ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea 00000020:00000080:0.0:1788263206.980515:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff283214000/ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea for lustre-OST0000 00000020:00000080:1.0:1788263206.980950:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff283215800 for lustre-OST0000 00010000:00010000:1.0:1788263207.471980:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263207.472177:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2838cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709703040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788263207.472241:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263207.472957:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709703040 00000100:00100000:2.0:1788263207.472966:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709703040 00000100:00100000:2.0:1788263207.473031:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788263207.473060:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709703040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788263207.473091:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263207.473150:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709703040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263207.473157:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788263207.473255:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2838cc000 x1875129709703040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263207.473275:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2838cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709703040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263207.473858:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709703168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788263207.473908:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263207.474160:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709703168 00000100:00100000:0.0:1788263207.474165:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709703168 00000100:00100000:0.0:1788263207.474212:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788263207.474220:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709703168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788263207.474235:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263207.474272:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709703168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263207.474278:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1788263207.475741:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff281e39f80 x1875129709703168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263207.475764:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709703168:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788263208.496305:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788263208.590452:0:11337:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 1 07:46:46 EDT 2026 00010000:00010000:2.0:1788263209.520351:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263210.031757:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788263210.031790:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709703424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788263210.031856:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263210.031931:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709703296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788263210.031953:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263210.032043:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709703424 00000100:00100000:3.0:1788263210.032050:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709703424 00000100:00100000:3.0:1788263210.032083:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709703296 00000100:00100000:3.0:1788263210.032086:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709703296 00000100:00100000:3.0:1788263210.032099:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788263210.032107:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709703424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788263210.032134:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788263210.032184:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709703424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263210.032190:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788263210.032205:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788263210.032211:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709703296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788263210.032224:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788263210.032252:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709703296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 41us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263210.032258:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788263210.032422:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709703424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788263210.032435:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709703296:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788263210.547265:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263211.567816:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709703552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263211.567885:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788263211.568073:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263211.568217:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875129709703808:0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.568268:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263211.568286:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875129709704320:0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.568303:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263211.568320:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875129709704832:0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.568334:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263211.568348:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788263211.568353:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709703680:0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.568372:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263211.568385:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709704192:0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.568413:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263211.568427:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709704704:0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.568443:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263211.568466:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709703808 00000100:00100000:1.0:1788263211.568472:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709703808 00000100:00100000:1.0:1788263211.568531:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709704320 00000100:00100000:1.0:1788263211.568535:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709704320 00000100:00100000:1.0:1788263211.568556:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709704832 00000100:00100000:1.0:1788263211.568559:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709704832 00000100:00100000:1.0:1788263211.568573:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788263211.568603:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28233b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875129709703808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.568654:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28233b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875129709703808:12345-0@lo:400:kworker.0 Request processed in 53us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263211.568660:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788263211.568675:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788263211.568680:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875129709704320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.568707:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875129709704320:12345-0@lo:400:kworker.0 Request processed in 27us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263211.568713:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788263211.568723:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788263211.568729:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875129709704832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.568749:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875129709704832:12345-0@lo:400:kworker.0 Request processed in 21us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263211.568753:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788263211.568775:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709704192 00000100:00100000:1.0:1788263211.568778:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709704192 00000100:00100000:1.0:1788263211.568801:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788263211.568807:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28233b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709704192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.568836:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28233b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709704192:12345-0@lo:400:kworker.0 Request processed in 30us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263211.568841:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788263211.568858:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709704704 00000100:00100000:1.0:1788263211.568867:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709704704 00000100:00100000:1.0:1788263211.568892:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788263211.568898:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28233bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709704704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.568924:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28233bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709704704:12345-0@lo:400:kworker.0 Request processed in 27us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263211.568929:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1788263211.568944:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788263211.568948:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263211.568963:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709704064:0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.568983:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263211.568995:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709704576:0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.569009:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263211.569034:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709705088:0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.569049:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263211.569064:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788263211.569067:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709703936:0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.569081:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263211.569091:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875129709704448:0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.569104:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263211.569113:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28233aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709704960:0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.569125:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263211.569140:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709704576 00000100:00100000:1.0:1788263211.569143:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709704576 00000100:00100000:1.0:1788263211.569161:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709705088 00000100:00100000:1.0:1788263211.569163:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709705088 00000100:00100000:1.0:1788263211.569176:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788263211.569180:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28233a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709704576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.569213:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28233a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709704576:12345-0@lo:400:kworker.0 Request processed in 32us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263211.569219:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788263211.569230:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788263211.569234:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709705088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.569252:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709705088:12345-0@lo:400:kworker.0 Request processed in 18us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263211.569256:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788263211.569273:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709704064 00000100:00100000:1.0:1788263211.569276:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709704064 00000100:00100000:1.0:1788263211.569289:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709704448 00000100:00100000:1.0:1788263211.569291:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709704448 00000100:00100000:1.0:1788263211.569301:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709704960 00000100:00100000:1.0:1788263211.569303:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709704960 00000100:00100000:1.0:1788263211.569311:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788263211.569315:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709704064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.569336:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709704064:12345-0@lo:400:kworker.0 Request processed in 20us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263211.569340:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788263211.569349:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788263211.569353:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875129709704448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.569370:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875129709704448:12345-0@lo:400:kworker.0 Request processed in 17us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263211.569374:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788263211.569381:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788263211.569385:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28233b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875129709704960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.569412:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28233b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875129709704960:12345-0@lo:400:kworker.0 Request processed in 26us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263211.569417:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1788263211.569432:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788263211.569434:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788263211.569436:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263211.569441:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709703936 00000100:00100000:1.0:1788263211.569443:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709703936 00000100:00100000:1.0:1788263211.569457:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788263211.569461:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709703936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.569483:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709703936:12345-0@lo:400:kworker.0 Request processed in 22us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263211.569488:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788263211.569516:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709704192:0@lo:400:kworker.0 00010000:00080000:1.0:1788263211.569526:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff282338000 x1875129709704704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263211.569535:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709704704:0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.569543:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875129709703808:0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.569550:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875129709704320:0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.569557:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875129709704832:0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.569611:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709703936:0@lo:400:kworker.0 00010000:00080000:1.0:1788263211.569620:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833e2300 x1875129709704448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263211.569628:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875129709704448:0@lo:400:kworker.0 00010000:00080000:1.0:1788263211.569646:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28233aa00 x1875129709704960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263211.569654:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28233aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709704960:0@lo:400:kworker.0 00000100:00100000:1.0:1788263211.569663:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709704064:0@lo:400:kworker.0 00010000:00080000:1.0:1788263211.569671:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833e2d80 x1875129709704576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263211.569678:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709704576:0@lo:400:kworker.0 00010000:00080000:1.0:1788263211.569686:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff282338380 x1875129709705088/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263211.569694:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709705088:0@lo:400:kworker.0 00000100:00100000:3.0:1788263211.569774:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709703552 00000100:00100000:3.0:1788263211.569778:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709703552 00000100:00100000:3.0:1788263211.569817:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788263211.569823:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709703552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788263211.569842:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263211.569877:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709703552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263211.569883:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788263211.569949:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709703680 00000100:00100000:2.0:1788263211.569953:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709703680 00000100:00100000:2.0:1788263211.569983:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788263211.569988:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3621:x1875129709703680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263211.570030:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3621:x1875129709703680:12345-0@lo:400:kworker.0 Request processed in 43us (1657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263211.570036:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788263211.570063:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709703680:0@lo:400:kworker.0 00000100:00080000:1.0:1788263211.570142:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788263211.570158:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff282fdca80 x1875129709703552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263211.570170:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709703552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788263211.652048:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263211.652107:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263211.652155:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263211.652279:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699149184 00000100:00100000:0.0:1788263211.652288:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699149184 00000100:00100000:0.0:1788263211.652344:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 285 00000100:00100000:0.0:1788263211.652353:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:2386:x1875129699149184:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263211.652438:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:2386:x1875129699149184:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 86us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263211.652446:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 285 00000100:00100000:2.0:1788263211.652522:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699149312 00000100:00100000:2.0:1788263211.652527:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699149312 00000100:00100000:2.0:1788263211.652616:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699149440 00000100:00100000:2.0:1788263211.652620:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699149440 00000100:00100000:2.0:1788263211.652654:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 103 00000100:00100000:2.0:1788263211.652663:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2386:x1875129699149312:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263211.652705:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2386:x1875129699149312:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 44us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263211.652712:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 103 00000100:00100000:2.0:1788263211.652732:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 104 00000100:00100000:2.0:1788263211.652739:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699149440:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263211.652766:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699149440:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 28us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263211.652772:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 104 00000100:00080000:1.0:1788263211.652962:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788263211.652966:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263212.081178:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788263212.081219:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709705216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788263212.081331:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263212.081407:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709705216 00000100:00100000:2.0:1788263212.081420:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709705216 00000100:00100000:2.0:1788263212.081494:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788263212.081505:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709705216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788263212.081532:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263212.081651:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709705216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 147us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263212.081669:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788263212.082006:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff282338380 x1875129709705216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263212.082051:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709705216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788263212.591968:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28233aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709705344:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788263212.592048:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263212.592120:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709705344 00000100:00100000:2.0:1788263212.592128:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709705344 00000100:00100000:2.0:1788263212.592179:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788263212.592190:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709705344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788263212.592216:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263212.592260:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709705344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263212.592268:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1788263212.592313:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28233aa00 x1875129709705344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263212.592331:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28233aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709705344:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788263212.596938:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2838cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709705472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788263212.597002:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788263212.597109:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263212.597120:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709705472 00000100:00100000:2.0:1788263212.597126:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709705472 00000100:00100000:2.0:1788263212.597174:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788263212.597182:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709705472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788263212.597201:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263212.597242:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709705472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263212.597250:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1788263212.597287:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2838cdc00 x1875129709705472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263212.597305:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2838cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709705472:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788263213.626993:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263214.639780:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263215.156264:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2838cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709705600:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788263215.156359:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263215.156438:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709705600 00000100:00100000:2.0:1788263215.156445:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709705600 00000100:00100000:2.0:1788263215.156489:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788263215.156499:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709705600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788263215.156527:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788263215.156569:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709705600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263215.156603:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788263215.156651:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2838cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709705600:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788263215.160529:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788263215.160551:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709705728:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788263215.160631:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263215.160844:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709705728 00000100:00100000:2.0:1788263215.160852:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709705728 00000100:00100000:2.0:1788263215.160909:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788263215.160918:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709705728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788263215.160962:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788263215.161051:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709705728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263215.161058:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788263215.163182:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709705728:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788263215.665104:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263216.688692:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263216.688722:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28233aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709705856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263216.688789:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263216.688849:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875129709706368:0@lo:400:kworker.0 00000100:00100000:0.0:1788263216.688892:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709706112:0@lo:400:kworker.0 00000100:00100000:1.0:1788263216.688908:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263216.688936:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709706880:0@lo:400:kworker.0 00000100:00100000:0.0:1788263216.688937:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263216.688969:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875129709706624:0@lo:400:kworker.0 00000100:00100000:1.0:1788263216.688970:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263216.689005:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709707392:0@lo:400:kworker.0 00000100:00100000:0.0:1788263216.689041:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263216.689042:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263216.689060:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788263216.689067:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709706240:0@lo:400:kworker.0 00000100:00100000:0.0:1788263216.689084:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875129709707136:0@lo:400:kworker.0 00000100:00100000:1.0:1788263216.689092:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263216.689113:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875129709706752:0@lo:400:kworker.0 00000100:00100000:0.0:1788263216.689121:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263216.689138:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263216.689149:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788263216.689158:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709705984:0@lo:400:kworker.0 00000100:00100000:1.0:1788263216.689165:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875129709707264:0@lo:400:kworker.0 00000100:00100000:1.0:1788263216.689199:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263216.689203:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263216.689488:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709706496:0@lo:400:kworker.0 00000100:00100000:1.0:1788263216.689503:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709705856 00000100:00100000:1.0:1788263216.689511:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709705856 00000100:00100000:0.0:1788263216.689516:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263216.689595:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709707008:0@lo:400:kworker.0 00000100:00100000:0.0:1788263216.689619:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263216.689645:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709706368 00000100:00100000:0.0:1788263216.689649:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709706368 00000100:00100000:0.0:1788263216.689671:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709706112 00000100:00100000:0.0:1788263216.689675:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709706112 00000100:00100000:0.0:1788263216.689686:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709706624 00000100:00100000:0.0:1788263216.689688:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709706624 00000100:00100000:0.0:1788263216.689702:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709707136 00000100:00100000:0.0:1788263216.689705:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709707136 00000100:00100000:1.0:1788263216.689712:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788263216.689718:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709706752 00000100:00100000:0.0:1788263216.689723:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709706752 00000100:00100000:1.0:1788263216.689727:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709705856:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263216.689738:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709707264 00000100:00100000:0.0:1788263216.689743:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709707264 00002000:00000024:1.0:1788263216.689753:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263216.689761:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788263216.689770:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28233a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875129709706368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263216.689795:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709705856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263216.689804:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788263216.689814:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28233a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875129709706368:12345-0@lo:400:kworker.0 Request processed in 44us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263216.689822:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788263216.689829:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788263216.689837:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709706112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263216.689843:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788263216.689854:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875129709706624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263216.689872:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709706112:12345-0@lo:400:kworker.0 Request processed in 35us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263216.689885:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788263216.689898:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788263216.689903:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875129709707136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263216.689926:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875129709707136:12345-0@lo:400:kworker.0 Request processed in 23us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263216.689932:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788263216.689942:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788263216.689950:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875129709706752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263216.689958:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875129709706624:12345-0@lo:400:kworker.0 Request processed in 105us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263216.689967:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788263216.689993:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875129709706752:12345-0@lo:400:kworker.0 Request processed in 30us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263216.690001:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788263216.690009:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875129709707264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263216.690043:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875129709707264:12345-0@lo:400:kworker.0 Request processed in 35us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263216.690115:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709706240 00000100:00100000:2.0:1788263216.690120:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709706240 00000100:00100000:2.0:1788263216.690141:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709706496 00000100:00100000:2.0:1788263216.690144:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709706496 00000100:00100000:2.0:1788263216.690159:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788263216.690165:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709706240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263216.690205:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709706240:12345-0@lo:400:kworker.0 Request processed in 40us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263216.690213:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788263216.690228:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788263216.690234:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709706496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263216.690260:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709706496:12345-0@lo:400:kworker.0 Request processed in 26us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263216.690266:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788263216.691185:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788263216.691212:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788263216.691249:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709705984 00000100:00100000:0.0:1788263216.691254:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709705984 00000100:00100000:0.0:1788263216.691335:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788263216.691344:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3619:x1875129709705984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263216.691390:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3619:x1875129709705984:12345-0@lo:400:kworker.0 Request processed in 48us (2192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263216.691397:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788263216.691458:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709706880 00000100:00100000:1.0:1788263216.691463:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709706880 00000100:00100000:1.0:1788263216.691492:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709707392 00000100:00100000:1.0:1788263216.691496:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709707392 00000100:00100000:1.0:1788263216.691516:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709707008 00000100:00100000:1.0:1788263216.691519:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709707008 00000100:00100000:1.0:1788263216.691540:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788263216.691547:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709706880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263216.691606:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709706880:12345-0@lo:400:kworker.0 Request processed in 60us (2637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263216.691613:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788263216.691625:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788263216.691632:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28233ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709707392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263216.691666:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28233ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709707392:12345-0@lo:400:kworker.0 Request processed in 35us (2627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263216.691684:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788263216.691696:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788263216.691703:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709707008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263216.691735:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709707008:12345-0@lo:400:kworker.0 Request processed in 33us (2115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263216.691742:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788263216.691771:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788263216.691776:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788263216.691779:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788263216.691782:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788263216.692113:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709706240:0@lo:400:kworker.0 00010000:00080000:1.0:1788263216.692131:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2831f2a00 x1875129709706752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263216.692144:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875129709706752:0@lo:400:kworker.0 00010000:00080000:1.0:1788263216.692159:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2831f1f80 x1875129709707264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263216.692169:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875129709707264:0@lo:400:kworker.0 00010000:00080000:1.0:1788263216.692182:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2831f3b80 x1875129709707392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263216.692192:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709707392:0@lo:400:kworker.0 00000100:00100000:1.0:1788263216.692207:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875129709706368:0@lo:400:kworker.0 00010000:00080000:1.0:1788263216.692217:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2831f1500 x1875129709706880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263216.692238:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709706880:0@lo:400:kworker.0 00010000:00080000:1.0:1788263216.692251:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28233aa00 x1875129709705856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263216.692266:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28233aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709705856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263216.692575:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709705984:0@lo:400:kworker.0 00000100:00100000:0.0:1788263216.692746:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709706496:0@lo:400:kworker.0 00010000:00080000:0.0:1788263216.692756:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2831f0700 x1875129709707008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263216.692766:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709707008:0@lo:400:kworker.0 00000100:00100000:0.0:1788263216.692779:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709706112:0@lo:400:kworker.0 00000100:00100000:0.0:1788263216.692791:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875129709706624:0@lo:400:kworker.0 00000100:00100000:0.0:1788263216.692802:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875129709707136:0@lo:400:kworker.0 00000100:00100000:1.0:1788263216.757113:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263216.758176:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699149568 00000100:00100000:3.0:1788263216.758193:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699149568 00000100:00100000:3.0:1788263216.758264:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 287 00000100:00100000:3.0:1788263216.758276:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:2389:x1875129699149568:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263216.758373:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:2389:x1875129699149568:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 99us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263216.758382:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 287 00000100:00100000:3.0:1788263216.760084:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263216.760125:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263216.760187:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699149696 00000100:00100000:0.0:1788263216.760196:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699149696 00000100:00100000:0.0:1788263216.760260:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699149824 00000100:00100000:0.0:1788263216.760264:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699149824 00000100:00100000:0.0:1788263216.760290:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 111 00000100:00100000:0.0:1788263216.760298:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2388:x1875129699149696:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263216.760363:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2388:x1875129699149696:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 66us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263216.760372:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 111 00000100:00100000:0.0:1788263216.760389:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 112 00000100:00100000:0.0:1788263216.760396:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2388:x1875129699149824:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263216.760448:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2388:x1875129699149824:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 52us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263216.760455:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 112 00000100:00080000:3.0:1788263216.760788:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788263216.760793:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263217.201894:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788263217.201916:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709707520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788263217.201992:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263217.202158:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709707520 00000100:00100000:1.0:1788263217.202165:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709707520 00000100:00100000:1.0:1788263217.202217:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788263217.202227:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709707520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788263217.202249:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263217.202297:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709707520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263217.202304:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1788263217.202341:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833e3100 x1875129709707520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263217.202359:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709707520:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788263217.711737:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1788263217.711816:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263217.712035:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2838cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709707648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788263217.712100:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263217.712246:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709707648 00000100:00100000:2.0:1788263217.712254:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709707648 00000100:00100000:2.0:1788263217.712310:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788263217.712319:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709707648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788263217.712344:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263217.712429:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709707648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263217.712443:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1788263217.712842:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2838cdc00 x1875129709707648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263217.712863:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2838cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709707648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263217.721270:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788263217.721290:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2838cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709707776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788263217.721351:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263217.721497:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709707776 00000100:00100000:2.0:1788263217.721504:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709707776 00000100:00100000:2.0:1788263217.721549:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788263217.721558:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709707776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788263217.721591:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263217.721632:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709707776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263217.721639:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1788263217.721758:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2838cf800 x1875129709707776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263217.721775:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2838cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709707776:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788263218.738694:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263219.761304:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263220.274482:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263220.274502:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2838cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709707904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788263220.274565:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263220.275388:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709707904 00000100:00100000:1.0:1788263220.275396:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709707904 00000100:00100000:1.0:1788263220.275439:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788263220.275448:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709707904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788263220.275479:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788263220.275536:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709707904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263220.275543:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788263220.276518:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2838cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709707904:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788263220.286236:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709708032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788263220.286300:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263220.287454:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709708032 00000100:00100000:0.0:1788263220.287462:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709708032 00000100:00100000:0.0:1788263220.287513:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788263220.287522:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709708032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788263220.287551:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788263220.288902:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709708032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1376us (2597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263220.288913:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788263220.288995:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709708032:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788263220.788313:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263221.809985:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283299c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709708544:0@lo:400:kworker.0 00000100:00100000:0.0:1788263221.810055:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263221.810110:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709709056:0@lo:400:kworker.0 00000100:00100000:0.0:1788263221.810132:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263221.810146:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709709568:0@lo:400:kworker.0 00000100:00100000:0.0:1788263221.810162:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263221.810182:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788263221.810203:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709708160:0@lo:400:kworker.0 00000100:00100000:0.0:1788263221.810228:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263221.810249:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28329aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709708672:0@lo:400:kworker.0 00000100:00100000:0.0:1788263221.810267:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263221.810281:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709709184:0@lo:400:kworker.0 00000100:00100000:0.0:1788263221.810296:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263221.810309:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28329a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709709696:0@lo:400:kworker.0 00000100:00100000:0.0:1788263221.810324:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263221.810345:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709708416:0@lo:400:kworker.0 00000100:00100000:0.0:1788263221.810365:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263221.810388:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28329b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875129709708928:0@lo:400:kworker.0 00000100:00100000:3.0:1788263221.810512:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709708544 00000100:00100000:3.0:1788263221.810519:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709708544 00000100:00100000:3.0:1788263221.810558:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788263221.810566:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709708544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263221.810689:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709708288:0@lo:400:kworker.0 00000100:00100000:2.0:1788263221.813660:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709708160 00000100:00100000:2.0:1788263221.813670:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709708160 00000100:00100000:2.0:1788263221.813724:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788263221.813732:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3618:x1875129709708160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263221.818055:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709708544:12345-0@lo:400:kworker.0 Request processed in 7480us (7991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263221.818071:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788263221.828790:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709709056 00000100:00100000:0.0:1788263221.828804:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709709056 00000100:00100000:0.0:1788263221.828859:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709709568 00000100:00100000:0.0:1788263221.828862:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709709568 00000100:00100000:0.0:1788263221.828872:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709709184 00000100:00100000:0.0:1788263221.828874:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709709184 00000100:00100000:0.0:1788263221.828886:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709709696 00000100:00100000:0.0:1788263221.828889:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709709696 00000100:00100000:0.0:1788263221.828906:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788263221.828915:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709709056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263221.829001:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709709056:12345-0@lo:400:kworker.0 Request processed in 87us (18867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263221.829008:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788263221.829022:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788263221.829027:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709709568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263221.829051:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709709568:12345-0@lo:400:kworker.0 Request processed in 24us (18888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263221.829056:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788263221.829065:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788263221.829070:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709709184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263221.829098:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709709184:12345-0@lo:400:kworker.0 Request processed in 21us (18793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263221.829104:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788263221.829113:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788263221.829119:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709709696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263221.829141:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709709696:12345-0@lo:400:kworker.0 Request processed in 23us (18816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263221.829159:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1788263221.829164:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788263221.829170:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788263221.829182:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709708672 00000100:00100000:0.0:1788263221.829202:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709708672 00000100:00100000:0.0:1788263221.829218:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709708416 00000100:00100000:0.0:1788263221.829220:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709708416 00000100:00100000:0.0:1788263221.829231:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788263221.829236:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709708672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263221.829266:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709708672:12345-0@lo:400:kworker.0 Request processed in 30us (18997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263221.829271:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788263221.829281:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788263221.829286:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709708416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263221.829307:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709708416:12345-0@lo:400:kworker.0 Request processed in 22us (18942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263221.829313:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788263221.829360:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28329aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709708672:0@lo:400:kworker.0 00010000:00080000:0.0:1788263221.829373:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283299180 x1875129709709184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263221.829383:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709709184:0@lo:400:kworker.0 00010000:00080000:0.0:1788263221.829393:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28329a680 x1875129709709696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263221.829402:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28329a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709709696:0@lo:400:kworker.0 00000100:00100000:0.0:1788263221.829553:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283299c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709708544:0@lo:400:kworker.0 00010000:00080000:0.0:1788263221.829564:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283298e00 x1875129709709056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263221.829597:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709709056:0@lo:400:kworker.0 00010000:00080000:0.0:1788263221.829610:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283299500 x1875129709709568/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263221.829619:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709709568:0@lo:400:kworker.0 00000100:00100000:0.0:1788263221.829662:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263221.829694:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28329bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875129709709440:0@lo:400:kworker.0 00000100:00100000:0.0:1788263221.829717:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263221.829737:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709708928 00000100:00100000:0.0:1788263221.829740:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709708928 00000100:00100000:0.0:1788263221.829765:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709709440 00000100:00100000:0.0:1788263221.829767:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709709440 00000100:00100000:0.0:1788263221.829779:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788263221.829784:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875129709708928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263221.829811:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875129709708928:12345-0@lo:400:kworker.0 Request processed in 26us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263221.829816:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788263221.829826:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788263221.829831:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875129709709440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263221.829850:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875129709709440:12345-0@lo:400:kworker.0 Request processed in 20us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263221.829856:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:0.0:1788263221.829873:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28329bb80 x1875129709709440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263221.829882:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28329bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875129709709440:0@lo:400:kworker.0 00000100:00100000:0.0:1788263221.829909:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709708416:0@lo:400:kworker.0 00010000:00080000:0.0:1788263221.829918:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28329b800 x1875129709708928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263221.829926:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28329b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875129709708928:0@lo:400:kworker.0 00000100:00080000:3.0:1788263221.830227:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788263221.831506:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263221.831542:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709708800:0@lo:400:kworker.0 00000100:00100000:1.0:1788263221.831567:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263221.831661:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709708288 00000100:00100000:3.0:1788263221.831666:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709708288 00000100:00100000:3.0:1788263221.831692:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709708800 00000100:00100000:3.0:1788263221.831694:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709708800 00000100:00100000:3.0:1788263221.831816:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788263221.831824:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709708288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263221.832420:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28329b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875129709709312:0@lo:400:kworker.0 00000100:00100000:1.0:1788263221.832552:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263221.832562:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709708288:12345-0@lo:400:kworker.0 Request processed in 738us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263221.832572:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788263221.832598:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3618:x1875129709708160:12345-0@lo:400:kworker.0 Request processed in 18846us (22348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263221.832609:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788263221.832631:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709708288:0@lo:400:kworker.0 00010000:00010000:2.0:1788263221.832680:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263221.832704:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709709312 00000100:00100000:2.0:1788263221.832708:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709709312 00000100:00100000:1.0:1788263221.832726:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788263221.832733:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788263221.832736:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709708800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263221.832746:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875129709709312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263221.832780:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709708800:12345-0@lo:400:kworker.0 Request processed in 47us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263221.832786:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788263221.832793:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875129709709312:12345-0@lo:400:kworker.0 Request processed in 49us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263221.832800:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:2.0:1788263221.832827:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263221.832842:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709709824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263221.832861:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263221.832894:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709708800:0@lo:400:kworker.0 00000100:00100000:1.0:1788263221.832900:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28329b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875129709709312:0@lo:400:kworker.0 00000100:00100000:0.0:1788263221.833979:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709708160:0@lo:400:kworker.0 00000100:00100000:2.0:1788263221.834341:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709709824 00000100:00100000:2.0:1788263221.834345:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709709824 00000100:00100000:2.0:1788263221.834378:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788263221.834385:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709709824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788263221.835619:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263221.835677:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709709824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1291us (2813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263221.835685:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1788263221.835700:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833e0700 x1875129709709824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263237 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263221.835719:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709709824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263221.877271:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263221.877363:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263221.877426:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263221.877501:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699150208 00000100:00100000:0.0:1788263221.877512:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699150208 00000100:00100000:1.0:1788263221.877513:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699150080 00000100:00100000:1.0:1788263221.877520:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699150080 00000100:00100000:0.0:1788263221.877595:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 119 00000100:00100000:0.0:1788263221.877605:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699150208:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263221.877665:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 120 00000100:00100000:0.0:1788263221.877673:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699150208:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 68us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263221.877699:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2386:x1875129699150080:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263221.877731:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2386:x1875129699150080:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 36us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263221.878244:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699149952 00000100:00100000:2.0:1788263221.878261:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699149952 00000100:00100000:2.0:1788263221.878293:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 289 00000100:00100000:2.0:1788263221.878300:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:2386:x1875129699149952:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263221.878343:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:2386:x1875129699149952:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 43us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263221.878365:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 289 00000100:00080000:2.0:1788263221.878407:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788263221.878425:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788263221.895101:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 119 00000100:00100000:1.0:1788263221.895149:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 120 00000100:00100000:2.0:1788263222.319855:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788263222.319879:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709709952:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788263222.319958:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263222.322726:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709709952 00000100:00100000:3.0:1788263222.322739:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709709952 00000100:00100000:3.0:1788263222.322804:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788263222.322814:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709709952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788263222.322849:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263222.322916:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709709952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (2958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263222.322924:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788263222.323179:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28387d880 x1875129709709952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263222.323210:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709709952:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788263222.833714:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2838cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709710208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263222.833767:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2838cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709710080:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788263222.833781:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263222.833820:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709710208 00000100:00100000:3.0:1788263222.833829:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709710208 00000100:00100000:3.0:1788263222.833880:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788263222.833886:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263222.833894:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709710208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788263222.833920:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263222.833925:0:8408:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788263222.833935:0:8408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1788263222.833980:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709710208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263222.833987:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788263222.834001:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709710080 00000100:00100000:3.0:1788263222.834004:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709710080 00000100:00100000:3.0:1788263222.834019:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788263222.834026:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709710080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788263222.834099:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263222.834130:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709710080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263222.834136:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1788263222.834168:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2838cf480 x1875129709710080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263222.834186:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2838cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709710080:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788263222.834453:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2838cfb80 x1875129709710208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263222.834478:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2838cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709710208:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788263222.895713:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263223.967303:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263225.031905:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263225.397366:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b55bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709710336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788263225.397434:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263225.397502:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709710336 00000100:00100000:0.0:1788263225.397509:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709710336 00000100:00100000:0.0:1788263225.397549:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788263225.397558:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709710336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788263225.399258:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788263225.399321:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709710336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1763us (1887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263225.399339:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788263225.399371:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709710464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788263225.399400:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263225.399453:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b55bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709710336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788263225.399473:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709710464 00000100:00100000:0.0:1788263225.399477:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709710464 00000100:00100000:0.0:1788263225.399501:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788263225.399508:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709710464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788263225.399526:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788263225.399557:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709710464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263225.399563:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788263225.399605:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709710464:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788263226.032039:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263226.927876:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788263226.927900:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709710592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263226.927978:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263226.928545:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28233aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709710720:0@lo:400:kworker.0 00000100:00100000:3.0:1788263226.928616:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709710592 00000100:00100000:3.0:1788263226.928624:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709710592 00000100:00100000:0.0:1788263226.928631:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263226.928678:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788263226.928701:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709710592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788263226.928731:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263226.928769:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709710720 00000100:00100000:2.0:1788263226.928775:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709710720 00000100:00100000:2.0:1788263226.928811:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788263226.928818:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3619:x1875129709710720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263226.936530:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709710848:0@lo:400:kworker.0 00000100:00100000:1.0:1788263226.936627:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263226.936667:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709711360:0@lo:400:kworker.0 00000100:00100000:1.0:1788263226.936686:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263226.936706:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875129709711872:0@lo:400:kworker.0 00000100:00100000:1.0:1788263226.936723:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263226.938024:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709710592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9318us (10038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263226.938037:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788263226.939399:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3619:x1875129709710720:12345-0@lo:400:kworker.0 Request processed in 10574us (10762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263226.939412:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788263226.939654:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788263226.939666:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709710976:0@lo:400:kworker.0 00000100:00100000:1.0:1788263226.939720:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263226.939898:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709711488:0@lo:400:kworker.0 00000100:00100000:1.0:1788263226.939934:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263226.944750:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28233aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709710720:0@lo:400:kworker.0 00010000:00080000:0.0:1788263226.944774:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28387d880 x1875129709710592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263226.944795:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709710592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263226.944849:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709711232:0@lo:400:kworker.0 00000100:00100000:0.0:1788263226.944917:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263226.944956:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709711744:0@lo:400:kworker.0 00000100:00100000:0.0:1788263226.944981:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263226.945001:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788263226.946854:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709711104:0@lo:400:kworker.0 00000100:00100000:0.0:1788263226.952425:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709710976 00000100:00100000:0.0:1788263226.952441:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709710976 00000100:00100000:0.0:1788263226.952504:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709711232 00000100:00100000:0.0:1788263226.952507:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709711232 00000100:00100000:0.0:1788263226.952529:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788263226.952538:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709710976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263226.956442:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709710976:12345-0@lo:400:kworker.0 Request processed in 3897us (16712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263226.956455:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788263226.956493:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788263226.956505:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709711232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263226.956553:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709711232:12345-0@lo:400:kworker.0 Request processed in 52us (11644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263226.956559:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788263226.956599:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709711744 00000100:00100000:0.0:1788263226.956607:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709711744 00000100:00100000:0.0:1788263226.956646:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788263226.956652:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709711744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263226.956680:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709711744:12345-0@lo:400:kworker.0 Request processed in 30us (11699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263226.956704:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788263226.963126:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709710848 00000100:00100000:3.0:1788263226.963142:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709710848 00000100:00100000:3.0:1788263226.963232:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709711360 00000100:00100000:3.0:1788263226.963236:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709711360 00000100:00100000:3.0:1788263226.963254:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709711872 00000100:00100000:3.0:1788263226.963257:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709711872 00000100:00100000:3.0:1788263226.963267:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709711488 00000100:00100000:3.0:1788263226.963269:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709711488 00000100:00100000:3.0:1788263226.963286:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788263226.963295:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709710848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263226.963527:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709710848:12345-0@lo:400:kworker.0 Request processed in 161us (26829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263226.963536:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788263226.963554:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788263226.963562:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709711360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263226.964165:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709711360:12345-0@lo:400:kworker.0 Request processed in 601us (27473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263226.964227:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788263226.964248:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788263226.964257:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875129709711872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263226.964292:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875129709711872:12345-0@lo:400:kworker.0 Request processed in 37us (27567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263226.964313:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788263226.964324:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788263226.964331:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709711488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263226.965028:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709711488:12345-0@lo:400:kworker.0 Request processed in 694us (25089us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263226.965036:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1788263226.965121:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788263226.965126:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788263226.965129:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788263226.965131:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788263226.968617:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263226.968679:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709711616:0@lo:400:kworker.0 00000100:00100000:3.0:1788263226.970019:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263226.970067:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709712128:0@lo:400:kworker.0 00000100:00100000:3.0:1788263226.970093:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263226.970131:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709711232:0@lo:400:kworker.0 00010000:00080000:3.0:1788263226.970147:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6cc700 x1875129709711744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263226.970157:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709711744:0@lo:400:kworker.0 00000100:00100000:3.0:1788263226.970202:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709711104 00000100:00100000:3.0:1788263226.970208:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709711104 00000100:00100000:3.0:1788263226.970251:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788263226.970260:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709711104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263226.970309:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709711104:12345-0@lo:400:kworker.0 Request processed in 50us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263226.970334:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788263226.970899:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709711616 00000100:00100000:2.0:1788263226.970905:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709711616 00000100:00100000:2.0:1788263226.970954:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709712128 00000100:00100000:2.0:1788263226.970957:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709712128 00000100:00100000:2.0:1788263226.970971:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788263226.970977:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709711616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263226.971020:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709711616:12345-0@lo:400:kworker.0 Request processed in 44us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263226.971026:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788263226.971039:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788263226.971044:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709712128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263226.971064:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709712128:12345-0@lo:400:kworker.0 Request processed in 21us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263226.971069:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1788263226.971089:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788263226.971093:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263226.971449:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709711104:0@lo:400:kworker.0 00010000:00080000:2.0:1788263226.971535:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6cdf80 x1875129709711616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263226.971546:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709711616:0@lo:400:kworker.0 00010000:00080000:2.0:1788263226.971560:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6ce300 x1875129709712128/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263226.971568:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709712128:0@lo:400:kworker.0 00010000:00080000:0.0:1788263226.975749:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6ce680 x1875129709711488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263226.975767:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709711488:0@lo:400:kworker.0 00000100:00100000:0.0:1788263226.975779:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875129709712000:0@lo:400:kworker.0 00000100:00100000:0.0:1788263226.975843:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263226.975882:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709710848:0@lo:400:kworker.0 00000100:00100000:0.0:1788263226.975895:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709711360:0@lo:400:kworker.0 00000100:00100000:0.0:1788263226.975905:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875129709711872:0@lo:400:kworker.0 00000100:00100000:0.0:1788263226.975948:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709710976:0@lo:400:kworker.0 00000100:00100000:3.0:1788263226.977065:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709712000 00000100:00100000:3.0:1788263226.977075:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709712000 00000100:00080000:2.0:1788263226.977191:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788263226.977922:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788263226.977939:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28233aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875129709712000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263226.978068:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28233aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875129709712000:12345-0@lo:400:kworker.0 Request processed in 136us (2224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263226.978076:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00080000:2.0:1788263226.978629:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6cf100 x1875129709712000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263226.978645:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875129709712000:0@lo:400:kworker.0 00000100:00100000:2.0:1788263226.997563:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263226.997703:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699150336 00000100:00100000:3.0:1788263226.997713:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699150336 00000100:00100000:3.0:1788263226.997771:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 291 00000100:00100000:3.0:1788263226.997781:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0499450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:2387:x1875129699150336:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263226.997848:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0499450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:2387:x1875129699150336:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 69us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263226.997866:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 291 00000100:00100000:1.0:1788263227.002494:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263227.004884:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699150464 00000100:00100000:3.0:1788263227.004905:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699150464 00000100:00100000:3.0:1788263227.005668:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 127 00000100:00100000:3.0:1788263227.005683:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2387:x1875129699150464:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263227.005793:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2387:x1875129699150464:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 114us (3315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263227.005803:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 127 00000100:00080000:2.0:1788263227.006085:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263227.011677:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263227.011760:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699150592 00000100:00100000:0.0:1788263227.011771:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699150592 00000100:00100000:0.0:1788263227.011898:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 128 00000100:00100000:0.0:1788263227.011921:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699150592:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263227.012021:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699150592:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 113us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263227.012029:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 128 00000100:00080000:2.0:1788263227.015325:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788263227.059332:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263227.440198:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709712256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788263227.440266:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263227.440505:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709712256 00000100:00100000:0.0:1788263227.440513:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709712256 00000100:00100000:0.0:1788263227.440564:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788263227.440574:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709712256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788263227.440623:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263227.440689:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709712256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263227.440697:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1788263227.441032:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6cf800 x1875129709712256/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263227.441051:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709712256:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788263227.951823:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2838cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709712384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263227.951894:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263227.952010:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709712384 00000100:00100000:2.0:1788263227.952018:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709712384 00000100:00100000:2.0:1788263227.952079:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788263227.952089:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709712384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788263227.952115:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263227.952162:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709712384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263227.952169:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1788263227.952207:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2838cdf80 x1875129709712384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263227.952224:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2838cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709712384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263227.959059:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2838cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709712512:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788263227.959131:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263227.959241:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709712512 00000100:00100000:2.0:1788263227.959250:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709712512 00000100:00100000:2.0:1788263227.959303:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788263227.959429:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709712512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788263227.959455:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263227.959510:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709712512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 198us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263227.959517:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1788263227.959608:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2838cdf80 x1875129709712512/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263227.959626:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2838cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709712512:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788263228.081454:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788263228.632301:0:11968:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 07:47:06 (1788263226) === 00010000:00010000:2.0:1788263229.103753:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263229.280756:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263229.281536:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699150720 00000100:00100000:3.0:1788263229.281548:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699150720 00000100:00100000:3.0:1788263229.281648:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 292 00000100:00100000:3.0:1788263229.281657:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:8697:x1875129699150720:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788263229.281686:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263229.281703:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff398eed800/0x4b1103cba666f474 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xd405f293d116fd05 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263229.281729:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff398eed800/0x4b1103cba666f474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd05 expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263229.281737:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff398eed800/0x4b1103cba666f474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd05 expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263229.281745:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eed800, rc 0) 00000100:00100000:3.0:1788263229.281808:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+11:8697:x1875129699150720:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 152us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263229.281814:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 292 00000100:00100000:1.0:1788263229.296160:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263229.296342:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699150848 00000100:00100000:3.0:1788263229.296352:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699150848 00000100:00100000:3.0:1788263229.296414:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 293 00000100:00100000:3.0:1788263229.296424:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+11:8697:x1875129699150848:12345-192.168.203.26@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788263229.296768:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+11:8697:x1875129699150848:12345-192.168.203.26@tcp:501:mount.lustre.0 Request processed in 344us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263229.296777:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 293 00000100:00100000:0.0:1788263229.312165:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263229.312408:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699150976 00000100:00100000:3.0:1788263229.312420:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699150976 00000100:00100000:3.0:1788263229.313168:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 294 00000100:00100000:3.0:1788263229.313181:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+11:8697:x1875129699150976:12345-192.168.203.26@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788263229.314237:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+11:8697:x1875129699150976:12345-192.168.203.26@tcp:503:mount.lustre.0 Request processed in 1052us (2074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263229.314264:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 294 00000100:00100000:0.0:1788263229.322561:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263229.322963:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699151104 00000100:00100000:2.0:1788263229.322974:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699151104 00000100:00100000:2.0:1788263229.323043:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 295 00000100:00100000:2.0:1788263229.323053:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+11:8701:x1875129699151104:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788263229.323220:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+11:8701:x1875129699151104:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 167us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263229.323229:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 295 00000100:00100000:1.0:1788263229.378890:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263229.379246:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699151232 00000100:00100000:2.0:1788263229.379262:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699151232 00000100:00100000:2.0:1788263229.379413:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 296 00000100:00100000:2.0:1788263229.379426:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+11:8701:x1875129699151232:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788263229.379656:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+11:8701:x1875129699151232:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 220us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263229.379666:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 296 00000100:00100000:0.0:1788263229.387813:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263229.388194:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699151360 00000100:00100000:3.0:1788263229.388205:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699151360 00000100:00100000:3.0:1788263229.388263:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 297 00000100:00100000:3.0:1788263229.388274:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+11:8701:x1875129699151360:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788263229.389178:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+11:8701:x1875129699151360:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 901us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263229.389189:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 297 00000100:00100000:0.0:1788263229.396512:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263229.396710:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699151488 00000100:00100000:3.0:1788263229.396719:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699151488 00000100:00100000:3.0:1788263229.396771:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 298 00000100:00100000:3.0:1788263229.396781:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+11:8697:x1875129699151488:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788263229.396797:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263229.396813:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff398eec000/0x4b1103cba666f47b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd405f293d116fd36 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263229.396852:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff398eec000/0x4b1103cba666f47b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd36 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263229.396864:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff398eec000/0x4b1103cba666f47b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd36 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263229.396874:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eec000, rc 0) 00000100:00100000:3.0:1788263229.396947:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+12:8697:x1875129699151488:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 167us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263229.396954:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 298 00000100:00100000:1.0:1788263229.399423:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263229.402604:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699151616 00000100:00100000:3.0:1788263229.402619:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699151616 00000100:00100000:2.0:1788263229.402861:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 299 00000100:00100000:2.0:1788263229.402876:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+12:8697:x1875129699151616:12345-192.168.203.26@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788263229.402910:0:6485:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788263229.402933:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788263229.402938:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788263229.402940:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788263229.402943:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788263229.402946:0:6485:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1788263229.407362:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+12:8697:x1875129699151616:12345-192.168.203.26@tcp:256:mount.lustre.0 Request processed in 4472us (7939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263229.407379:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 299 00000100:00100000:0.0:1788263229.414226:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263229.414911:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699151744 00000100:00100000:3.0:1788263229.414928:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699151744 00000100:00100000:3.0:1788263229.414982:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 300 00000100:00100000:3.0:1788263229.414991:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+12:8697:x1875129699151744:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788263229.415390:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263229.415416:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f482 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd405f293d116fd3d expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263229.416424:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f482 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd3d expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263229.416511:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f482 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd3d expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263229.416522:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eed600, rc 0) 00000100:00100000:3.0:1788263229.416621:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:8697:x1875129699151744:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 1630us (2422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263229.416630:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 300 00000100:00100000:1.0:1788263229.428632:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263229.431597:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699151872 00000100:00100000:3.0:1788263229.431612:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699151872 00000100:00100000:3.0:1788263229.431685:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 301 00000100:00100000:3.0:1788263229.431774:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:8697:x1875129699151872:12345-192.168.203.26@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788263229.434251:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:8697:x1875129699151872:12345-192.168.203.26@tcp:501:mount.lustre.0 Request processed in 2471us (5620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263229.434265:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 301 00000100:00100000:2.0:1788263229.459616:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263229.464909:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699152000 00000100:00100000:0.0:1788263229.464924:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699152000 00000100:00100000:0.0:1788263229.464991:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 302 00000100:00100000:0.0:1788263229.465001:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:8697:x1875129699152000:12345-192.168.203.26@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788263229.465153:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:8697:x1875129699152000:12345-192.168.203.26@tcp:503:mount.lustre.0 Request processed in 152us (5831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263229.465161:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 302 00000100:00100000:2.0:1788263229.470291:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263229.475769:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699152128 00000100:00100000:3.0:1788263229.475814:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699152128 00000100:00100000:3.0:1788263229.475985:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 303 00000100:00100000:3.0:1788263229.475998:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:8706:x1875129699152128:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788263229.476218:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:8706:x1875129699152128:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 223us (5937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263229.476227:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 303 00000100:00100000:1.0:1788263229.479878:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263229.479976:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699152256 00000100:00100000:0.0:1788263229.479987:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699152256 00000100:00100000:0.0:1788263229.480042:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 304 00000100:00100000:0.0:1788263229.480051:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:8706:x1875129699152256:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788263229.480202:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:8706:x1875129699152256:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 151us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263229.480216:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 304 00000100:00100000:2.0:1788263229.488776:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263229.488821:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263229.488845:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263229.488957:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263229.489048:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699153152 00000100:00100000:0.0:1788263229.489061:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699153152 00000100:00100000:0.0:1788263229.489140:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699153024 00000100:00100000:0.0:1788263229.489143:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699153024 00000100:00100000:0.0:1788263229.489159:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699152384 00000100:00100000:0.0:1788263229.489162:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699152384 00000100:00100000:0.0:1788263229.489172:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699152640 00000100:00100000:0.0:1788263229.489174:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699152640 00000100:00100000:0.0:1788263229.489187:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 129 00000100:00100000:0.0:1788263229.489198:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699153152:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263229.489300:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699153152:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 103us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263229.489310:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 129 00000100:00100000:0.0:1788263229.489332:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 130 00000100:00100000:0.0:1788263229.489340:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2387:x1875129699153024:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263229.489371:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:0.0:1788263229.489373:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2387:x1875129699153024:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 32us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263229.489386:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 130 00000100:00100000:3.0:1788263229.489399:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2385:x1875129699152384:12345-192.168.203.26@tcp:38:mount.lustre.0 00000100:00100000:0.0:1788263229.489414:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:0.0:1788263229.489421:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2385:x1875129699152640:12345-192.168.203.26@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788263229.489448:0:8884:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from d8481cd9-d282-4057-bab5-8c571435635f@192.168.203.26@tcp t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:0.0:1788263229.489494:0:8884:0:(genops.c:1385:class_connect()) connect: client d8481cd9-d282-4057-bab5-8c571435635f, cookie 0x4b1103cba666f489 00000004:00100000:0.0:1788263229.489528:0:8884:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00010000:00080000:3.0:1788263229.489556:0:6491:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from d8481cd9-d282-4057-bab5-8c571435635f@192.168.203.26@tcp t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:3.0:1788263229.489645:0:6491:0:(genops.c:1385:class_connect()) connect: client d8481cd9-d282-4057-bab5-8c571435635f, cookie 0x4b1103cba666f490 00000004:00100000:3.0:1788263229.489680:0:6491:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788263229.489731:0:8884:0:(import.c:65:import_set_state_nolock()) ffff9ff3bf638000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263229.489796:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8481cd9-d282-4057-bab5-8c571435635f+6:2385:x1875129699152640:12345-192.168.203.26@tcp:38:mount.lustre.0 Request processed in 371us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263229.489804:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00080000:3.0:1788263229.489824:0:6491:0:(import.c:65:import_set_state_nolock()) ffff9ff283211800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788263229.489918:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8481cd9-d282-4057-bab5-8c571435635f+6:2385:x1875129699152384:12345-192.168.203.26@tcp:38:mount.lustre.0 Request processed in 530us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263229.489927:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00080000:2.0:1788263229.491638:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788263229.491652:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788263229.499306:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263229.499354:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263229.499837:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263229.500720:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699152768 00000100:00100000:1.0:1788263229.500735:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699152768 00000100:00100000:1.0:1788263229.500805:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699152512 00000100:00100000:1.0:1788263229.500810:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699152512 00000100:00080000:2.0:1788263229.500831:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263229.500836:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699152896 00000100:00100000:1.0:1788263229.500850:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699152896 00000100:00080000:2.0:1788263229.500861:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788263229.500881:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:1.0:1788263229.500902:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+6:0:x1875129699152768:12345-192.168.203.26@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788263229.500937:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788263229.501042:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+6:0:x1875129699152768:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 146us (1745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263229.501051:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:3.0:1788263229.501079:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:3.0:1788263229.501168:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8481cd9-d282-4057-bab5-8c571435635f+7:0:x1875129699152512:12345-192.168.203.26@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788263229.501209:0:10388:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788263229.501275:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:1.0:1788263229.501292:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+7:8697:x1875129699152896:12345-192.168.203.26@tcp:41:mount.lustre.0 00000100:00100000:3.0:1788263229.501303:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8481cd9-d282-4057-bab5-8c571435635f+7:0:x1875129699152512:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 205us (1941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263229.501314:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 19 00000004:00000024:1.0:1788263229.501391:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788263229.501621:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+6:8697:x1875129699152896:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 296us (1745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263229.501646:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:2.0:1788263229.526152:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263229.526264:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699153280 00000100:00100000:3.0:1788263229.526274:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699153280 00000100:00100000:3.0:1788263229.526345:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:3.0:1788263229.526355:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8481cd9-d282-4057-bab5-8c571435635f+6:8697:x1875129699153280:12345-192.168.203.26@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788263229.526657:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8481cd9-d282-4057-bab5-8c571435635f+6:8697:x1875129699153280:12345-192.168.203.26@tcp:40:mount.lustre.0 Request processed in 290us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263229.526665:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:2.0:1788263229.542035:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263229.542096:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263229.542257:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263229.542316:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699153664 00000100:00100000:3.0:1788263229.542330:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699153664 00000100:00100000:3.0:1788263229.542422:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:3.0:1788263229.542457:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d8481cd9-d282-4057-bab5-8c571435635f+6:8697:x1875129699153664:12345-192.168.203.26@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788263229.542640:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d8481cd9-d282-4057-bab5-8c571435635f+6:8697:x1875129699153664:12345-192.168.203.26@tcp:900:mount.lustre.0 Request processed in 207us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263229.542651:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:0.0:1788263229.549387:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699153408 00000100:00100000:0.0:1788263229.549412:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699153408 00000100:00100000:3.0:1788263229.550094:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699153536 00000100:00100000:3.0:1788263229.550101:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699153536 00000100:00100000:3.0:1788263229.551085:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:3.0:1788263229.551099:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2385:x1875129699153536:12345-192.168.203.26@tcp:8:mount.lustre.0 00000100:00100000:2.0:1788263229.551339:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263229.551376:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699153792 00000100:00100000:2.0:1788263229.551381:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699153792 00000100:00100000:2.0:1788263229.551427:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1 00000100:00100000:2.0:1788263229.551435:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8481cd9-d282-4057-bab5-8c571435635f+6:8697:x1875129699153792:12345-192.168.203.26@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788263229.551681:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788263229.551780:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8481cd9-d282-4057-bab5-8c571435635f+6:8697:x1875129699153792:12345-192.168.203.26@tcp:33:mount.lustre.0 Request processed in 345us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263229.551789:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1 00000100:00100000:1.0:1788263229.551937:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:1.0:1788263229.551949:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2385:x1875129699153408:12345-192.168.203.26@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788263229.551984:0:8404:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from d8481cd9-d282-4057-bab5-8c571435635f@192.168.203.26@tcp t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:1.0:1788263229.552015:0:8404:0:(genops.c:1385:class_connect()) connect: client d8481cd9-d282-4057-bab5-8c571435635f, cookie 0x4b1103cba666f497 00002000:00100000:1.0:1788263229.552028:0:8404:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d8481cd9-d282-4057-bab5-8c571435635f/ffff9ff3b5609000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00010000:00080000:3.0:1788263229.552041:0:9885:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d8481cd9-d282-4057-bab5-8c571435635f@192.168.203.26@tcp t0 exp 0000000000000000 cur 238 last 0 00002000:00100000:1.0:1788263229.552041:0:8404:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000080:3.0:1788263229.552087:0:9885:0:(genops.c:1385:class_connect()) connect: client d8481cd9-d282-4057-bab5-8c571435635f, cookie 0x4b1103cba666f49e 00002000:00100000:3.0:1788263229.552098:0:9885:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d8481cd9-d282-4057-bab5-8c571435635f/ffff9ff283215000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788263229.552120:0:9885:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788263229.552138:0:8404:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788263229.552173:0:8404:0:(import.c:65:import_set_state_nolock()) ffff9ff3b560d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788263229.552239:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8481cd9-d282-4057-bab5-8c571435635f+6:2385:x1875129699153408:12345-192.168.203.26@tcp:8:mount.lustre.0 Request processed in 286us (10138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263229.552248:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 21 00002000:00080000:3.0:1788263229.552885:0:9885:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788263229.552930:0:9885:0:(import.c:65:import_set_state_nolock()) ffff9ff283210800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788263229.552983:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8481cd9-d282-4057-bab5-8c571435635f+6:2385:x1875129699153536:12345-192.168.203.26@tcp:8:mount.lustre.0 Request processed in 1886us (10727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263229.552993:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 20 00010000:00010000:0.0:1788263230.128144:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263230.516402:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28329b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709712640:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788263230.516473:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263230.516657:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709712640 00000100:00100000:3.0:1788263230.516679:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709712640 00000100:00100000:3.0:1788263230.516739:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788263230.516748:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709712640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788263230.516786:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788263230.516828:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709712640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263230.516835:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788263230.517065:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28329b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709712640:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788263230.521364:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709712768:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788263230.521447:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263230.522460:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709712768 00000100:00100000:0.0:1788263230.522475:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709712768 00000100:00100000:0.0:1788263230.522566:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788263230.522632:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709712768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788263230.522681:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788263230.522790:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709712768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 163us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263230.522799:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788263230.523021:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709712768:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788263231.154112:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263232.049424:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788263232.049455:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709712896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263232.049551:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263232.050723:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709712896 00000100:00100000:0.0:1788263232.050749:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709712896 00000100:00100000:0.0:1788263232.050836:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788263232.050850:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709712896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263232.050905:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263232.051009:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709712896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (1458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263232.051017:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1788263232.051076:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28312f800 x1875129709712896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263232.051099:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709712896:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788263232.051279:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788263232.053348:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709713280:0@lo:400:kworker.0 00000100:00100000:2.0:1788263232.053439:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263232.053487:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875129709713792:0@lo:400:kworker.0 00000100:00100000:2.0:1788263232.053525:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263232.053551:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709714304:0@lo:400:kworker.0 00000100:00100000:2.0:1788263232.053572:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263232.053630:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788263232.053636:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709713152:0@lo:400:kworker.0 00000100:00100000:2.0:1788263232.053660:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263232.053678:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875129709713664:0@lo:400:kworker.0 00000100:00100000:2.0:1788263232.053699:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263232.053714:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875129709714176:0@lo:400:kworker.0 00000100:00100000:2.0:1788263232.053733:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263232.053841:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709713408:0@lo:400:kworker.0 00000100:00100000:0.0:1788263232.053955:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709713024:0@lo:400:kworker.0 00000100:00100000:0.0:1788263232.054013:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263232.054042:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709713536:0@lo:400:kworker.0 00000100:00100000:0.0:1788263232.054071:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263232.054088:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709714048:0@lo:400:kworker.0 00000100:00100000:0.0:1788263232.054111:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263232.054151:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709713280 00000100:00100000:0.0:1788263232.054159:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709713280 00000100:00100000:0.0:1788263232.054201:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709713536 00000100:00100000:0.0:1788263232.054204:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709713536 00000100:00100000:0.0:1788263232.054223:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788263232.054233:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709713280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263232.054294:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709713280:12345-0@lo:400:kworker.0 Request processed in 62us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263232.054302:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788263232.054320:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788263232.054325:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b016c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709713536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263232.054359:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b016c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709713536:12345-0@lo:400:kworker.0 Request processed in 33us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263232.054365:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788263232.055942:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709713280:0@lo:400:kworker.0 00000100:00100000:3.0:1788263232.057657:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709713792 00000100:00100000:3.0:1788263232.057670:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709713792 00000100:00100000:3.0:1788263232.058431:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263232.058489:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709713920:0@lo:400:kworker.0 00000100:00100000:3.0:1788263232.058564:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263232.058615:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709714432:0@lo:400:kworker.0 00000100:00100000:3.0:1788263232.058640:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788263232.058715:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788263232.062230:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709714304 00000100:00100000:3.0:1788263232.062251:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709714304 00000100:00080000:3.0:1788263232.062319:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788263232.062348:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709713152 00000100:00100000:3.0:1788263232.062352:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709713152 00000100:00100000:3.0:1788263232.062368:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709713664 00000100:00100000:3.0:1788263232.062371:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709713664 00000100:00080000:3.0:1788263232.062386:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263232.062399:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709714176 00000100:00100000:3.0:1788263232.062402:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709714176 00000100:00080000:3.0:1788263232.062412:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263232.062423:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709713408 00000100:00100000:3.0:1788263232.062426:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709713408 00000100:00100000:3.0:1788263232.062471:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788263232.062481:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875129709713792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263232.062635:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875129709713792:12345-0@lo:400:kworker.0 Request processed in 155us (9108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263232.062644:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788263232.062667:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788263232.062674:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875129709714304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263232.062706:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875129709714304:12345-0@lo:400:kworker.0 Request processed in 33us (9132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263232.062712:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788263232.062724:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788263232.062730:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709713152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263232.062929:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709713152:12345-0@lo:400:kworker.0 Request processed in 198us (9267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263232.062937:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788263232.062951:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788263232.062957:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875129709713664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263232.063063:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875129709713664:12345-0@lo:400:kworker.0 Request processed in 30us (9286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263232.063071:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788263232.063085:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788263232.063139:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875129709714176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263232.063175:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875129709714176:12345-0@lo:400:kworker.0 Request processed in 85us (9441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263232.063182:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788263232.063210:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788263232.063216:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28329a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709713408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263232.063257:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28329a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709713408:12345-0@lo:400:kworker.0 Request processed in 42us (4831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263232.063263:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788263232.063318:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709713408:0@lo:400:kworker.0 00000100:00100000:3.0:1788263232.063365:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709713152:0@lo:400:kworker.0 00000100:00100000:3.0:1788263232.063379:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875129709713664:0@lo:400:kworker.0 00000100:00100000:3.0:1788263232.063391:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875129709714176:0@lo:400:kworker.0 00010000:00080000:3.0:1788263232.063408:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833d8e00 x1875129709713792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263232.063420:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875129709713792:0@lo:400:kworker.0 00010000:00080000:3.0:1788263232.063432:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6dbb80 x1875129709714304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263232.063440:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709714304:0@lo:400:kworker.0 00000100:00100000:1.0:1788263232.063609:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709714048 00000100:00100000:1.0:1788263232.063617:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709714048 00000100:00100000:1.0:1788263232.063665:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709713920 00000100:00100000:1.0:1788263232.063668:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709713920 00000100:00100000:1.0:1788263232.063684:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709714432 00000100:00100000:1.0:1788263232.063687:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709714432 00000100:00100000:1.0:1788263232.063702:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788263232.063708:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709714048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263232.063766:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709714048:12345-0@lo:400:kworker.0 Request processed in 58us (9654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263232.063773:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788263232.063793:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788263232.063799:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709713920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263232.063835:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709713920:12345-0@lo:400:kworker.0 Request processed in 36us (5271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263232.063841:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788263232.063851:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788263232.063857:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28329ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709714432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263232.063899:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28329ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709714432:12345-0@lo:400:kworker.0 Request processed in 42us (5258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263232.063905:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1788263232.063921:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788263232.063926:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788263232.063950:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833d8700 x1875129709713920/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263232.063961:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709713920:0@lo:400:kworker.0 00010000:00080000:1.0:1788263232.063975:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6d9500 x1875129709714432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263232.063983:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709714432:0@lo:400:kworker.0 00000100:00100000:0.0:1788263232.064781:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709713024 00000100:00100000:0.0:1788263232.064790:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709713024 00000100:00100000:0.0:1788263232.064839:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788263232.064848:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3621:x1875129709713024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263232.064919:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3621:x1875129709713024:12345-0@lo:400:kworker.0 Request processed in 72us (10905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263232.064927:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788263232.065020:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709713024:0@lo:400:kworker.0 00000100:00100000:0.0:1788263232.065037:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709713536:0@lo:400:kworker.0 00010000:00080000:0.0:1788263232.065051:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833d9f80 x1875129709714048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263232.065061:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709714048:0@lo:400:kworker.0 00010000:00010000:0.0:1788263232.185530:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263232.560149:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788263232.560460:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709714560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788263232.560555:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263232.561032:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709714560 00000100:00100000:2.0:1788263232.561043:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709714560 00000100:00100000:2.0:1788263232.561259:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788263232.561271:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28329b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709714560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788263232.561302:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263232.561374:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28329b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709714560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263232.561382:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1788263232.561460:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6cd180 x1875129709714560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263232.561483:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709714560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788263233.075682:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709714688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788263233.075759:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263233.076692:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709714688 00000100:00100000:3.0:1788263233.076702:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709714688 00000100:00100000:3.0:1788263233.076750:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788263233.076760:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28329b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709714688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788263233.076978:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263233.077037:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28329b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709714688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 278us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263233.077045:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1788263233.077087:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6d8a80 x1875129709714688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263233.077106:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709714688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788263233.083940:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709714816:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788263233.084020:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263233.084100:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709714816 00000100:00100000:3.0:1788263233.084109:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709714816 00000100:00100000:3.0:1788263233.084155:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788263233.084166:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283298380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709714816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788263233.084202:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263233.084253:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283298380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709714816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263233.084261:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1788263233.084305:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6cf480 x1875129709714816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263233.084325:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709714816:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788263233.201935:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263234.224486:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263234.679279:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263234.679326:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263234.679358:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263234.679400:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263234.679420:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263234.679437:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263234.679457:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263234.679506:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699154560 00000100:00100000:1.0:1788263234.679515:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699154560 00000100:00100000:3.0:1788263234.679656:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699154048 00000100:00100000:3.0:1788263234.679661:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699154048 00000100:00100000:3.0:1788263234.679704:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699154304 00000100:00100000:3.0:1788263234.679707:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699154304 00000100:00100000:3.0:1788263234.679721:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699154176 00000100:00100000:3.0:1788263234.679724:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699154176 00000100:00100000:3.0:1788263234.679734:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699154432 00000100:00100000:3.0:1788263234.679737:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699154432 00000100:00100000:3.0:1788263234.679752:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 137 00000100:00100000:3.0:1788263234.679761:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2389:x1875129699154048:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263234.679833:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2389:x1875129699154048:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 72us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263234.679841:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 137 00000100:00100000:3.0:1788263234.679867:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 138 00000100:00100000:3.0:1788263234.679875:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8481cd9-d282-4057-bab5-8c571435635f+6:2389:x1875129699154304:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263234.679901:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8481cd9-d282-4057-bab5-8c571435635f+6:2389:x1875129699154304:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 27us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263234.679907:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 138 00000100:00100000:3.0:1788263234.679918:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 139 00000100:00100000:3.0:1788263234.679924:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2389:x1875129699154176:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263234.679945:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2389:x1875129699154176:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 22us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263234.679951:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 139 00000100:00100000:3.0:1788263234.679960:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 140 00000100:00100000:3.0:1788263234.679966:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8481cd9-d282-4057-bab5-8c571435635f+6:2389:x1875129699154432:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263234.680002:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8481cd9-d282-4057-bab5-8c571435635f+6:2389:x1875129699154432:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 36us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263234.680009:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 140 00000100:00080000:3.0:1788263234.680048:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788263234.680052:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788263234.680054:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788263234.680203:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699153920 00000100:00100000:0.0:1788263234.680208:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699153920 00000100:00100000:0.0:1788263234.680244:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 306 00000100:00100000:0.0:1788263234.680251:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2389:x1875129699153920:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263234.680279:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2389:x1875129699153920:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 30us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263234.680285:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 306 00000100:00100000:2.0:1788263234.680555:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699154688 00000100:00100000:2.0:1788263234.680560:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699154688 00000100:00100000:2.0:1788263234.680647:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:2.0:1788263234.680655:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8481cd9-d282-4057-bab5-8c571435635f+6:2389:x1875129699154688:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263234.680689:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8481cd9-d282-4057-bab5-8c571435635f+6:2389:x1875129699154688:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 35us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263234.680708:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00080000:0.0:1788263234.681019:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788263234.685975:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:1.0:1788263234.686001:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8481cd9-d282-4057-bab5-8c571435635f+6:2389:x1875129699154560:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263234.686082:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8481cd9-d282-4057-bab5-8c571435635f+6:2389:x1875129699154560:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 95us (6723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263234.686090:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 60 00000001:00100000:0.0:1788263235.123985:0:7422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d8481cd9-d282-4057-bab5-8c571435635f 00000001:00100000:0.0:1788263235.124567:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d8481cd9-d282-4057-bab5-8c571435635f 00000001:00100000:2.0:1788263235.124962:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d8481cd9-d282-4057-bab5-8c571435635f 00000001:00100000:1.0:1788263235.125533:0:6470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d8481cd9-d282-4057-bab5-8c571435635f 00010000:00010000:0.0:1788263235.248910:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263235.632009:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709715072:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788263235.632080:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263235.632147:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788263235.632153:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709714944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788263235.632177:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263235.632276:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709715072 00000100:00100000:2.0:1788263235.632285:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709715072 00000100:00100000:2.0:1788263235.632318:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709714944 00000100:00100000:2.0:1788263235.632321:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709714944 00000100:00100000:2.0:1788263235.632333:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788263235.632342:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5402300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709715072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788263235.632373:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788263235.632426:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5402300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709715072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263235.632433:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788263235.632450:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788263235.632456:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709714944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788263235.632471:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788263235.632496:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709714944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 41us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263235.632502:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788263235.632609:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709714944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788263235.632625:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709715072:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788263236.273554:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788263237.065113:0:12161:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1788263237.171408:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788263237.171808:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28329b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709715456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788263237.171888:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263237.171957:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709715456 00000100:00100000:3.0:1788263237.171964:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709715456 00000100:00100000:3.0:1788263237.172028:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788263237.172037:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709715456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788263237.172064:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263237.172106:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709715456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263237.172112:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1788263237.172132:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788263237.172171:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28329b800 x1875129709715456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263237.172188:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28329b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709715456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263237.175439:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5401f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709715328:0@lo:400:kworker.0 00000100:00100000:2.0:1788263237.175517:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263237.175570:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709715200:0@lo:400:kworker.0 00000100:00100000:2.0:1788263237.175618:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263237.175756:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709715328 00000100:00100000:1.0:1788263237.175764:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709715328 00000100:00100000:1.0:1788263237.175819:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788263237.175828:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709715328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263237.175897:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709715328:12345-0@lo:400:kworker.0 Request processed in 70us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263237.175904:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788263237.175943:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5401f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709715328:0@lo:400:kworker.0 00000100:00100000:0.0:1788263237.176624:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709715200 00000100:00100000:0.0:1788263237.176631:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709715200 00000100:00100000:0.0:1788263237.176677:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788263237.176686:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3619:x1875129709715200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263237.176740:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3619:x1875129709715200:12345-0@lo:400:kworker.0 Request processed in 56us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263237.176747:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788263237.176787:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709715200:0@lo:400:kworker.0 00000100:00100000:0.0:1788263237.182060:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709715584:0@lo:400:kworker.0 00000100:00100000:0.0:1788263237.182129:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263237.182278:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709715712:0@lo:400:kworker.0 00000100:00100000:1.0:1788263237.182308:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263237.182361:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788263237.182368:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709715840:0@lo:400:kworker.0 00000100:00100000:1.0:1788263237.182391:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263237.182542:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709715584 00000100:00100000:1.0:1788263237.182549:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709715584 00000100:00100000:1.0:1788263237.182604:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709715840 00000100:00100000:1.0:1788263237.182607:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709715840 00000100:00100000:1.0:1788263237.182640:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788263237.182647:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709715584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263237.184696:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709715712 00000100:00100000:2.0:1788263237.184707:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709715712 00000100:00100000:2.0:1788263237.184751:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788263237.184766:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709715712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263237.184853:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709715712:12345-0@lo:400:kworker.0 Request processed in 89us (2544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263237.184860:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788263237.184911:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709715712:0@lo:400:kworker.0 00000100:00100000:1.0:1788263237.185614:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709715584:12345-0@lo:400:kworker.0 Request processed in 2964us (3483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263237.185623:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788263237.185644:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788263237.185652:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709715840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263237.185714:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709715840:12345-0@lo:400:kworker.0 Request processed in 64us (3322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263237.185720:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788263237.185820:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709715840:0@lo:400:kworker.0 00000100:00100000:0.0:1788263237.192384:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709715584:0@lo:400:kworker.0 00000100:00100000:3.0:1788263237.192830:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709716224:0@lo:400:kworker.0 00000100:00100000:3.0:1788263237.192903:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263237.192937:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709716736:0@lo:400:kworker.0 00000100:00100000:3.0:1788263237.192958:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263237.192983:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788263237.192988:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709716352:0@lo:400:kworker.0 00000100:00100000:3.0:1788263237.193021:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263237.193047:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709715968:0@lo:400:kworker.0 00000100:00100000:3.0:1788263237.193072:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263237.193091:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875129709716480:0@lo:400:kworker.0 00000100:00100000:3.0:1788263237.193109:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263237.193127:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788263237.193132:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709716096:0@lo:400:kworker.0 00000100:00100000:3.0:1788263237.193153:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263237.193182:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875129709716608:0@lo:400:kworker.0 00000100:00100000:3.0:1788263237.193202:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263237.193230:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709715968 00000100:00100000:3.0:1788263237.193235:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709715968 00000100:00100000:3.0:1788263237.193280:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709716480 00000100:00100000:3.0:1788263237.193283:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709716480 00000100:00100000:3.0:1788263237.193295:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709716096 00000100:00100000:3.0:1788263237.193297:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709716096 00000100:00100000:3.0:1788263237.193307:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709716608 00000100:00100000:3.0:1788263237.193309:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709716608 00000100:00100000:3.0:1788263237.193322:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788263237.193328:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709715968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263237.193376:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709715968:12345-0@lo:400:kworker.0 Request processed in 48us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263237.193383:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788263237.193398:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788263237.193403:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875129709716480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263237.193459:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875129709716480:12345-0@lo:400:kworker.0 Request processed in 55us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263237.193465:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788263237.193476:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788263237.193482:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28329a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709716096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263237.193558:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28329a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709716096:12345-0@lo:400:kworker.0 Request processed in 76us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263237.193563:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788263237.193606:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788263237.193621:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875129709716608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263237.193656:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875129709716608:12345-0@lo:400:kworker.0 Request processed in 44us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263237.193667:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:3.0:1788263237.193692:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788263237.193695:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788263237.193726:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6ce680 x1875129709716096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263237.193739:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709716096:0@lo:400:kworker.0 00010000:00080000:3.0:1788263237.193748:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff282fdc380 x1875129709716608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263237.193756:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875129709716608:0@lo:400:kworker.0 00000100:00100000:3.0:1788263237.193766:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709715968:0@lo:400:kworker.0 00000100:00100000:3.0:1788263237.193773:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875129709716480:0@lo:400:kworker.0 00000100:00100000:0.0:1788263237.194119:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709716224 00000100:00100000:0.0:1788263237.194124:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709716224 00000100:00100000:0.0:1788263237.194169:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709716736 00000100:00100000:0.0:1788263237.194172:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709716736 00000100:00100000:0.0:1788263237.194188:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709716352 00000100:00100000:0.0:1788263237.194190:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709716352 00000100:00100000:0.0:1788263237.194202:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788263237.194208:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28329b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709716224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263237.194251:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28329b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709716224:12345-0@lo:400:kworker.0 Request processed in 43us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263237.194257:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788263237.194268:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788263237.194274:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28329bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709716736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263237.194299:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28329bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709716736:12345-0@lo:400:kworker.0 Request processed in 26us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263237.194311:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788263237.194321:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788263237.194327:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709716352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263237.194355:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709716352:12345-0@lo:400:kworker.0 Request processed in 28us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263237.194361:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1788263237.194381:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788263237.194383:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788263237.194402:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6ce300 x1875129709716352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263237.194424:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709716352:0@lo:400:kworker.0 00010000:00080000:0.0:1788263237.194435:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6cc700 x1875129709716224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263237.194443:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709716224:0@lo:400:kworker.0 00010000:00080000:0.0:1788263237.194451:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff282fddc00 x1875129709716736/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263237.194459:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709716736:0@lo:400:kworker.0 00010000:00010000:0.0:1788263237.306823:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263237.680031:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709716864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788263237.680181:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263237.686266:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709716864 00000100:00100000:3.0:1788263237.686282:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709716864 00000100:00100000:3.0:1788263237.686499:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788263237.686511:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709716864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788263237.686543:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263237.695277:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709716864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 8761us (15088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263237.695302:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1788263237.696251:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff282fdd500 x1875129709716864/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263237.696275:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709716864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788263238.195158:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709716992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263238.195251:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263238.195345:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709716992 00000100:00100000:1.0:1788263238.195354:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709716992 00000100:00100000:1.0:1788263238.195410:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788263238.195420:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709716992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788263238.195471:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263238.195524:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709716992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263238.195532:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1788263238.195684:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff282fdd500 x1875129709716992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263238.195707:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709716992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263238.197504:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788263238.197527:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709717120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788263238.197625:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263238.197686:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709717120 00000100:00100000:0.0:1788263238.197694:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709717120 00000100:00100000:0.0:1788263238.197741:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788263238.197751:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709717120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788263238.197774:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263238.197819:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709717120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263238.197826:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1788263238.197880:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6d8000 x1875129709717120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263238.197900:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709717120:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788263238.319900:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263239.343839:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263239.823343:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263239.823394:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263239.823416:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263239.823436:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263239.823458:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263239.823477:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263239.823505:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263239.823539:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699154816 00000100:00100000:0.0:1788263239.823550:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699154816 00000100:00100000:0.0:1788263239.823634:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 308 00000100:00100000:0.0:1788263239.823647:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2386:x1875129699154816:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263239.823747:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2386:x1875129699154816:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 103us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263239.823756:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 308 00000100:00100000:0.0:1788263239.823797:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699154944 00000100:00100000:0.0:1788263239.823801:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699154944 00000100:00100000:0.0:1788263239.823852:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699155072 00000100:00100000:0.0:1788263239.823855:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699155072 00000100:00100000:0.0:1788263239.823868:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699155328 00000100:00100000:0.0:1788263239.823871:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699155328 00000100:00100000:0.0:1788263239.823888:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699155200 00000100:00100000:0.0:1788263239.823891:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699155200 00000100:00100000:0.0:1788263239.823905:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 147 00000100:00100000:0.0:1788263239.823912:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2387:x1875129699154944:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263239.823946:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2387:x1875129699154944:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 36us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263239.823952:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 147 00000100:00100000:0.0:1788263239.823964:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 148 00000100:00100000:0.0:1788263239.823970:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699155072:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263239.823992:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699155072:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 23us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263239.823998:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 148 00000100:00100000:0.0:1788263239.824008:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 149 00000100:00100000:0.0:1788263239.824014:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699155328:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263239.824036:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699155328:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 22us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263239.824052:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 149 00000100:00100000:0.0:1788263239.824064:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 150 00000100:00100000:0.0:1788263239.824070:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699155200:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263239.824094:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699155200:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 25us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263239.824099:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 150 00000100:00100000:0.0:1788263239.824121:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699155584 00000100:00100000:0.0:1788263239.824124:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699155584 00000100:00100000:0.0:1788263239.824150:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699155456 00000100:00100000:0.0:1788263239.824153:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699155456 00000100:00100000:0.0:1788263239.824175:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:0.0:1788263239.824182:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699155584:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263239.824213:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699155584:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 32us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263239.824219:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:0.0:1788263239.824230:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:0.0:1788263239.824236:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699155456:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263239.824261:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699155456:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 25us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263239.824268:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00080000:0.0:1788263239.824293:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788263239.824298:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788263239.824301:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788263239.824303:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788263240.371294:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263240.751796:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788263240.751826:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709717248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788263240.751892:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263240.751960:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709717248 00000100:00100000:0.0:1788263240.751968:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709717248 00000100:00100000:0.0:1788263240.752013:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788263240.752022:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709717248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788263240.752394:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788263240.752449:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709717248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 427us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263240.752457:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788263240.752704:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709717248:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788263240.756295:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709717376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788263240.756363:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263240.756895:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709717376 00000100:00100000:2.0:1788263240.756903:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709717376 00000100:00100000:2.0:1788263240.756956:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788263240.756967:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28329aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709717376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788263240.756998:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788263240.770543:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28329aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709717376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 13568us (14169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263240.770569:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788263240.770954:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709717376:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788263241.391896:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263242.287962:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788263242.287986:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709717504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788263242.288054:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263242.288148:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709717504 00000100:00100000:0.0:1788263242.288157:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709717504 00000100:00100000:0.0:1788263242.288216:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788263242.288225:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bd504450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709717504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263242.288252:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263242.288298:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bd504450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709717504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263242.288305:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:0.0:1788263242.288492:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283327480 x1875129709717504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263242.288511:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709717504:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788263242.288601:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788263242.289678:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709718016:0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.289729:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263242.289771:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709718528:0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.289794:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263242.289821:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709719040:0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.289840:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263242.289858:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788263242.289863:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709717632:0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.289888:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263242.289908:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709718144:0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.289929:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263242.289946:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709718656:0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.289967:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263242.289990:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709717760:0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.290011:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263242.290028:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709718272:0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.290046:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263242.290062:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875129709718784:0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.290080:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263242.290096:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788263242.290101:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709717888:0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.290121:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263242.290138:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709718400:0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.290157:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263242.290173:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709718912:0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.290191:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263242.290227:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709718144 00000100:00100000:1.0:1788263242.290233:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709718144 00000100:00100000:1.0:1788263242.290262:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709717888 00000100:00100000:1.0:1788263242.290265:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709717888 00000100:00100000:1.0:1788263242.290280:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788263242.290288:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709718144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.290337:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709718144:12345-0@lo:400:kworker.0 Request processed in 50us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263242.290344:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788263242.290359:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788263242.290365:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709717888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.290395:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709717888:12345-0@lo:400:kworker.0 Request processed in 30us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263242.290401:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788263242.290417:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709718016 00000100:00100000:1.0:1788263242.290421:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709718016 00000100:00100000:1.0:1788263242.290437:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709717760 00000100:00100000:1.0:1788263242.290440:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709717760 00000100:00100000:1.0:1788263242.290449:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709718272 00000100:00100000:1.0:1788263242.290452:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709718272 00000100:00100000:1.0:1788263242.290471:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709718784 00000100:00100000:1.0:1788263242.290474:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709718784 00000100:00100000:1.0:1788263242.290486:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709718400 00000100:00100000:1.0:1788263242.290488:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709718400 00000100:00100000:1.0:1788263242.290499:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709718912 00000100:00100000:1.0:1788263242.290501:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709718912 00000100:00100000:1.0:1788263242.290515:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788263242.290521:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709718016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.290549:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709718016:12345-0@lo:400:kworker.0 Request processed in 29us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263242.290565:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788263242.290600:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788263242.290607:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709717760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.290635:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709717760:12345-0@lo:400:kworker.0 Request processed in 30us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263242.290641:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788263242.290651:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788263242.290656:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709718272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.290679:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709718272:12345-0@lo:400:kworker.0 Request processed in 23us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263242.290684:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788263242.290693:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788263242.290698:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875129709718784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.290718:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875129709718784:12345-0@lo:400:kworker.0 Request processed in 21us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263242.290723:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788263242.290732:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788263242.290737:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709718400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.290757:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709718400:12345-0@lo:400:kworker.0 Request processed in 20us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263242.290761:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788263242.290770:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788263242.290774:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875129709718912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.290794:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875129709718912:12345-0@lo:400:kworker.0 Request processed in 20us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263242.290818:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:1.0:1788263242.290836:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788263242.290839:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263242.290866:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709717888:0@lo:400:kworker.0 00010000:00080000:1.0:1788263242.290878:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff282fdd500 x1875129709718400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263242.290888:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709718400:0@lo:400:kworker.0 00010000:00080000:1.0:1788263242.290897:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5471880 x1875129709718912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263242.290905:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709718912:0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.290914:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709717760:0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.290922:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709718272:0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.290930:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875129709718784:0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.290972:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709718144:0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.290981:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709718016:0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.291351:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709717632 00000100:00100000:1.0:1788263242.291357:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709717632 00000100:00100000:1.0:1788263242.291396:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788263242.291403:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3620:x1875129709717632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.291490:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3620:x1875129709717632:12345-0@lo:400:kworker.0 Request processed in 88us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263242.291496:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788263242.291530:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709718528 00000100:00100000:1.0:1788263242.291534:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709718528 00000100:00100000:1.0:1788263242.291574:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709719040 00000100:00100000:1.0:1788263242.291596:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709719040 00000100:00100000:1.0:1788263242.291611:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709718656 00000100:00100000:1.0:1788263242.291613:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709718656 00000100:00100000:1.0:1788263242.291624:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788263242.291629:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5472680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709718528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.291914:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5472680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709718528:12345-0@lo:400:kworker.0 Request processed in 282us (2117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263242.291920:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788263242.291932:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788263242.291938:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709719040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.291965:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709719040:12345-0@lo:400:kworker.0 Request processed in 27us (2124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263242.291970:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788263242.291980:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788263242.291985:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709718656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263242.292013:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709718656:12345-0@lo:400:kworker.0 Request processed in 28us (2046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263242.292018:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1788263242.292040:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788263242.292044:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788263242.296830:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709717632:0@lo:400:kworker.0 00010000:00080000:2.0:1788263242.297251:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5472a00 x1875129709718656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263242.297265:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709718656:0@lo:400:kworker.0 00010000:00080000:2.0:1788263242.297280:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5471500 x1875129709718528/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263242.297289:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709718528:0@lo:400:kworker.0 00010000:00080000:2.0:1788263242.297301:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5473100 x1875129709719040/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263242.297309:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709719040:0@lo:400:kworker.0 00010000:00010000:2.0:1788263242.425732:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263242.800166:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788263242.800199:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709719168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788263242.800260:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263242.800419:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709719168 00000100:00100000:1.0:1788263242.800427:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709719168 00000100:00100000:1.0:1788263242.800473:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788263242.800481:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709719168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788263242.800501:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263242.800553:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709719168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263242.800560:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1788263242.800962:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3a0f6c700 x1875129709719168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263242.800982:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709719168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788263243.311793:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709719296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788263243.311873:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263243.311940:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788263243.311946:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709719424:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788263243.311969:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263243.312005:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709719296 00000100:00100000:1.0:1788263243.312013:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709719296 00000100:00100000:1.0:1788263243.312075:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709719424 00000100:00100000:1.0:1788263243.312079:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709719424 00000100:00100000:1.0:1788263243.312095:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788263243.312104:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28329b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709719296:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788263243.312114:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788263243.312121:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28329b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709719424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788263243.312131:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1788263243.312140:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263243.312181:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28329b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709719424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263243.312189:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788263243.319263:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28329b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709719296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7149us (7380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263243.319286:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:3.0:1788263243.319647:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283327480 x1875129709719424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263243.319670:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709719424:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1788263243.319690:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3a0f6f100 x1875129709719296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263243.319701:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709719296:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788263243.449680:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263244.465606:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263244.914993:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263244.915144:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699155712 00000100:00100000:1.0:1788263244.915155:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699155712 00000100:00100000:1.0:1788263244.915215:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 310 00000100:00100000:1.0:1788263244.915225:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2387:x1875129699155712:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263244.915298:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2387:x1875129699155712:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 74us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263244.915306:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 310 00000100:00100000:0.0:1788263244.922307:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263244.922348:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263244.922398:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699155840 00000100:00100000:1.0:1788263244.922408:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699155840 00000100:00100000:1.0:1788263244.922474:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699155968 00000100:00100000:1.0:1788263244.922477:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699155968 00000100:00100000:1.0:1788263244.922499:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 157 00000100:00100000:1.0:1788263244.922508:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2387:x1875129699155840:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263244.922620:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2387:x1875129699155840:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 112us (321us total) trans 0 rc 0/0 00000100:00080000:0.0:1788263244.922718:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788263244.922733:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263244.922750:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 158 00000100:00100000:0.0:1788263244.922760:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699155968:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263244.922803:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699155968:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 44us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263244.922812:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 158 00000100:00100000:1.0:1788263244.923261:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 157 00000100:00100000:2.0:1788263244.935420:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263244.935473:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263244.935505:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263244.935556:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699156096 00000100:00100000:1.0:1788263244.935566:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699156096 00000100:00100000:2.0:1788263244.935598:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263244.935665:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699156224 00000100:00100000:1.0:1788263244.935669:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699156224 00000100:00100000:1.0:1788263244.935696:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 159 00000100:00100000:1.0:1788263244.935707:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699156096:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263244.935774:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699156096:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 69us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263244.935793:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 159 00000100:00100000:1.0:1788263244.935811:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 160 00000100:00100000:1.0:1788263244.935817:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699156224:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263244.935847:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699156224:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 30us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263244.935854:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 160 00000100:00100000:1.0:1788263244.935873:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699156352 00000100:00100000:1.0:1788263244.935877:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699156352 00000100:00100000:1.0:1788263244.935981:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699156480 00000100:00100000:1.0:1788263244.935986:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699156480 00000100:00100000:1.0:1788263244.936010:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 69 00000100:00100000:1.0:1788263244.936017:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699156352:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263244.936038:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 70 00000100:00100000:1.0:1788263244.936048:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699156352:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 31us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263244.936051:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699156480:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263244.936063:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 69 00000100:00100000:2.0:1788263244.936091:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699156480:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 44us (493us total) trans 0 rc 0/0 00000100:00080000:1.0:1788263244.936093:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788263244.936098:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 70 00000100:00080000:1.0:1788263244.936113:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788263244.936116:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788263244.936119:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000004:0.0:1788263245.450180:0:12477:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788263245.450401:0:12477:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788263245.501174:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263245.873174:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709719552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788263245.873296:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263245.878045:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709719680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788263245.878091:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709719552 00000100:00100000:1.0:1788263245.878099:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709719552 00000100:00100000:2.0:1788263245.878116:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263245.878140:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709719680 00000100:00100000:1.0:1788263245.878144:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709719680 00000100:00100000:1.0:1788263245.878166:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788263245.878177:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709719552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788263245.878208:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788263245.878299:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709719552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (5003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263245.878306:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788263245.878322:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788263245.878327:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709719680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788263245.878354:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788263245.878390:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709719680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263245.878396:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788263245.878631:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709719680:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788263245.881816:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709719552:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788263246.511798:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263247.407957:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709720064:0@lo:400:kworker.0 00000100:00100000:1.0:1788263247.408040:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263247.408098:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709720576:0@lo:400:kworker.0 00000100:00100000:1.0:1788263247.408137:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263247.408162:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875129709721088:0@lo:400:kworker.0 00000100:00100000:1.0:1788263247.408184:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263247.408207:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788263247.408229:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709720192:0@lo:400:kworker.0 00000100:00100000:1.0:1788263247.408269:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263247.408288:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709720704:0@lo:400:kworker.0 00000100:00100000:1.0:1788263247.408310:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263247.408327:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709721216:0@lo:400:kworker.0 00000100:00100000:1.0:1788263247.408351:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263247.408386:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709720064 00000100:00100000:1.0:1788263247.408393:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709720064 00000100:00100000:1.0:1788263247.408437:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788263247.408447:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709720064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263247.408498:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709720064:12345-0@lo:400:kworker.0 Request processed in 53us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263247.408506:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788263247.408527:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709720576 00000100:00100000:1.0:1788263247.408530:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709720576 00000100:00100000:1.0:1788263247.408560:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709721088 00000100:00100000:1.0:1788263247.408563:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709721088 00000100:00100000:1.0:1788263247.408607:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709720192 00000100:00100000:1.0:1788263247.408611:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709720192 00000100:00100000:1.0:1788263247.408625:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788263247.408631:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709720576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263247.408663:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709720576:12345-0@lo:400:kworker.0 Request processed in 32us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263247.408669:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788263247.408680:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788263247.408686:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875129709721088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263247.408711:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875129709721088:12345-0@lo:400:kworker.0 Request processed in 26us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263247.408724:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788263247.408735:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788263247.408741:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709720192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263247.408783:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709720192:12345-0@lo:400:kworker.0 Request processed in 42us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263247.408788:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788263247.408814:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709720704 00000100:00100000:1.0:1788263247.408817:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709720704 00000100:00100000:1.0:1788263247.408842:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709721216 00000100:00100000:1.0:1788263247.408845:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709721216 00000100:00100000:1.0:1788263247.408864:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788263247.408870:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709720704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263247.408902:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709720704:12345-0@lo:400:kworker.0 Request processed in 32us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263247.408908:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788263247.408919:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788263247.408924:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709721216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263247.408950:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709721216:12345-0@lo:400:kworker.0 Request processed in 26us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263247.408955:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1788263247.408975:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788263247.408979:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788263247.408981:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788263247.409021:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709720192:0@lo:400:kworker.0 00010000:00080000:1.0:1788263247.409033:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5471500 x1875129709720704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263247.409056:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709720704:0@lo:400:kworker.0 00010000:00080000:1.0:1788263247.409068:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff282fdc000 x1875129709721216/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263247.409076:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709721216:0@lo:400:kworker.0 00000100:00100000:1.0:1788263247.409085:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709720064:0@lo:400:kworker.0 00010000:00080000:1.0:1788263247.409093:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5473100 x1875129709720576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263247.409101:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709720576:0@lo:400:kworker.0 00010000:00080000:1.0:1788263247.409111:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5471880 x1875129709721088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263247.409120:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875129709721088:0@lo:400:kworker.0 00000100:00100000:3.0:1788263247.409374:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709719808:0@lo:400:kworker.0 00000100:00100000:3.0:1788263247.409410:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263247.409444:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709720320:0@lo:400:kworker.0 00000100:00100000:3.0:1788263247.409467:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263247.409485:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709720832:0@lo:400:kworker.0 00000100:00100000:3.0:1788263247.409504:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263247.409520:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709721344:0@lo:400:kworker.0 00000100:00100000:3.0:1788263247.409541:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263247.409559:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788263247.409565:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709719936:0@lo:400:kworker.0 00000100:00100000:3.0:1788263247.409639:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263247.409655:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709720448:0@lo:400:kworker.0 00000100:00100000:3.0:1788263247.409675:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263247.409688:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875129709720960:0@lo:400:kworker.0 00000100:00100000:3.0:1788263247.409708:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263247.409735:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709719936 00000100:00100000:3.0:1788263247.409739:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709719936 00000100:00100000:3.0:1788263247.409764:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709720448 00000100:00100000:3.0:1788263247.409777:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709720448 00000100:00100000:3.0:1788263247.409798:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709720960 00000100:00100000:3.0:1788263247.409801:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709720960 00000100:00100000:3.0:1788263247.409815:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788263247.409822:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709719936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263247.409859:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709719936:12345-0@lo:400:kworker.0 Request processed in 37us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263247.409865:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788263247.409879:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788263247.409885:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709720448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263247.409909:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709720448:12345-0@lo:400:kworker.0 Request processed in 26us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263247.409915:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788263247.409926:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788263247.409932:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875129709720960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263247.409956:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875129709720960:12345-0@lo:400:kworker.0 Request processed in 25us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263247.409962:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788263247.409987:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709720832 00000100:00100000:3.0:1788263247.409991:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709720832 00000100:00100000:3.0:1788263247.410010:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709721344 00000100:00100000:3.0:1788263247.410013:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709721344 00000100:00100000:3.0:1788263247.410146:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788263247.410152:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709720832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263247.410184:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709720832:12345-0@lo:400:kworker.0 Request processed in 32us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263247.410190:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788263247.410201:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788263247.410206:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709721344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263247.410231:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709721344:12345-0@lo:400:kworker.0 Request processed in 26us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263247.410237:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788263247.410254:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709720320 00000100:00100000:3.0:1788263247.410257:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709720320 00000100:00100000:3.0:1788263247.410276:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788263247.410282:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709720320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263247.410311:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709720320:12345-0@lo:400:kworker.0 Request processed in 29us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263247.410317:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788263247.410352:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709719936:0@lo:400:kworker.0 00000100:00100000:3.0:1788263247.410362:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709720448:0@lo:400:kworker.0 00000100:00100000:3.0:1788263247.410370:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875129709720960:0@lo:400:kworker.0 00000100:00100000:3.0:1788263247.410379:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709720320:0@lo:400:kworker.0 00010000:00080000:3.0:1788263247.410401:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5472a00 x1875129709720832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263247.410411:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709720832:0@lo:400:kworker.0 00010000:00080000:3.0:1788263247.410420:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff282fdf800 x1875129709721344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263247.410428:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709721344:0@lo:400:kworker.0 00000100:00100000:1.0:1788263247.414984:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709719808 00000100:00100000:1.0:1788263247.415000:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709719808 00000100:00100000:1.0:1788263247.415192:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788263247.415211:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3618:x1875129709719808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263247.415315:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3618:x1875129709719808:12345-0@lo:400:kworker.0 Request processed in 114us (5904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263247.415322:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00080000:1.0:1788263247.415379:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788263247.415383:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788263247.415387:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263247.415893:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709721472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263247.415936:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263247.416347:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709721472 00000100:00100000:3.0:1788263247.416353:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709721472 00000100:00100000:3.0:1788263247.416392:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788263247.416400:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709721472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788263247.416423:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263247.416467:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709721472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263247.416473:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:3.0:1788263247.416508:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6ce680 x1875129709721472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263247.416528:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709721472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263247.416737:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709719808:0@lo:400:kworker.0 00010000:00010000:0.0:1788263247.541515:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788263247.926384:0:12574:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788263247.926640:0:12574:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788263247.928958:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709721600:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788263247.929026:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263247.929111:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709721600 00000100:00100000:0.0:1788263247.929120:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709721600 00000100:00100000:0.0:1788263247.929167:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788263247.929175:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709721600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788263247.929195:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263247.935995:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709721600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6812us (6960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263247.936010:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1788263247.937562:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28178dc00 x1875129709721600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263247.937693:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709721600:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788263248.436199:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788263248.436223:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5402a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709721728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788263248.436299:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263248.436393:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709721728 00000100:00100000:0.0:1788263248.436401:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709721728 00000100:00100000:0.0:1788263248.436445:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788263248.436455:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709721728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788263248.436483:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263248.436525:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709721728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263248.436555:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:0.0:1788263248.436663:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5402a00 x1875129709721728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263248.436683:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5402a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709721728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788263248.446030:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788263248.446062:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709721856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788263248.446133:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263248.446297:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709721856 00000100:00100000:2.0:1788263248.446305:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709721856 00000100:00100000:2.0:1788263248.446355:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788263248.446371:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709721856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788263248.446391:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263248.446433:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709721856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263248.446440:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1788263248.446650:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6dbb80 x1875129709721856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263248.446668:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709721856:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788263248.560792:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263249.587402:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263250.035693:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263250.035732:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263250.035776:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263250.035805:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263250.035814:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699156608 00000100:00100000:2.0:1788263250.035825:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699156608 00000100:00100000:1.0:1788263250.035827:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263250.035844:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699156736 00000100:00100000:1.0:1788263250.035848:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699156736 00000100:00100000:1.0:1788263250.035879:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699156992 00000100:00100000:1.0:1788263250.035882:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699156992 00000100:00100000:2.0:1788263250.035885:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 312 00000100:00100000:2.0:1788263250.035894:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2387:x1875129699156608:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263250.035895:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699156864 00000100:00100000:1.0:1788263250.035897:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699156864 00000100:00100000:1.0:1788263250.035907:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699157120 00000100:00100000:1.0:1788263250.035909:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699157120 00000100:00100000:1.0:1788263250.035920:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 167 00000100:00100000:1.0:1788263250.035925:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2387:x1875129699156736:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263250.035959:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2387:x1875129699156608:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 66us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263250.035967:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 312 00000100:00100000:3.0:1788263250.035992:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 168 00000100:00100000:3.0:1788263250.036010:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699156992:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263250.038342:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2387:x1875129699156736:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 2405us (2647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263250.038355:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 167 00000100:00100000:1.0:1788263250.038386:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 169 00000100:00100000:1.0:1788263250.038396:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699156864:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263250.038456:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699156864:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 64us (2650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263250.038462:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 169 00000100:00100000:1.0:1788263250.038474:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 170 00000100:00100000:1.0:1788263250.038481:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699157120:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263250.038505:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699157120:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 25us (2677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263250.038518:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 170 00000100:00080000:1.0:1788263250.038544:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788263250.038548:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263250.050269:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699156992:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 14256us (14522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263250.050281:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263250.050284:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 168 00000100:00100000:3.0:1788263250.050345:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699157248 00000100:00100000:3.0:1788263250.050354:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699157248 00000100:00100000:2.0:1788263250.050390:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263250.050400:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699157376 00000100:00100000:3.0:1788263250.050402:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699157376 00000100:00100000:2.0:1788263250.050416:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:2.0:1788263250.050874:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8481cd9-d282-4057-bab5-8c571435635f+5:2385:x1875129699157248:12345-192.168.203.26@tcp:9:kworker.0 00000020:00000080:2.0:1788263250.050905:0:8404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f497 00000100:00080000:2.0:1788263250.050916:0:8404:0:(import.c:65:import_set_state_nolock()) ffff9ff3b560d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788263250.050961:0:8404:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788263250.051105:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8481cd9-d282-4057-bab5-8c571435635f+2:2385:x1875129699157248:12345-192.168.203.26@tcp:9:kworker.0 Request processed in 247us (824us total) trans 0 rc 0/0 00010000:00010000:0.0:1788263250.053670:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263250.056472:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:3.0:1788263250.056495:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:2385:x1875129699157376:12345-192.168.203.26@tcp:9:kworker.0 00000020:00000080:3.0:1788263250.056704:0:8406:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f49e 00000100:00080000:3.0:1788263250.056716:0:8406:0:(import.c:65:import_set_state_nolock()) ffff9ff283210800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788263250.057080:0:8406:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788263250.057240:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8481cd9-d282-4057-bab5-8c571435635f+2:2385:x1875129699157376:12345-192.168.203.26@tcp:9:kworker.0 Request processed in 752us (6847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263250.057250:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00080000:3.0:1788263250.057273:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788263250.057277:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788263250.057291:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263250.064127:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 22 00000020:00000004:3.0:1788263250.357297:0:12672:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788263250.357771:0:12672:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788263250.608829:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263250.992691:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709721984:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788263250.992771:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263250.992983:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709721984 00000100:00100000:2.0:1788263250.992992:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709721984 00000100:00100000:2.0:1788263250.993047:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788263250.993057:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709721984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788263250.993104:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788263250.993165:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709721984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263250.993172:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788263250.993710:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709721984:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788263250.996371:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788263250.996390:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709722112:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788263250.996558:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263250.996817:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709722112 00000100:00100000:0.0:1788263250.996825:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709722112 00000100:00100000:0.0:1788263250.996879:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788263250.996889:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709722112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788263250.996921:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788263250.996969:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709722112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263250.996976:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788263250.997217:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709722112:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788263251.637946:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263252.527757:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709722368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788263252.527830:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263252.527863:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709722240:0@lo:400:kworker.0 00000100:00100000:3.0:1788263252.527896:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709722880:0@lo:400:kworker.0 00000100:00100000:1.0:1788263252.527904:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263252.527933:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875129709722752:0@lo:400:kworker.0 00000100:00100000:3.0:1788263252.527937:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263252.527970:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709723392:0@lo:400:kworker.0 00000100:00100000:1.0:1788263252.527970:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263252.527991:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709723264:0@lo:400:kworker.0 00000100:00100000:1.0:1788263252.528010:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263252.528022:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709723776:0@lo:400:kworker.0 00000100:00100000:1.0:1788263252.528039:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263252.528058:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788263252.528063:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709722624:0@lo:400:kworker.0 00000100:00100000:1.0:1788263252.528083:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263252.528097:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875129709723136:0@lo:400:kworker.0 00000100:00100000:3.0:1788263252.528124:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263252.528130:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263252.528156:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709723904:0@lo:400:kworker.0 00000100:00100000:1.0:1788263252.528157:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875129709723648:0@lo:400:kworker.0 00000100:00100000:1.0:1788263252.528180:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263252.528204:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263252.528208:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709722496:0@lo:400:kworker.0 00000100:00100000:1.0:1788263252.528235:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263252.528247:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709722368 00000100:00100000:1.0:1788263252.528254:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875129709723008:0@lo:400:kworker.0 00000100:00100000:3.0:1788263252.528255:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709722368 00000100:00100000:1.0:1788263252.528274:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263252.528286:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875129709723520:0@lo:400:kworker.0 00000100:00100000:1.0:1788263252.528322:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263252.528432:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709722240 00000100:00100000:1.0:1788263252.528436:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709722240 00000100:00100000:1.0:1788263252.528470:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788263252.528478:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3621:x1875129709722240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263252.528519:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3621:x1875129709722240:12345-0@lo:400:kworker.0 Request processed in 42us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263252.528525:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788263252.528549:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709722752 00000100:00100000:1.0:1788263252.528552:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709722752 00000100:00100000:1.0:1788263252.528565:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709723136 00000100:00100000:1.0:1788263252.528567:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709723136 00000100:00100000:1.0:1788263252.528603:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709723648 00000100:00100000:1.0:1788263252.528605:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709723648 00000100:00100000:1.0:1788263252.528614:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709722496 00000100:00100000:1.0:1788263252.528616:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709722496 00000100:00100000:1.0:1788263252.528624:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709723008 00000100:00100000:1.0:1788263252.528625:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709723008 00000100:00100000:1.0:1788263252.528634:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709723520 00000100:00100000:1.0:1788263252.528636:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709723520 00000100:00100000:1.0:1788263252.528646:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788263252.528651:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875129709722752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263252.528678:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875129709722752:12345-0@lo:400:kworker.0 Request processed in 27us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263252.528684:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788263252.528693:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788263252.528698:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875129709723136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263252.528716:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875129709723136:12345-0@lo:400:kworker.0 Request processed in 18us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263252.528727:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788263252.528749:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788263252.528755:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875129709723648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263252.528779:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875129709723648:12345-0@lo:400:kworker.0 Request processed in 25us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263252.528784:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788263252.528793:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788263252.528797:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709722496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263252.528819:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709722496:12345-0@lo:400:kworker.0 Request processed in 22us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263252.528824:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788263252.528832:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788263252.528837:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875129709723008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263252.528856:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875129709723008:12345-0@lo:400:kworker.0 Request processed in 19us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263252.528861:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788263252.528869:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788263252.528873:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875129709723520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263252.528890:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875129709723520:12345-0@lo:400:kworker.0 Request processed in 17us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263252.528895:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788263252.528908:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709723264 00000100:00100000:1.0:1788263252.528911:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709723264 00000100:00100000:1.0:1788263252.528925:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709723776 00000100:00100000:1.0:1788263252.528927:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709723776 00000100:00100000:0.0:1788263252.531459:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709722880 00000100:00100000:0.0:1788263252.531471:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709722880 00000100:00100000:0.0:1788263252.531498:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709722624 00000100:00100000:0.0:1788263252.531501:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709722624 00000100:00100000:0.0:1788263252.531517:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788263252.531525:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709722880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263252.531573:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788263252.532650:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709723392 00000100:00100000:1.0:1788263252.532658:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709723392 00000100:00100000:1.0:1788263252.532679:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709723904 00000100:00100000:1.0:1788263252.532682:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709723904 00000100:00100000:1.0:1788263252.532694:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788263252.532702:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709723264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263252.532770:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709723264:12345-0@lo:400:kworker.0 Request processed in 69us (4759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263252.532777:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788263252.532791:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788263252.532796:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709723776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263252.532822:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709723776:12345-0@lo:400:kworker.0 Request processed in 26us (4783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263252.532827:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788263252.532837:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788263252.532842:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709723392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263252.532939:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709723392:12345-0@lo:400:kworker.0 Request processed in 96us (4816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263252.532945:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788263252.532956:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788263252.532962:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3618:x1875129709723904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263252.532989:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3618:x1875129709723904:12345-0@lo:400:kworker.0 Request processed in 28us (4786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263252.532994:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788263252.533041:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709722496:0@lo:400:kworker.0 00000100:00100000:1.0:1788263252.533150:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875129709723008:0@lo:400:kworker.0 00000100:00100000:1.0:1788263252.533180:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875129709723520:0@lo:400:kworker.0 00010000:00080000:1.0:1788263252.533236:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28178f100 x1875129709723136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263252.533248:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875129709723136:0@lo:400:kworker.0 00010000:00080000:1.0:1788263252.533264:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5472a00 x1875129709723648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263252.533272:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875129709723648:0@lo:400:kworker.0 00000100:00100000:1.0:1788263252.533282:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709722240:0@lo:400:kworker.0 00000100:00100000:1.0:1788263252.533432:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875129709722752:0@lo:400:kworker.0 00010000:00080000:1.0:1788263252.533452:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28178dc00 x1875129709723264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263252.533460:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709723264:0@lo:400:kworker.0 00010000:00080000:1.0:1788263252.533475:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5473800 x1875129709723776/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263252.533482:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709723776:0@lo:400:kworker.0 00000100:00100000:3.0:1788263252.533855:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709722368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788263252.533881:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263252.533926:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709722368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2329us (6096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263252.533933:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788263252.533966:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788263252.533970:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788263252.533973:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788263252.533976:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788263252.535429:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709722880:12345-0@lo:400:kworker.0 Request processed in 3901us (7492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263252.535448:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788263252.535600:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788263252.535611:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709722624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263252.535673:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709722624:12345-0@lo:400:kworker.0 Request processed in 65us (7589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263252.535680:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788263252.537435:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709722880:0@lo:400:kworker.0 00010000:00080000:2.0:1788263252.537455:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff282fdf800 x1875129709723392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263252.537467:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709723392:0@lo:400:kworker.0 00010000:00080000:2.0:1788263252.537478:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5471880 x1875129709723904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263252.537487:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709723904:0@lo:400:kworker.0 00010000:00080000:2.0:1788263252.537498:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff281e3bb80 x1875129709722368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263252.537533:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709722368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263252.538002:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709722624:0@lo:400:kworker.0 00010000:00010000:3.0:1788263252.665021:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263253.040793:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788263253.040816:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2838cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709724032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788263253.040891:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263253.041029:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709724032 00000100:00100000:1.0:1788263253.041047:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709724032 00000100:00100000:1.0:1788263253.041095:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788263253.041104:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709724032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788263253.041125:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263253.041169:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709724032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263253.041176:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:3.0:1788263253.041242:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2838cd180 x1875129709724032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263253.041266:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2838cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709724032:0@lo:13:osp-pre-1-1.0 00000020:00000004:3.0:1788263253.373505:0:12770:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788263253.374476:0:12770:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788263253.551918:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709724160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788263253.552203:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263253.552336:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709724160 00000100:00100000:1.0:1788263253.552344:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709724160 00000100:00100000:1.0:1788263253.552399:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788263253.552409:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709724160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788263253.552435:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263253.552480:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709724160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263253.552486:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:0.0:1788263253.552756:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5403b80 x1875129709724160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263253.552775:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709724160:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788263253.556411:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263253.556433:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709724288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263253.556503:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263253.557702:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709724288 00000100:00100000:2.0:1788263253.557713:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709724288 00000100:00100000:2.0:1788263253.557765:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788263253.557774:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709724288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788263253.557806:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263253.558079:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709724288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 304us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263253.558087:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:1.0:1788263253.558156:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6d9180 x1875129709724288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263253.558176:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709724288:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788263253.683423:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263254.706067:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263255.162744:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263255.162786:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263255.162805:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263255.162828:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263255.162896:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263255.162925:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699157760 00000100:00100000:0.0:1788263255.162933:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699157760 00000100:00100000:0.0:1788263255.162986:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699158016 00000100:00100000:0.0:1788263255.162988:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699158016 00000100:00100000:0.0:1788263255.163002:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699157632 00000100:00100000:0.0:1788263255.163005:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699157632 00000100:00100000:0.0:1788263255.163016:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699157888 00000100:00100000:0.0:1788263255.163018:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699157888 00000100:00100000:0.0:1788263255.163033:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 177 00000100:00100000:0.0:1788263255.163042:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699157760:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263255.163120:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699157760:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 79us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263255.163128:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 177 00000100:00100000:0.0:1788263255.163144:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 178 00000100:00100000:0.0:1788263255.163159:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699158016:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263255.163185:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699158016:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 27us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263255.163192:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 178 00000100:00100000:0.0:1788263255.163204:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 179 00000100:00100000:0.0:1788263255.163210:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2387:x1875129699157632:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263255.163234:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2387:x1875129699157632:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 25us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263255.163240:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 179 00000100:00100000:0.0:1788263255.163250:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 180 00000100:00100000:0.0:1788263255.163255:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699157888:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263255.163275:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699157888:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 20us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263255.163281:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 180 00000100:00080000:0.0:1788263255.163303:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788263255.163307:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788263255.163438:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699157504 00000100:00100000:2.0:1788263255.163443:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699157504 00000100:00100000:2.0:1788263255.163484:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 314 00000100:00100000:2.0:1788263255.163491:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2387:x1875129699157504:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263255.163521:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2387:x1875129699157504:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 30us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263255.163527:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 314 00000020:00000004:0.0:1788263255.520335:0:12867:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788263255.520693:0:12867:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788263255.729929:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263256.113092:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2838ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709724416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788263256.113159:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263256.113271:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709724416 00000100:00100000:1.0:1788263256.113280:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709724416 00000100:00100000:1.0:1788263256.113325:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788263256.113333:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709724416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788263256.113377:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788263256.113438:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709724416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263256.113445:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788263256.113486:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2838ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709724416:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1788263256.114206:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d8481cd9-d282-4057-bab5-8c571435635f 00000020:00000080:1.0:1788263256.114212:0:8398:0:(genops.c:885:class_export_put()) final put ffff9ff3b5609000/d8481cd9-d282-4057-bab5-8c571435635f 00000100:00100000:2.0:1788263256.117195:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709724544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788263256.117259:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:0.0:1788263256.119276:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d8481cd9-d282-4057-bab5-8c571435635f 00000020:00000080:0.0:1788263256.119284:0:9482:0:(genops.c:885:class_export_put()) final put ffff9ff283215000/d8481cd9-d282-4057-bab5-8c571435635f 00000020:00000080:2.0:1788263256.123340:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff283215000/d8481cd9-d282-4057-bab5-8c571435635f for lustre-OST0001 00000020:00000080:2.0:1788263256.123781:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3b5609000/d8481cd9-d282-4057-bab5-8c571435635f for lustre-OST0000 00000020:00000080:2.0:1788263256.123803:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff283210800 for lustre-OST0001 00000020:00000080:2.0:1788263256.123808:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff3b560d800 for lustre-OST0000 00000100:00100000:2.0:1788263256.123841:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709724544 00000100:00100000:2.0:1788263256.123851:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709724544 00000100:00100000:2.0:1788263256.124252:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788263256.124262:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709724544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788263256.124298:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788263256.124388:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709724544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (7128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263256.124396:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788263256.124454:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709724544:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788263256.752184:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263257.650945:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788263257.650989:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709724672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263257.651071:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263257.651314:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709724672 00000100:00100000:3.0:1788263257.651322:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709724672 00000100:00100000:3.0:1788263257.651381:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788263257.651393:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709724672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788263257.651422:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263257.651469:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709724672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263257.651475:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1788263257.656017:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788263257.656097:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff281e38380 x1875129709724672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263257.656122:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709724672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263257.659957:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709724800:0@lo:400:kworker.0 00000100:00100000:1.0:1788263257.660029:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263257.662865:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709724928:0@lo:400:kworker.0 00000100:00100000:3.0:1788263257.662933:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263257.662984:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788263257.662991:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709725056:0@lo:400:kworker.0 00000100:00100000:3.0:1788263257.663016:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263257.663045:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709725184:0@lo:400:kworker.0 00000100:00100000:3.0:1788263257.663069:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263257.663103:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709724800 00000100:00100000:3.0:1788263257.663110:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709724800 00000100:00100000:3.0:1788263257.663156:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788263257.663176:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3621:x1875129709724800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263257.665505:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875129709725568:0@lo:400:kworker.0 00000100:00100000:0.0:1788263257.665610:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263257.665641:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709726080:0@lo:400:kworker.0 00000100:00100000:0.0:1788263257.665664:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263257.665686:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788263257.665692:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875129709725440:0@lo:400:kworker.0 00000100:00100000:0.0:1788263257.665960:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263257.665980:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875129709725952:0@lo:400:kworker.0 00000100:00100000:0.0:1788263257.666003:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263257.666030:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709724928 00000100:00100000:0.0:1788263257.666037:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709724928 00000100:00100000:0.0:1788263257.666073:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709725184 00000100:00100000:0.0:1788263257.666076:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709725184 00000100:00100000:0.0:1788263257.666089:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709725568 00000100:00100000:0.0:1788263257.666091:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709725568 00000100:00100000:0.0:1788263257.666112:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709726080 00000100:00100000:0.0:1788263257.666115:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709726080 00000100:00100000:0.0:1788263257.666128:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709725440 00000100:00100000:0.0:1788263257.666130:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709725440 00000100:00100000:0.0:1788263257.666143:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709725952 00000100:00100000:0.0:1788263257.666145:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709725952 00000100:00100000:0.0:1788263257.666161:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788263257.666179:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709724928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263257.666228:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709724928:12345-0@lo:400:kworker.0 Request processed in 51us (3294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263257.666236:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788263257.666254:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788263257.666260:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709725184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263257.666289:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709725184:12345-0@lo:400:kworker.0 Request processed in 30us (3219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263257.666295:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788263257.666307:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788263257.666314:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875129709725568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263257.666358:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875129709725568:12345-0@lo:400:kworker.0 Request processed in 31us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263257.666364:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788263257.666377:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788263257.666384:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875129709726080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263257.666411:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875129709726080:12345-0@lo:400:kworker.0 Request processed in 29us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263257.666417:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788263257.666429:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788263257.666435:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875129709725440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263257.666468:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875129709725440:12345-0@lo:400:kworker.0 Request processed in 34us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263257.666474:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788263257.666487:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788263257.666501:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875129709725952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263257.666530:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875129709725952:12345-0@lo:400:kworker.0 Request processed in 30us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263257.666548:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:0.0:1788263257.666566:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788263257.666569:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788263257.666611:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709725696:0@lo:400:kworker.0 00000100:00100000:0.0:1788263257.666641:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263257.666661:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709726208:0@lo:400:kworker.0 00000100:00100000:0.0:1788263257.666681:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263257.666725:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709725184:0@lo:400:kworker.0 00000100:00100000:0.0:1788263257.666746:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788263257.666752:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709725312:0@lo:400:kworker.0 00000100:00100000:0.0:1788263257.667131:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263257.667191:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709725824:0@lo:400:kworker.0 00000100:00100000:0.0:1788263257.667215:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263257.667246:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709725696 00000100:00100000:0.0:1788263257.667250:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709725696 00000100:00100000:0.0:1788263257.667284:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709726208 00000100:00100000:0.0:1788263257.667287:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709726208 00000100:00100000:0.0:1788263257.667301:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709725824 00000100:00100000:0.0:1788263257.667304:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709725824 00000100:00100000:0.0:1788263257.667318:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788263257.667324:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709725696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263257.667375:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709725696:12345-0@lo:400:kworker.0 Request processed in 51us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263257.667381:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788263257.667403:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788263257.667409:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709726208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263257.667439:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709726208:12345-0@lo:400:kworker.0 Request processed in 30us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263257.667445:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788263257.667456:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788263257.667463:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709725824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263257.667489:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709725824:12345-0@lo:400:kworker.0 Request processed in 27us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263257.667494:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1788263257.667511:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788263257.667514:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788263257.667678:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709724928:0@lo:400:kworker.0 00000100:00100000:0.0:1788263257.667729:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875129709725440:0@lo:400:kworker.0 00000100:00100000:0.0:1788263257.667741:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875129709725952:0@lo:400:kworker.0 00010000:00080000:0.0:1788263257.667752:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833d8a80 x1875129709725568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263257.667883:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875129709725568:0@lo:400:kworker.0 00010000:00080000:0.0:1788263257.667898:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833db800 x1875129709726080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263257.667906:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709726080:0@lo:400:kworker.0 00010000:00080000:0.0:1788263257.667945:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833db480 x1875129709725824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263257.668030:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709725824:0@lo:400:kworker.0 00010000:00080000:0.0:1788263257.668043:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833dad80 x1875129709725696/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263257.668049:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709725696:0@lo:400:kworker.0 00010000:00080000:0.0:1788263257.668058:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833d8700 x1875129709726208/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263257.668066:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709726208:0@lo:400:kworker.0 00000100:00100000:3.0:1788263257.668263:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3621:x1875129709724800:12345-0@lo:400:kworker.0 Request processed in 5087us (8232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263257.668280:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788263257.668473:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709725056 00000100:00100000:2.0:1788263257.668478:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709725056 00000100:00100000:2.0:1788263257.668501:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709725312 00000100:00100000:2.0:1788263257.668503:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709725312 00000100:00100000:2.0:1788263257.668516:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788263257.668523:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709725056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263257.668606:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709725056:12345-0@lo:400:kworker.0 Request processed in 84us (5589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263257.668613:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788263257.668635:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788263257.668641:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709725312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263257.668671:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709725312:12345-0@lo:400:kworker.0 Request processed in 31us (1541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263257.668676:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788263257.669076:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709725056:0@lo:400:kworker.0 00000100:00100000:0.0:1788263257.669105:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709725312:0@lo:400:kworker.0 00000100:00100000:1.0:1788263257.669165:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709724800:0@lo:400:kworker.0 00010000:00010000:3.0:1788263257.777852:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263258.159958:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788263258.167374:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2838ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709726336:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788263258.167464:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263258.167781:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709726336 00000100:00100000:3.0:1788263258.167789:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709726336 00000100:00100000:3.0:1788263258.167862:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788263258.167871:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709726336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788263258.167895:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263258.167939:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709726336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263258.167946:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1788263258.169295:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2838ce680 x1875129709726336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263258.169318:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2838ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709726336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788263258.671798:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709726464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788263258.671886:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263258.671973:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709726464 00000100:00100000:0.0:1788263258.671981:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709726464 00000100:00100000:0.0:1788263258.672032:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788263258.672043:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709726464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788263258.672075:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263258.672121:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709726464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263258.672130:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:0.0:1788263258.672173:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833d8700 x1875129709726464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263258.672192:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709726464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788263258.674072:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709726592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263258.674134:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263258.674188:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709726592 00000100:00100000:0.0:1788263258.674193:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709726592 00000100:00100000:0.0:1788263258.674230:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788263258.674239:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709726592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788263258.674258:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263258.674297:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709726592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263258.674304:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1788263258.674339:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833d8700 x1875129709726592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263258.674356:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709726592:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788263258.801250:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788263259.579117:0:13011:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788263259.825355:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263260.276255:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263260.276316:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263260.276351:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263260.276380:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263260.276417:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263260.276437:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699158400 00000100:00100000:1.0:1788263260.276452:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699158400 00000100:00100000:0.0:1788263260.276485:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699158656 00000100:00100000:0.0:1788263260.276495:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699158656 00000100:00100000:1.0:1788263260.276523:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699158272 00000100:00100000:1.0:1788263260.276528:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699158272 00000100:00100000:0.0:1788263260.276550:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699158528 00000100:00100000:0.0:1788263260.276557:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699158528 00000100:00100000:1.0:1788263260.276567:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 187 00000100:00100000:1.0:1788263260.276630:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699158400:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263260.276726:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699158400:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 150us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263260.276733:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 187 00000100:00100000:1.0:1788263260.276754:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 188 00000100:00100000:1.0:1788263260.276760:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699158656:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263260.276787:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699158656:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 27us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263260.276794:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699158144 00000100:00100000:1.0:1788263260.276795:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 188 00000100:00100000:2.0:1788263260.276806:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699158144 00000100:00100000:1.0:1788263260.276823:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 189 00000100:00100000:1.0:1788263260.276835:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2386:x1875129699158272:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263260.276876:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 316 00000100:00100000:1.0:1788263260.276884:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2386:x1875129699158272:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 50us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263260.276896:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2386:x1875129699158144:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263260.276901:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 189 00000100:00100000:2.0:1788263260.276969:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2386:x1875129699158144:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 82us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263260.276995:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 316 00000100:00080000:2.0:1788263260.277089:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788263260.277096:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788263260.277474:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 190 00000100:00100000:0.0:1788263260.277486:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699158528:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263260.277544:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699158528:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 62us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263260.277560:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 190 00010000:00010000:0.0:1788263260.848237:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263261.232780:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709726720:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788263261.232888:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263261.234714:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2838cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709726848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788263261.235612:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709726720 00000100:00100000:0.0:1788263261.235626:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709726720 00000100:00100000:0.0:1788263261.235704:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788263261.235716:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709726720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788263261.235763:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788263261.235835:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709726720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (2948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263261.235854:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788263261.235884:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263261.237864:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709726720:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788263261.237926:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709726848 00000100:00100000:3.0:1788263261.237934:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709726848 00000100:00100000:3.0:1788263261.237980:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788263261.237990:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709726848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788263261.238033:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788263261.238148:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709726848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 156us (2260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263261.238158:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788263261.238185:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2838cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709726848:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788263261.872799:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263262.767943:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709727232:0@lo:400:kworker.0 00000100:00100000:2.0:1788263262.768016:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263262.768076:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709727744:0@lo:400:kworker.0 00000100:00100000:2.0:1788263262.768100:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263262.768124:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875129709728256:0@lo:400:kworker.0 00000100:00100000:2.0:1788263262.768144:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263262.768167:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788263262.768171:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709727360:0@lo:400:kworker.0 00000100:00100000:2.0:1788263262.768189:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263262.768206:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709727872:0@lo:400:kworker.0 00000100:00100000:2.0:1788263262.768225:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263262.768242:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709728384:0@lo:400:kworker.0 00000100:00100000:1.0:1788263262.768323:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709727104:0@lo:400:kworker.0 00000100:00100000:1.0:1788263262.768353:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263262.768371:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875129709727616:0@lo:400:kworker.0 00000100:00100000:1.0:1788263262.768391:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263262.768407:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875129709728128:0@lo:400:kworker.0 00000100:00100000:1.0:1788263262.768423:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263262.768434:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788263262.768439:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28233b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709726976:0@lo:400:kworker.0 00000100:00100000:1.0:1788263262.768462:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263262.768481:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709727488:0@lo:400:kworker.0 00000100:00100000:1.0:1788263262.768502:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263262.768529:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709728000:0@lo:400:kworker.0 00000100:00100000:1.0:1788263262.768559:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709727744 00000100:00100000:1.0:1788263262.768566:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709727744 00000100:00100000:1.0:1788263262.768632:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709728256 00000100:00100000:1.0:1788263262.768636:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709728256 00000100:00100000:1.0:1788263262.768649:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709727360 00000100:00100000:1.0:1788263262.768652:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709727360 00000100:00100000:1.0:1788263262.768672:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709727104 00000100:00100000:1.0:1788263262.768675:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709727104 00000100:00100000:1.0:1788263262.768686:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709727616 00000100:00100000:1.0:1788263262.768688:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709727616 00000100:00100000:1.0:1788263262.768698:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709728128 00000100:00100000:1.0:1788263262.768700:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709728128 00000100:00100000:1.0:1788263262.768734:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788263262.768742:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709727744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263262.768788:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709727744:12345-0@lo:400:kworker.0 Request processed in 46us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263262.768795:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788263262.768810:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788263262.768816:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875129709728256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263262.768842:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875129709728256:12345-0@lo:400:kworker.0 Request processed in 26us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263262.768848:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788263262.768859:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788263262.768865:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709727360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263262.768889:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709727360:12345-0@lo:400:kworker.0 Request processed in 24us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263262.768894:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788263262.768905:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788263262.768910:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709727104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263262.768938:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709727104:12345-0@lo:400:kworker.0 Request processed in 29us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263262.768944:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788263262.768953:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788263262.768958:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875129709727616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263262.768981:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875129709727616:12345-0@lo:400:kworker.0 Request processed in 23us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263262.768986:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788263262.769002:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788263262.769007:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875129709728128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263262.769032:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875129709728128:12345-0@lo:400:kworker.0 Request processed in 25us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263262.769037:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788263262.769053:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709726976 00000100:00100000:1.0:1788263262.769055:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709726976 00000100:00100000:1.0:1788263262.769076:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1788263262.769082:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3619:x1875129709726976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263262.769105:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3619:x1875129709726976:12345-0@lo:400:kworker.0 Request processed in 24us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263262.769110:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1788263262.769136:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709727232 00000100:00100000:1.0:1788263262.769139:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709727232 00000100:00100000:1.0:1788263262.769154:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709727488 00000100:00100000:1.0:1788263262.769156:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709727488 00000100:00100000:1.0:1788263262.769165:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788263262.769171:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709727232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263262.769198:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709727232:12345-0@lo:400:kworker.0 Request processed in 28us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263262.769204:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788263262.769214:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788263262.769219:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709727488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263262.769239:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709727488:12345-0@lo:400:kworker.0 Request processed in 21us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263262.769244:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788263262.769310:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263262.769358:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709727232:0@lo:400:kworker.0 00010000:00080000:2.0:1788263262.769371:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833e3800 x1875129709727744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263262.769379:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709727744:0@lo:400:kworker.0 00010000:00080000:2.0:1788263262.769387:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833e0000 x1875129709728256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263262.769407:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875129709728256:0@lo:400:kworker.0 00000100:00100000:2.0:1788263262.769431:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709727360:0@lo:400:kworker.0 00000100:00100000:2.0:1788263262.769467:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709727872 00000100:00100000:2.0:1788263262.769470:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709727872 00000100:00100000:2.0:1788263262.769496:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709728384 00000100:00100000:2.0:1788263262.769500:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709728384 00000100:00100000:2.0:1788263262.769519:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788263262.769526:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38767a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709727872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263262.769561:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38767a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709727872:12345-0@lo:400:kworker.0 Request processed in 36us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263262.769567:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788263262.769597:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788263262.769604:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709728384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263262.769630:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709728384:12345-0@lo:400:kworker.0 Request processed in 27us (1367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263262.769636:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1788263262.769650:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788263262.769654:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788263262.769657:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788263262.769669:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788263262.769686:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263262.769709:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709728512:0@lo:400:kworker.0 00000100:00100000:2.0:1788263262.769733:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263262.769757:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709727104:0@lo:400:kworker.0 00000100:00100000:2.0:1788263262.769767:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875129709727616:0@lo:400:kworker.0 00000100:00100000:2.0:1788263262.769785:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875129709728128:0@lo:400:kworker.0 00000100:00100000:2.0:1788263262.769800:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28233b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709726976:0@lo:400:kworker.0 00000100:00100000:2.0:1788263262.769809:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709727488:0@lo:400:kworker.0 00000100:00100000:2.0:1788263262.769824:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709728000 00000100:00100000:2.0:1788263262.769827:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709728000 00000100:00100000:2.0:1788263262.769851:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709728512 00000100:00100000:2.0:1788263262.769854:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709728512 00000100:00100000:2.0:1788263262.769867:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788263262.769873:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38767b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709728000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263262.769906:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38767b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709728000:12345-0@lo:400:kworker.0 Request processed in 33us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263262.769912:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788263262.769924:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788263262.769929:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387679500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709728512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263262.769954:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387679500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709728512:12345-0@lo:400:kworker.0 Request processed in 25us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263262.769959:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1788263262.769975:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788263262.769977:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788263262.769992:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833e3480 x1875129709728000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263262.770001:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709728000:0@lo:400:kworker.0 00010000:00080000:2.0:1788263262.770010:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833e3b80 x1875129709728512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263262.770032:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709728512:0@lo:400:kworker.0 00010000:00080000:2.0:1788263262.770059:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833e1180 x1875129709727872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263262.770068:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709727872:0@lo:400:kworker.0 00010000:00080000:2.0:1788263262.770077:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833e2a00 x1875129709728384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263262.770084:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709728384:0@lo:400:kworker.0 00000100:00100000:0.0:1788263262.771103:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263262.771119:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709728640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263262.771167:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263262.771279:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709728640 00000100:00100000:3.0:1788263262.771285:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709728640 00000100:00100000:3.0:1788263262.771324:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788263262.771332:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709728640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788263262.771365:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263262.771407:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709728640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263262.771414:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:0.0:1788263262.771492:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28387ed80 x1875129709728640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263262.771507:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709728640:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788263262.896396:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263263.295689:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788263263.295712:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709728768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788263263.295780:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263263.295845:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709728768 00000100:00100000:1.0:1788263263.295852:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709728768 00000100:00100000:1.0:1788263263.295899:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788263263.295920:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709728768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788263263.295943:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263263.295997:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709728768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263263.296004:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:1.0:1788263263.296044:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5473800 x1875129709728768/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263263.296061:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709728768:0@lo:13:osp-pre-1-1.0 00000020:00000080:2.0:1788263263.342351:0:13159:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc21fcd0b0 20000000:00000080:2.0:1788263263.342368:0:13159:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ff3af74b400 uarg=0000000000000000 20000000:01000000:2.0:1788263263.342405:0:13159:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788263263.342411:0:13159:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788263263.342415:0:13159:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788263263.343137:0:13160:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788263263.343288:0:13159:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788263263.357030:0:13159:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788263263.357283:0:13159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f4a5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263263.357304:0:13159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff3829e8800/0x4b1103cba666f3da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f3d3 expref: 23 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263263.357312:0:13159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff3bd17f600/0x4b1103cba666f404 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f3fd expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263263.357319:0:13159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff3bd17e000/0x4b1103cba666f42e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f427 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263263.357325:0:13159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff3bd17f800/0x4b1103cba666f458 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f451 expref: 23 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263263.357335:0:13159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f46d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcfe expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263263.357342:0:13159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f482 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd3d expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263263.357350:0:13159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f4a5 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263263.357393:0:13159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f482 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd3d expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263263.357427:0:13159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f482 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd3d expref: 12 pid: 6484 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263263.357443:0:13159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13159:1875129709728896:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263263.357561:0:13159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f46d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcfe expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263263.357570:0:13159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f46d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcfe expref: 12 pid: 6486 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263263.357611:0:13159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13159:1875129709729024:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263263.357651:0:13159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff3bd17f800/0x4b1103cba666f458 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f451 expref: 23 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263263.357670:0:13159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff3bd17f800/0x4b1103cba666f458 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f451 expref: 23 pid: 8424 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263263.357679:0:13159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13159:1875129709729152:0@lo:104: 00000100:00100000:3.0:1788263263.357720:0:13159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788263263.357759:0:13159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff3bd17e000/0x4b1103cba666f42e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f427 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263263.357767:0:13159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff3bd17e000/0x4b1103cba666f42e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f427 expref: 23 pid: 6486 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263263.357774:0:13159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e3bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13159:1875129709729280:0@lo:104: 00000100:00100000:3.0:1788263263.357795:0:13159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788263263.357827:0:13159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff3bd17f600/0x4b1103cba666f404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f3fd expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263263.357836:0:13159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff3bd17f600/0x4b1103cba666f404 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f3fd expref: 23 pid: 6485 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263263.357844:0:13159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13159:1875129709729408:0@lo:104: 00000100:00100000:3.0:1788263263.357864:0:13159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788263263.357880:0:13159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff3829e8800/0x4b1103cba666f3da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f3d3 expref: 23 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263263.357888:0:13159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff3829e8800/0x4b1103cba666f3da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f3d3 expref: 23 pid: 8424 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263263.357896:0:13159:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13159:1875129709729536:0@lo:104: 00000100:00100000:3.0:1788263263.357916:0:13159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263263.357926:0:13159:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a96099c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263263.358001:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709729152 00000100:00100000:0.0:1788263263.358010:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709729152 00000100:00100000:0.0:1788263263.358048:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709729280 00000100:00100000:0.0:1788263263.358051:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709729280 00000100:00100000:0.0:1788263263.358061:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709729408 00000100:00100000:0.0:1788263263.358070:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709729408 00000100:00100000:0.0:1788263263.358083:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709729536 00000100:00100000:0.0:1788263263.358085:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709729536 00000100:00100000:0.0:1788263263.358096:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788263263.358105:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+6:13159:x1875129709729152:12345-0@lo:104: 00010000:00010000:0.0:1788263263.358116:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f451 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f458 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.358180:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788263263.358187:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+6:13159:x1875129709729152:12345-0@lo:104: Request processed in 83us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263263.358194:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788263263.358223:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788263263.358230:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+5:13159:x1875129709729280:12345-0@lo:104: 00010000:00010000:0.0:1788263263.358238:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764e00/0x4b1103cba666f427 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f42e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.358268:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788263263.358273:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+5:13159:x1875129709729280:12345-0@lo:104: Request processed in 44us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263263.358278:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788263263.358291:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788263263.358297:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:13159:x1875129709729408:12345-0@lo:104: 00010000:00010000:0.0:1788263263.358305:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f3fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f404 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.358342:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788263263.358347:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:13159:x1875129709729408:12345-0@lo:104: Request processed in 51us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263263.358360:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788263263.358373:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788263263.358379:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:13159:x1875129709729536:12345-0@lo:104: 00010000:00010000:0.0:1788263263.358386:0:6474:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9400/0x4b1103cba666f3d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f3da expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.358414:0:6474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788263263.358419:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:13159:x1875129709729536:12345-0@lo:104: Request processed in 40us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263263.358424:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1788263263.358444:0:9492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788263263.358449:0:9492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f451 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f458 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.358456:0:9492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17e800 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:0.0:1788263263.358459:0:9492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f451 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f458 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.358467:0:9492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f458 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263263.358474:0:9492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f458 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263263.358480:0:9492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788263263.358506:0:9492:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f451 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f458 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.358512:0:9492:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263263.358536:0:9492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f451 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f458 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.358542:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17e800/0x4b1103cba666f451 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f458 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.358554:0:9492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788263263.358557:0:9492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764e00/0x4b1103cba666f427 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f42e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.358562:0:9492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae764e00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:0.0:1788263263.358565:0:9492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764e00/0x4b1103cba666f427 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f42e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.358571:0:9492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764e00/0x4b1103cba666f427 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f42e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263263.358599:0:9492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764e00/0x4b1103cba666f427 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f42e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263263.358604:0:9492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788263263.358617:0:9492:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764e00/0x4b1103cba666f427 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f42e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.358623:0:9492:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263263.358636:0:9492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764e00/0x4b1103cba666f427 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f42e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.358642:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764e00/0x4b1103cba666f427 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f42e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.358651:0:9492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788263263.358670:0:9492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f3fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f404 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.358676:0:9492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17ea00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:0.0:1788263263.358679:0:9492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f3fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f404 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.358686:0:9492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f3fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f404 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263263.358691:0:9492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f3fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f404 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263263.358696:0:9492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788263263.358709:0:9492:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f3fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f404 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.358715:0:9492:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263263.358721:0:9492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f3fd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f404 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.358727:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ea00/0x4b1103cba666f3fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f404 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.358736:0:9492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263263.358738:0:9492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9400/0x4b1103cba666f3d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f3da expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.358743:0:9492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9400 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:0.0:1788263263.358746:0:9492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9400/0x4b1103cba666f3d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f3da expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.358763:0:9492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9400/0x4b1103cba666f3d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f3da expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263263.358769:0:9492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9400/0x4b1103cba666f3d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f3da expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263263.358774:0:9492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788263263.358787:0:9492:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9400/0x4b1103cba666f3d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f3da expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.358792:0:9492:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263263.358798:0:9492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9400/0x4b1103cba666f3d3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f3da expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.358804:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9400/0x4b1103cba666f3d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f3da expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.358816:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263263.358817:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263263.358819:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263263.358831:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709729792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263263.358863:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263263.358886:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263263.358892:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709729920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263263.358911:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263263.358936:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709729792 00000100:00100000:0.0:1788263263.358941:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709729792 00010000:00010000:0.0:1788263263.358959:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff3bd17e000/0x4b1103cba666f42e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f427 expref: 24 pid: 6486 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263263.358990:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709729920 00000100:00100000:0.0:1788263263.358993:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709729920 00010000:00010000:0.0:1788263263.359006:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff3bd17f600/0x4b1103cba666f404 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f3fd expref: 25 pid: 6485 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263263.359023:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788263263.359030:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+25:3618:x1875129709729792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263263.359040:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263263.359045:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff3bd17e000/0x4b1103cba666f42e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f427 expref: 25 pid: 6486 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.359053:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff3bd17e000/0x4b1103cba666f42e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f427 expref: 25 pid: 6486 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.359068:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263263.359098:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+25:3618:x1875129709729792:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263263.359104:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788263263.359118:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788263263.359123:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3618:x1875129709729920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263263.359132:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263263.359136:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff3bd17f600/0x4b1103cba666f404 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f3fd expref: 24 pid: 6485 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.359144:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff3bd17f600/0x4b1103cba666f404 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f3fd expref: 24 pid: 6485 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263263.359153:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263263.359183:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3618:x1875129709729920:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263263.359189:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788263263.359223:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709729920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263263.359232:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709729792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788263263.360139:0:13159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13159:1875129709729152:0@lo:104: 00010000:00010000:3.0:1788263263.360150:0:13159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3bd17e000/0x4b1103cba666f42e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f427 expref: 23 pid: 6486 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263263.360162:0:13159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e3bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13159:1875129709729280:0@lo:104: 00010000:00010000:3.0:1788263263.360171:0:13159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3bd17f600/0x4b1103cba666f404 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f3fd expref: 22 pid: 6485 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263263.360178:0:13159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13159:1875129709729408:0@lo:104: 00000100:00100000:3.0:1788263263.360186:0:13159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13159:1875129709729536:0@lo:104: 00010000:00010000:2.0:1788263263.360746:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263263.360770:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709730048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263263.360812:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263263.360852:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788263263.360857:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709729664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263263.360878:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263263.360920:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709730048 00000100:00100000:2.0:1788263263.360925:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709730048 00010000:00010000:2.0:1788263263.360948:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff3829e8800/0x4b1103cba666f3da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f3d3 expref: 22 pid: 8424 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263263.361381:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709729664 00000100:00100000:2.0:1788263263.361386:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709729664 00010000:00010000:2.0:1788263263.361401:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff3bd17f800/0x4b1103cba666f458 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f451 expref: 23 pid: 8424 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263263.361419:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788263263.361426:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387679c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:3620:x1875129709730048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788263263.361437:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263263.361442:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff3829e8800/0x4b1103cba666f3da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f3d3 expref: 23 pid: 8424 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263263.361453:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff3829e8800/0x4b1103cba666f3da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f3d3 expref: 23 pid: 8424 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263263.361468:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3829e8800/0x4b1103cba666f3da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f3d3 expref: 23 pid: 8424 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263263.361481:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263263.361533:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387679c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:3620:x1875129709730048:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263263.361540:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788263263.361555:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788263263.361561:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:3620:x1875129709729664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788263263.361569:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263263.361573:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff3bd17f800/0x4b1103cba666f458 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f451 expref: 21 pid: 8424 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263263.361602:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff3bd17f800/0x4b1103cba666f458 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f451 expref: 21 pid: 8424 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263263.361621:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3bd17f800/0x4b1103cba666f458 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f451 expref: 21 pid: 8424 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263263.361630:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263263.361654:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:3620:x1875129709729664:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263263.361671:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788263263.361701:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709729664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263263.361709:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709730048:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788263263.362460:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263263.365547:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263263.365604:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263263.365695:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699158784 00000100:00100000:2.0:1788263263.365706:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699158784 00010000:00010000:2.0:1788263263.365746:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f482 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd3d expref: 13 pid: 6484 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263263.365785:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699158912 00000100:00100000:2.0:1788263263.365789:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699158912 00010000:00010000:2.0:1788263263.365800:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f46d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcfe expref: 14 pid: 6486 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263263.365822:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:2.0:1788263263.365836:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+14:2387:x1875129699158784:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263263.365852:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263263.365862:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f482 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd3d expref: 14 pid: 6484 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263263.365875:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f482 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd3d expref: 14 pid: 6484 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263263.365924:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263263.365975:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+14:2387:x1875129699158784:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 144us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263263.366092:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:2.0:1788263263.366114:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 45 00000100:00100000:2.0:1788263263.366121:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a9662c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2387:x1875129699158912:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263263.366133:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263263.366138:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f46d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcfe expref: 13 pid: 6486 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263263.366146:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f46d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcfe expref: 13 pid: 6486 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263263.366158:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f4a5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263263.366166:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f4a5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263263.366181:0:6476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f4a5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263263.366187:0:6476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f4a5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263263.366193:0:6476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f4a5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263263.366211:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f4a5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263263.366226:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eed200 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:2.0:1788263263.366231:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f4a5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263263.366239:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f4a5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263263.366248:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f4a5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263263.366257:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263263.366280:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a9662c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2387:x1875129699158912:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 160us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263263.366286:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 45 00010000:00010000:3.0:1788263263.366867:0:13159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff398eed600/0x4b1103cba666f482 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd3d expref: 12 pid: 6484 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263263.366894:0:13159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13159:1875129709728896:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263263.367268:0:13159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f46d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcfe expref: 11 pid: 6486 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263263.367279:0:13159:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13159:1875129709729024:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263263.367310:0:13159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f4a5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263263.367319:0:13159:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f4a5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263263.367325:0:13159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f4a5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263263.367332:0:13159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff398eed200/0x4b1103cba666f4a5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263263.791861:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788263263.791884:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b55bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709730176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263263.795109:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263263.795380:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709730176 00000100:00100000:2.0:1788263263.795390:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709730176 00000100:00100000:2.0:1788263263.795445:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788263263.795455:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709730176:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263263.795484:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709730304:0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788263263.795804:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263263.796299:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709730176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 844us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263263.796307:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:3.0:1788263263.796620:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b55bed80 x1875129709730176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263263.796642:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b55bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709730176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263263.796706:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263263.796767:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709730304 00000100:00100000:1.0:1788263263.796772:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709730304 00000100:00100000:1.0:1788263263.796850:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788263263.796859:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709730304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788263263.796875:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263263.796915:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709730304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263263.796920:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:0.0:1788263263.797208:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833e2a00 x1875129709730304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263263.797222:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709730304:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788263263.922030:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263264.502043:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263264.502154:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699159040 00000100:00100000:1.0:1788263264.504734:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699159040 00000100:00100000:1.0:1788263264.504815:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 318 00000100:00100000:1.0:1788263264.504839:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a2692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+11:6158:x1875129699159040:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263264.504856:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263264.504876:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3ae764a00/0x4b1103cba666f4ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd405f293d116fd6e expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263264.504904:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3ae764a00/0x4b1103cba666f4ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd6e expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263264.504914:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3ae764a00/0x4b1103cba666f4ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd6e expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263264.504923:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae764a00, rc 0) 00000100:00100000:1.0:1788263264.504978:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a2692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+12:6158:x1875129699159040:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 141us (2942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263264.513997:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263264.514045:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699159168 00000100:00100000:0.0:1788263264.514054:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699159168 00000100:00100000:1.0:1788263264.515423:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 318 00000100:00100000:0.0:1788263264.521232:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 319 00000100:00100000:0.0:1788263264.521252:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a2692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+12:6158:x1875129699159168:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263264.521410:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a2692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+12:6158:x1875129699159168:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 164us (7421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263264.521419:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 319 00000100:00100000:0.0:1788263264.527689:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263264.528169:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699159296 00000100:00100000:2.0:1788263264.528180:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699159296 00000100:00100000:2.0:1788263264.528233:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 320 00000100:00100000:2.0:1788263264.528245:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+12:6158:x1875129699159296:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263264.528391:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+12:6158:x1875129699159296:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 148us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263264.528400:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 320 00000100:00100000:1.0:1788263264.536248:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263264.536457:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699159424 00000100:00100000:2.0:1788263264.536466:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699159424 00000100:00100000:2.0:1788263264.536525:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 321 00000100:00100000:2.0:1788263264.536534:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+12:6158:x1875129699159424:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263264.536550:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263264.536566:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff282f5d400/0x4b1103cba666f4b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd405f293d116fd75 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263264.536771:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff282f5d400/0x4b1103cba666f4b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd75 expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263264.536783:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff282f5d400/0x4b1103cba666f4b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd75 expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263264.536792:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff282f5d400, rc 0) 00000100:00100000:2.0:1788263264.536847:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:6158:x1875129699159424:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 314us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263264.536854:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 321 00000100:00100000:2.0:1788263264.543025:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263264.543094:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699159552 00000100:00100000:3.0:1788263264.543103:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699159552 00000100:00100000:3.0:1788263264.543157:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 322 00000100:00100000:3.0:1788263264.543168:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:6158:x1875129699159552:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263264.543317:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:6158:x1875129699159552:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 150us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263264.543324:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 322 00000100:00100000:3.0:1788263264.546944:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263264.546981:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699159680 00000100:00100000:3.0:1788263264.546990:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699159680 00000100:00100000:3.0:1788263264.547034:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 323 00000100:00100000:3.0:1788263264.547044:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:6158:x1875129699159680:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263264.547173:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:6158:x1875129699159680:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 129us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263264.547180:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 323 00010000:00010000:2.0:1788263264.944706:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788263264.944771:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788263264.944776:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff281faf000 from 7 10000000:01000000:3.0:1788263264.944781:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788263264.944819:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f4ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263264.944831:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f4ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263264.944843:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f4ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263264.944867:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709730432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788263264.944938:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263264.944984:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff383968f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263264.945091:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709730432 00000100:00100000:2.0:1788263264.945098:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709730432 00000100:00100000:2.0:1788263264.945147:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788263264.945156:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:6489:x1875129709730432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263264.945173:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263264.945185:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff282f5cc00/0x4b1103cba666f4c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f4ba expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263264.945206:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff282f5cc00/0x4b1103cba666f4c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f4ba expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263264.945216:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff282f5cc00/0x4b1103cba666f4c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f4ba expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263264.945225:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff282f5cc00, rc 0) 00000100:00100000:2.0:1788263264.945263:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709730432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263264.945270:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788263264.945364:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709730432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263264.945383:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f4ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f4c1 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263264.945391:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f4ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f4c1 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263264.945448:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709730560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263264.945472:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263264.945494:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff383968f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263264.945545:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709730560 00000100:00100000:2.0:1788263264.945549:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709730560 00000100:00100000:2.0:1788263264.945598:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788263264.945605:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709730560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263264.945710:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709730560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263264.945717:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788263264.945790:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709730560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263264.945877:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709730688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263264.945925:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263264.945949:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff383968f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263264.946044:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709730688 00000100:00100000:2.0:1788263264.946049:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709730688 00000100:00100000:2.0:1788263264.946074:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788263264.946080:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709730688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263264.946146:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709730688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263264.946161:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788263264.946193:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709730688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788263264.946834:0:13203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788263264.946885:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788263264.946967:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788263264.946976:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f4ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f4c1 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263264.946984:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f4ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f4c1 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263264.946993:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788263264.946995:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff3ae569800 from 7 10000000:01000000:2.0:1788263264.946998:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788263264.947020:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d200/0x4b1103cba666f4c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263264.947027:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d200/0x4b1103cba666f4c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263264.947034:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d200/0x4b1103cba666f4c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263264.947050:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709730816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788263264.947082:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263264.947100:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd14d900 going to sleep for 11 seconds 00000100:00100000:2.0:1788263264.947114:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709730816 00000100:00100000:2.0:1788263264.947118:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709730816 00000100:00100000:2.0:1788263264.947141:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788263264.947155:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709730816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263264.947164:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263264.947172:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff282f5de00/0x4b1103cba666f4cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f4c8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263264.947189:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff282f5de00/0x4b1103cba666f4cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f4c8 expref: 22 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263264.947198:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff282f5de00/0x4b1103cba666f4cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f4c8 expref: 22 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263264.947206:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff282f5de00, rc 0) 00000100:00100000:2.0:1788263264.947233:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:6489:x1875129709730816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263264.947239:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788263264.947266:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709730816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263264.947277:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d200/0x4b1103cba666f4c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f4cf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263264.947284:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d200/0x4b1103cba666f4c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f4cf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263264.947320:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709730944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263264.947341:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263264.947353:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd14d900 going to sleep for 11 seconds 00000100:00100000:2.0:1788263264.947363:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709730944 00000100:00100000:2.0:1788263264.947366:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709730944 00000100:00100000:2.0:1788263264.947384:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788263264.947397:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:6489:x1875129709730944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263264.947465:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:6489:x1875129709730944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 69us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263264.947471:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788263264.947496:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709730944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263264.947518:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709731072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263264.947550:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263264.947563:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd14d900 going to sleep for 11 seconds 00000100:00100000:2.0:1788263264.947574:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709731072 00000100:00100000:2.0:1788263264.947593:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709731072 00000100:00100000:2.0:1788263264.947614:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788263264.947620:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:6489:x1875129709731072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263264.947698:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:6489:x1875129709731072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263264.947704:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788263264.947833:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709731072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788263264.951414:0:13204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788263264.951921:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788263264.951941:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788263264.951952:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d200/0x4b1103cba666f4c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f4cf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263264.951964:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d200/0x4b1103cba666f4c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f4cf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263264.951973:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788263264.951975:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff38769d000 from 7 10000000:01000000:2.0:1788263264.951991:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788263264.952022:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d800/0x4b1103cba666f4d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263264.952030:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d800/0x4b1103cba666f4d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263264.952041:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d800/0x4b1103cba666f4d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263264.952064:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709731200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788263264.952122:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263264.952158:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd14d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788263264.953008:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709731200 00000100:00100000:3.0:1788263264.953016:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709731200 00000100:00100000:3.0:1788263264.953067:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788263264.953076:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:6489:x1875129709731200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263264.953089:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263264.953103:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f4dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f4d6 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263264.953124:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f4dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f4d6 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263264.953133:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f4dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f4d6 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263264.953154:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eece00, rc 0) 00000100:00100000:3.0:1788263264.953199:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:6489:x1875129709731200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263264.953205:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788263264.954724:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709731200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263264.954745:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d800/0x4b1103cba666f4d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f4dd expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263264.954755:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d800/0x4b1103cba666f4d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f4dd expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263264.954824:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709731328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263264.954866:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263264.954898:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd14d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788263264.954976:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709731328 00000100:00100000:3.0:1788263264.954982:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709731328 00000100:00100000:3.0:1788263264.955012:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788263264.955019:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:6489:x1875129709731328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263264.955120:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:6489:x1875129709731328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263264.955128:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788263264.955685:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709731328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263264.955718:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b55bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709731456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263264.955767:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263264.955798:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae57a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788263264.956766:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709731456 00000100:00100000:3.0:1788263264.956774:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709731456 00000100:00100000:3.0:1788263264.956817:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788263264.956826:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:6489:x1875129709731456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263264.956934:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:6489:x1875129709731456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263264.956941:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788263264.957512:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b55bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709731456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788263264.959930:0:13206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788263264.960660:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788263264.960684:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788263264.960695:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d800/0x4b1103cba666f4d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f4dd expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263264.960707:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d800/0x4b1103cba666f4d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f4dd expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263264.960731:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788263264.960733:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff3888e6000 from 7 10000000:01000000:3.0:1788263264.960736:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788263264.960768:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eed600/0x4b1103cba666f4e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263264.960776:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff398eed600/0x4b1103cba666f4e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263264.960786:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff398eed600/0x4b1103cba666f4e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263264.960808:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709731584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788263264.960868:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263264.960902:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae468a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788263264.961436:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709731584 00000100:00100000:2.0:1788263264.961444:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709731584 00000100:00100000:2.0:1788263264.961494:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788263264.961504:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:6489:x1875129709731584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263264.961535:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263264.961548:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff282f5d000/0x4b1103cba666f4eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f4e4 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263264.961571:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff282f5d000/0x4b1103cba666f4eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f4e4 expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263264.961611:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff282f5d000/0x4b1103cba666f4eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f4e4 expref: 24 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263264.961620:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff282f5d000, rc 0) 00000100:00100000:2.0:1788263264.961677:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:6489:x1875129709731584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263264.961684:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788263264.961731:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709731584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263264.961745:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff398eed600/0x4b1103cba666f4e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f4eb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263264.961754:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff398eed600/0x4b1103cba666f4e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f4eb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263264.961809:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709731712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263264.961835:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263264.961907:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae468a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788263264.961938:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709731712 00000100:00100000:2.0:1788263264.961942:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709731712 00000100:00100000:2.0:1788263264.961965:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788263264.961971:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:6489:x1875129709731712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263264.962107:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:6489:x1875129709731712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263264.962114:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788263264.962165:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709731712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263264.962191:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709731840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263264.962232:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263264.962287:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae468a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788263264.962320:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709731840 00000100:00100000:2.0:1788263264.962324:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709731840 00000100:00100000:2.0:1788263264.962381:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1788263264.962388:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:6489:x1875129709731840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263264.962479:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:6489:x1875129709731840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263264.962502:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788263264.962988:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709731840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788263264.965862:0:13209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788263264.966079:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788263264.966102:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788263264.966114:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eed600/0x4b1103cba666f4e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f4eb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263264.966125:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff398eed600/0x4b1103cba666f4e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f4eb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263265.395961:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263265.396047:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263265.396165:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699159936 00000100:00100000:2.0:1788263265.396175:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699159936 00000100:00100000:2.0:1788263265.396256:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699160192 00000100:00100000:2.0:1788263265.396260:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699160192 00000100:00100000:2.0:1788263265.396287:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 197 00000100:00100000:2.0:1788263265.396297:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2386:x1875129699159936:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263265.396423:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2386:x1875129699159936:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 126us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263265.396432:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 197 00000100:00100000:2.0:1788263265.396451:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 198 00000100:00100000:2.0:1788263265.396459:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699160192:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263265.396486:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699160192:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 29us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263265.396493:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 198 00000100:00080000:2.0:1788263265.396736:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263265.402446:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263265.402498:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263265.402522:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699159808 00000100:00100000:0.0:1788263265.402534:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699159808 00000100:00100000:2.0:1788263265.402549:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263265.402604:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699160064 00000100:00100000:2.0:1788263265.402610:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699160064 00000100:00100000:0.0:1788263265.402622:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 336 00000100:00100000:0.0:1788263265.402633:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2386:x1875129699159808:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263265.402669:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699160320 00000100:00100000:2.0:1788263265.402673:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699160320 00000100:00100000:2.0:1788263265.402703:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 199 00000100:00100000:0.0:1788263265.402712:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2386:x1875129699159808:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 79us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263265.402714:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699160064:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263265.402728:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 336 00000100:00100000:2.0:1788263265.402772:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699160064:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 60us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263265.402780:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 199 00000100:00100000:2.0:1788263265.402794:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 200 00000100:00100000:2.0:1788263265.402801:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699160320:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263265.402827:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699160320:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 26us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263265.402834:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 200 00000100:00080000:2.0:1788263265.402857:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788263265.970019:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263266.352527:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263266.352546:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b55bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709731968:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788263266.352623:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263266.352708:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709731968 00000100:00100000:0.0:1788263266.352717:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709731968 00000100:00100000:0.0:1788263266.352767:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788263266.352776:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709731968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788263266.352807:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788263266.352849:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709731968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263266.352856:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788263266.352902:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b55bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709731968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788263266.353022:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788263266.353032:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709732096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788263266.353061:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263266.353086:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709732096 00000100:00100000:3.0:1788263266.353090:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709732096 00000100:00100000:3.0:1788263266.353114:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788263266.353120:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709732096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788263266.353136:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788263266.353166:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709732096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 46us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263266.353171:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788263266.353210:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709732096:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788263266.992764:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788263267.400149:0:13358:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788263267.887985:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709732480:0@lo:400:kworker.0 00000100:00100000:1.0:1788263267.888197:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709732608:0@lo:400:kworker.0 00000100:00100000:1.0:1788263267.888234:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263267.888289:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709733120:0@lo:400:kworker.0 00000100:00100000:1.0:1788263267.888312:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263267.888333:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709733632:0@lo:400:kworker.0 00000100:00100000:2.0:1788263267.888423:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263267.888448:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875129709732992:0@lo:400:kworker.0 00000100:00100000:0.0:1788263267.888554:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709732224:0@lo:400:kworker.0 00000100:00100000:0.0:1788263267.888608:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263267.888733:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263267.888763:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709733120 00000100:00100000:2.0:1788263267.888770:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709733120 00000100:00100000:2.0:1788263267.888828:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788263267.888838:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709733120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263267.888887:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709733120:12345-0@lo:400:kworker.0 Request processed in 51us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263267.888894:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788263267.888917:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709732480 00000100:00100000:2.0:1788263267.888920:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709732480 00000100:00100000:2.0:1788263267.888946:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788263267.888952:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709732480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263267.888987:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709732480:12345-0@lo:400:kworker.0 Request processed in 35us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263267.889008:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788263267.889028:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709732608 00000100:00100000:2.0:1788263267.889032:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709732608 00000100:00100000:2.0:1788263267.889052:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709732992 00000100:00100000:2.0:1788263267.889552:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709732992 00000100:00100000:2.0:1788263267.889612:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788263267.889620:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709732608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263267.889674:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709732608:12345-0@lo:400:kworker.0 Request processed in 55us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263267.889680:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788263267.889692:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788263267.889699:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875129709732992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263267.889728:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875129709732992:12345-0@lo:400:kworker.0 Request processed in 30us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263267.889733:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:2.0:1788263267.889749:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788263267.889754:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263267.889809:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709732224 00000100:00100000:2.0:1788263267.889813:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709732224 00000100:00100000:2.0:1788263267.889837:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788263267.889843:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3621:x1875129709732224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263267.889874:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3621:x1875129709732224:12345-0@lo:400:kworker.0 Request processed in 32us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263267.889880:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788263267.889910:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709732352:0@lo:400:kworker.0 00000100:00100000:2.0:1788263267.889937:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263267.889986:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709732352 00000100:00100000:2.0:1788263267.889990:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709732352 00000100:00100000:2.0:1788263267.890011:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788263267.890016:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709732352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263267.890048:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709732352:12345-0@lo:400:kworker.0 Request processed in 31us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263267.890200:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263267.890222:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709733632 00000100:00100000:1.0:1788263267.890225:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709733632 00000100:00100000:1.0:1788263267.890255:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788263267.890262:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709733632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263267.890294:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709733632:12345-0@lo:400:kworker.0 Request processed in 33us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263267.890301:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1788263267.890317:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788263267.890511:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709732224:0@lo:400:kworker.0 00000100:00100000:0.0:1788263267.890521:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709732736:0@lo:400:kworker.0 00000100:00100000:0.0:1788263267.890556:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263267.890593:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709732736 00000100:00100000:0.0:1788263267.890597:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709732736 00000100:00100000:0.0:1788263267.890634:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788263267.890642:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709732736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263267.890677:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709732736:12345-0@lo:400:kworker.0 Request processed in 36us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263267.890683:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788263267.890919:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00010000:00080000:1.0:1788263267.890994:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833e1180 x1875129709732992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263267.891007:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875129709732992:0@lo:400:kworker.0 00000100:00100000:1.0:1788263267.891014:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28233b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709733504:0@lo:400:kworker.0 00000100:00100000:1.0:1788263267.891041:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263267.891100:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709732480:0@lo:400:kworker.0 00000100:00100000:1.0:1788263267.891114:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788263267.891119:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709733888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263267.891144:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263267.891270:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709733888 00000100:00100000:3.0:1788263267.891276:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709733888 00000100:00100000:3.0:1788263267.891322:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788263267.891330:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709733888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788263267.891375:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263267.891416:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709733888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263267.891423:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:3.0:1788263267.891455:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2831f1c00 x1875129709733888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263267.891479:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709733888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263267.891737:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709732352:0@lo:400:kworker.0 00000100:00100000:0.0:1788263267.891745:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709732864:0@lo:400:kworker.0 00000100:00100000:0.0:1788263267.891771:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263267.891794:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875129709733376:0@lo:400:kworker.0 00000100:00100000:0.0:1788263267.891814:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263267.891846:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709733504 00000100:00100000:0.0:1788263267.891850:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709733504 00000100:00100000:0.0:1788263267.891874:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709732864 00000100:00100000:0.0:1788263267.891877:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709732864 00000100:00100000:0.0:1788263267.891892:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709733376 00000100:00100000:0.0:1788263267.891894:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709733376 00000100:00100000:0.0:1788263267.891907:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788263267.891914:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875129709733504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263267.891948:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875129709733504:12345-0@lo:400:kworker.0 Request processed in 35us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263267.891955:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788263267.891967:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788263267.891973:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709732864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263267.892015:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709732864:12345-0@lo:400:kworker.0 Request processed in 42us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263267.892021:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788263267.892033:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788263267.892039:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875129709733376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263267.892164:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875129709733376:12345-0@lo:400:kworker.0 Request processed in 124us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263267.892171:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788263267.892199:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709732864:0@lo:400:kworker.0 00000100:00100000:0.0:1788263267.892209:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875129709733376:0@lo:400:kworker.0 00000100:00080000:1.0:1788263267.892287:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788263267.892292:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788263267.892294:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788263267.892366:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28233b480 x1875129709733504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263267.892376:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28233b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709733504:0@lo:400:kworker.0 00010000:00080000:3.0:1788263267.892417:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff282338700 x1875129709733632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263267.892426:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709733632:0@lo:400:kworker.0 00000100:00100000:3.0:1788263267.892443:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709732608:0@lo:400:kworker.0 00010000:00080000:3.0:1788263267.892453:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833e2a00 x1875129709733120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263267.892460:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709733120:0@lo:400:kworker.0 00000100:00100000:0.0:1788263267.892648:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709732736:0@lo:400:kworker.0 00000100:00100000:0.0:1788263267.892656:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709733248:0@lo:400:kworker.0 00000100:00100000:0.0:1788263267.892685:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263267.892718:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709733760:0@lo:400:kworker.0 00000100:00100000:0.0:1788263267.892739:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263267.892824:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709733248 00000100:00100000:1.0:1788263267.892829:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709733248 00000100:00100000:1.0:1788263267.892872:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709733760 00000100:00100000:1.0:1788263267.892875:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709733760 00000100:00100000:1.0:1788263267.892892:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788263267.892899:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709733248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263267.892947:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709733248:12345-0@lo:400:kworker.0 Request processed in 49us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263267.892953:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788263267.892966:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788263267.892972:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709733760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263267.892996:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709733760:12345-0@lo:400:kworker.0 Request processed in 25us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263267.893002:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:1.0:1788263267.893033:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283324000 x1875129709733248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263267.893043:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283324000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709733248:0@lo:400:kworker.0 00010000:00080000:1.0:1788263267.893168:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff282338380 x1875129709733760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263267.893179:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709733760:0@lo:400:kworker.0 00000100:00080000:0.0:1788263267.893302:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788263268.016961:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263268.399863:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709734016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788263268.399934:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263268.400070:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709734016 00000100:00100000:1.0:1788263268.400078:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709734016 00000100:00100000:1.0:1788263268.400130:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788263268.400147:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709734016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788263268.400169:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263268.400237:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709734016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263268.400245:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:2.0:1788263268.400332:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28178f100 x1875129709734016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263268.400351:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709734016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788263268.913247:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788263268.913277:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709734144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788263268.913368:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263268.913660:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709734144 00000100:00100000:3.0:1788263268.913672:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709734144 00000100:00100000:3.0:1788263268.916981:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788263268.917012:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709734144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788263268.917052:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263268.917157:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709734144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (3788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263268.917164:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:2.0:1788263268.917827:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2831f0a80 x1875129709734144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263268.917849:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709734144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788263268.918113:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788263268.918124:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709734272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788263268.918162:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263268.920037:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709734272 00000100:00100000:3.0:1788263268.920050:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709734272 00000100:00100000:3.0:1788263268.920110:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788263268.920120:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709734272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788263268.920142:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263268.920201:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709734272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (2038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263268.920209:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:2.0:1788263268.921125:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28312e680 x1875129709734272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263268.921147:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709734272:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788263269.041971:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263270.064158:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263270.525735:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263270.525783:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263270.525824:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263270.525873:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263270.525900:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263270.525925:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699160576 00000100:00100000:1.0:1788263270.525933:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699160576 00000100:00100000:1.0:1788263270.525985:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699160832 00000100:00100000:1.0:1788263270.525988:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699160832 00000100:00100000:1.0:1788263270.526001:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699160704 00000100:00100000:1.0:1788263270.526004:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699160704 00000100:00100000:1.0:1788263270.526015:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699160960 00000100:00100000:1.0:1788263270.526017:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699160960 00000100:00100000:1.0:1788263270.526032:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 207 00000100:00100000:1.0:1788263270.526041:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2387:x1875129699160576:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263270.526123:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2387:x1875129699160576:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 82us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263270.526131:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 207 00000100:00100000:1.0:1788263270.526147:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 208 00000100:00100000:1.0:1788263270.526154:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699160832:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263270.526179:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699160832:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 26us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263270.526185:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 208 00000100:00100000:1.0:1788263270.526197:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 209 00000100:00100000:1.0:1788263270.526204:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699160704:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263270.526225:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699160704:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 23us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263270.526232:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 209 00000100:00100000:1.0:1788263270.526256:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 210 00000100:00100000:1.0:1788263270.526272:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699160960:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263270.526309:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699160960:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 39us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263270.526316:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 210 00000100:00080000:0.0:1788263270.526645:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788263270.526649:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263270.526839:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699160448 00000100:00100000:3.0:1788263270.526844:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699160448 00000100:00100000:3.0:1788263270.526882:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 338 00000100:00100000:3.0:1788263270.526890:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2387:x1875129699160448:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263270.526921:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2387:x1875129699160448:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 31us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263270.526927:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 338 00010000:00010000:2.0:1788263271.087739:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263271.475300:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b55bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709734400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788263271.475369:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263271.475438:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709734400 00000100:00100000:0.0:1788263271.475445:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709734400 00000100:00100000:0.0:1788263271.475500:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788263271.475510:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709734400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788263271.475553:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788263271.475631:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709734400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263271.475638:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788263271.475694:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b55bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709734400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788263271.476460:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709734528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788263271.476510:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263271.476556:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709734528 00000100:00100000:2.0:1788263271.476562:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709734528 00000100:00100000:2.0:1788263271.476631:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788263271.476638:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709734528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788263271.476659:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788263271.476715:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709734528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263271.476721:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788263271.476755:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709734528:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788263272.111883:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263273.010132:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788263273.010179:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709734656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263273.010304:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263273.010405:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709734656 00000100:00100000:0.0:1788263273.010415:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709734656 00000100:00100000:0.0:1788263273.010518:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788263273.010530:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709734656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263273.010574:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263273.010663:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709734656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263273.010671:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1788263273.010697:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788263273.010739:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2831f0a80 x1875129709734656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263273.010764:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709734656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263273.012018:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709734912:0@lo:400:kworker.0 00000100:00100000:0.0:1788263273.012115:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263273.012169:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28233b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709735424:0@lo:400:kworker.0 00000100:00100000:0.0:1788263273.012196:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263273.012246:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875129709735936:0@lo:400:kworker.0 00000100:00100000:0.0:1788263273.012269:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263273.012294:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788263273.012300:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709735040:0@lo:400:kworker.0 00000100:00100000:0.0:1788263273.012325:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263273.012345:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709735552:0@lo:400:kworker.0 00000100:00100000:0.0:1788263273.012366:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263273.012380:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709736064:0@lo:400:kworker.0 00000100:00100000:0.0:1788263273.012400:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263273.012435:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709734912 00000100:00100000:0.0:1788263273.012443:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709734912 00000100:00100000:0.0:1788263273.013054:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709735424 00000100:00100000:0.0:1788263273.013062:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709735424 00000100:00100000:0.0:1788263273.013101:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709735936 00000100:00100000:0.0:1788263273.013164:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709735936 00000100:00100000:0.0:1788263273.013186:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709735552 00000100:00100000:0.0:1788263273.013189:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709735552 00000100:00100000:0.0:1788263273.013204:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709736064 00000100:00100000:0.0:1788263273.013207:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709736064 00000100:00100000:0.0:1788263273.013226:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788263273.013236:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709734912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263273.013313:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709734912:12345-0@lo:400:kworker.0 Request processed in 77us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263273.013321:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788263273.013342:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788263273.013348:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709735424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263273.013377:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709735424:12345-0@lo:400:kworker.0 Request processed in 30us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263273.013399:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788263273.013413:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788263273.013419:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875129709735936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263273.013449:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875129709735936:12345-0@lo:400:kworker.0 Request processed in 31us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263273.013455:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788263273.013703:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709735168:0@lo:400:kworker.0 00000100:00100000:2.0:1788263273.013745:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263273.013767:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709735680:0@lo:400:kworker.0 00000100:00100000:2.0:1788263273.013794:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263273.013818:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709736192:0@lo:400:kworker.0 00000100:00100000:2.0:1788263273.013841:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263273.013867:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788263273.013874:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709734784:0@lo:400:kworker.0 00000100:00100000:2.0:1788263273.013905:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263273.013933:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff282338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709735296:0@lo:400:kworker.0 00000100:00100000:2.0:1788263273.013958:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263273.014804:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709735808:0@lo:400:kworker.0 00000100:00100000:2.0:1788263273.014878:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263273.014951:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709735168 00000100:00100000:2.0:1788263273.014959:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709735168 00000100:00100000:2.0:1788263273.015189:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788263273.015203:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709735552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263273.015264:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709735552:12345-0@lo:400:kworker.0 Request processed in 64us (2896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263273.015280:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788263273.015295:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788263273.015303:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875129709736064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263273.015339:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875129709736064:12345-0@lo:400:kworker.0 Request processed in 37us (2937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263273.015345:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788263273.015357:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788263273.015363:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709735168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263273.015396:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709735168:12345-0@lo:400:kworker.0 Request processed in 33us (1651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263273.015402:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788263273.015426:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709735040 00000100:00100000:2.0:1788263273.015431:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709735040 00000100:00100000:2.0:1788263273.015455:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709735296 00000100:00100000:2.0:1788263273.015472:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709735296 00000100:00100000:2.0:1788263273.015491:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788263273.015510:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709735040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263273.015549:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709735040:12345-0@lo:400:kworker.0 Request processed in 52us (3223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263273.015556:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788263273.015569:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788263273.015575:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709735296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263273.015636:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709735296:12345-0@lo:400:kworker.0 Request processed in 61us (1676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263273.015642:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788263273.015684:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709735680 00000100:00100000:2.0:1788263273.015689:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709735680 00000100:00100000:2.0:1788263273.015720:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709736192 00000100:00100000:2.0:1788263273.015723:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709736192 00000100:00100000:2.0:1788263273.015738:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709735808 00000100:00100000:2.0:1788263273.015740:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709735808 00000100:00100000:2.0:1788263273.015752:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788263273.015757:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709735680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263273.015790:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709735680:12345-0@lo:400:kworker.0 Request processed in 33us (1996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263273.015797:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788263273.015807:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788263273.015813:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709736192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263273.015841:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709736192:12345-0@lo:400:kworker.0 Request processed in 28us (1999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263273.015847:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788263273.015857:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788263273.015863:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709735808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263273.015886:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709735808:12345-0@lo:400:kworker.0 Request processed in 23us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263273.015891:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788263273.015914:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709734784 00000100:00100000:2.0:1788263273.015918:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709734784 00000100:00100000:2.0:1788263273.015943:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1788263273.015949:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3620:x1875129709734784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263273.015979:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3620:x1875129709734784:12345-0@lo:400:kworker.0 Request processed in 31us (2074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263273.015994:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1788263273.016062:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709734784:0@lo:400:kworker.0 00000100:00100000:2.0:1788263273.016078:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709735296:0@lo:400:kworker.0 00010000:00080000:2.0:1788263273.016090:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28387fb80 x1875129709735808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263273.016102:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709735808:0@lo:400:kworker.0 00000100:00100000:2.0:1788263273.016115:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff282338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709735168:0@lo:400:kworker.0 00010000:00080000:2.0:1788263273.016125:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28387df80 x1875129709735680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263273.016133:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709735680:0@lo:400:kworker.0 00010000:00080000:2.0:1788263273.016143:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5637480 x1875129709736192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263273.016151:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709736192:0@lo:400:kworker.0 00000100:00080000:0.0:1788263273.017153:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788263273.017161:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788263273.017164:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788263273.017167:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263273.017217:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709735040:0@lo:400:kworker.0 00010000:00080000:0.0:1788263273.017234:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff281e3bb80 x1875129709735552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263273.017245:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709735552:0@lo:400:kworker.0 00010000:00080000:0.0:1788263273.017257:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5634e00 x1875129709736064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263273.017265:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709736064:0@lo:400:kworker.0 00000100:00100000:0.0:1788263273.017279:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709734912:0@lo:400:kworker.0 00000100:00100000:0.0:1788263273.017291:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28233b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709735424:0@lo:400:kworker.0 00000100:00100000:0.0:1788263273.017302:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875129709735936:0@lo:400:kworker.0 00010000:00010000:0.0:1788263273.136187:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263273.524630:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709736320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788263273.524805:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263273.525044:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709736320 00000100:00100000:1.0:1788263273.525054:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709736320 00000100:00100000:1.0:1788263273.525125:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788263273.525139:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709736320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788263273.525170:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263273.525230:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709736320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263273.525238:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:1.0:1788263273.525285:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833e0000 x1875129709736320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263273.525308:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709736320:0@lo:13:osp-pre-1-1.0 00000001:02000400:1.0:1788263273.743305:0:13506:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 07:47:51 (1788263271) === 00000100:00100000:3.0:1788263274.015893:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263274.015962:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263274.016000:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699161216 00000100:00100000:3.0:1788263274.016013:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699161216 00000100:00100000:3.0:1788263274.016091:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:3.0:1788263274.016105:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:10467:x1875129699161216:12345-192.168.203.26@tcp:700:mkdir.0 00000100:00100000:3.0:1788263274.016209:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:10467:x1875129699161216:12345-192.168.203.26@tcp:700:mkdir.0 Request processed in 105us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263274.016219:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:2.0:1788263274.016879:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699161088 00000100:00100000:2.0:1788263274.016887:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699161088 00000100:00100000:2.0:1788263274.016932:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:2.0:1788263274.016942:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2387:x1875129699161088:12345-192.168.203.26@tcp:41:mkdir.0 00000004:00000024:2.0:1788263274.016978:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788263274.017058:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2387:x1875129699161088:12345-192.168.203.26@tcp:41:mkdir.0 Request processed in 117us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263274.017067:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00080000:1.0:1788263274.019167:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263274.022229:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263274.022275:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699161472 00000100:00100000:3.0:1788263274.022287:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699161472 00000100:00100000:3.0:1788263274.022351:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:3.0:1788263274.022364:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:10467:x1875129699161472:12345-192.168.203.26@tcp:36:mkdir.0 00010000:00010000:3.0:1788263274.022437:0:10388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263274.030776:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ee00/0x4b1103cba666f394 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fce9 expref: 6 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.030801:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff28314fb00) 00010000:00010000:3.0:1788263274.030840:0:10388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263274.030938:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f4f2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.030952:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f4f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.030963:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f4f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.030990:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f4f9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.031012:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f4f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.031020:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f4f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.037007:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666f500 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.037029:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666f500 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.037041:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666f500 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788263274.037057:0:10388:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a4284b9 reply state 000000009e9b0fdb transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666f500 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.037068:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666f500 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.037075:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ff282128500) 00010000:00010000:3.0:1788263274.037077:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788263274.037081:0:10388:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788263274.037087:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788263274.037094:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f4f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.037100:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f4f2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.037106:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f4f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.037120:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eec600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263274.037125:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f4f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.037132:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f4f2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.037143:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff282128800) 00010000:00010000:3.0:1788263274.037145:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263274.037147:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f4f2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.037153:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f4f2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788263274.037171:0:10388:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a4284b9 reply state 000000009e9b0fdb transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f4f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.037189:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f4f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.037195:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ff282128600) 00010000:00010000:3.0:1788263274.037197:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788263274.037199:0:10388:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788263274.037394:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:10467:x1875129699161472:12345-192.168.203.26@tcp:36:mkdir.0 Request processed in 15028us (15175us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788263274.037404:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:2.0:1788263274.040248:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709736576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788263274.040350:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263274.040488:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788263274.040498:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709736448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788263274.040525:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263274.040893:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709736576 00000100:00100000:3.0:1788263274.040908:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709736576 00000100:00100000:3.0:1788263274.040977:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709736448 00000100:00100000:3.0:1788263274.040995:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709736448 00000100:00100000:3.0:1788263274.041021:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788263274.041030:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709736576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788263274.041062:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263274.041138:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709736576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263274.041144:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788263274.041159:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788263274.041166:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709736448:12345-0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788263274.042250:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283823100 x1875129709736576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263274.042284:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709736576:0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788263274.042923:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263274.043041:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283820a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709736448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1872us (2511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263274.043051:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:2.0:1788263274.043874:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283821880 x1875129709736448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263274.043901:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709736448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788263274.056237:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263274.056367:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699161600 00000100:00100000:1.0:1788263274.056380:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699161600 00000100:00100000:1.0:1788263274.056449:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:1.0:1788263274.056461:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:10468:x1875129699161600:12345-192.168.203.26@tcp:101:chmod.0 00010000:00010000:1.0:1788263274.056490:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263274.056524:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764c00/0x4b1103cba666f507 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fd7c expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.056742:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764000/0x4b1103cba666f50e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.056775:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764000/0x4b1103cba666f50e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.056791:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764000/0x4b1103cba666f50e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263274.056852:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788263274.056857:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788263274.056901:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764000/0x4b1103cba666f50e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.056932:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764c00/0x4b1103cba666f507 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd7c expref: 9 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.056954:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764000/0x4b1103cba666f50e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd7c expref: 8 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.056964:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff3c205dd00) 00010000:00010000:1.0:1788263274.056967:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788263274.056972:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae764000, rc 0) 00000100:00100000:1.0:1788263274.057157:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:10468:x1875129699161600:12345-192.168.203.26@tcp:101:chmod.0 Request processed in 697us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263274.057166:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:2.0:1788263274.062235:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263274.065171:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699161856 00000100:00100000:0.0:1788263274.065191:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699161856 00000100:00100000:0.0:1788263274.065352:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:0.0:1788263274.065365:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:10468:x1875129699161856:12345-192.168.203.26@tcp:36:chmod.0 00010000:00010000:0.0:1788263274.065453:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263274.065488:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764000/0x4b1103cba666f50e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd7c expref: 8 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.065513:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff3c205dd00) 00010000:00010000:0.0:1788263274.065526:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788263274.065563:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f515 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.065610:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f515 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.065623:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f515 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788263274.065895:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023fc9e5e reply state 000000002efcc54e transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f515 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.065911:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f515 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.065917:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff28314f900) 00010000:00010000:0.0:1788263274.065919:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788263274.065922:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788263274.065931:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788263274.066067:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:10468:x1875129699161856:12345-192.168.203.26@tcp:36:chmod.0 Request processed in 704us (3847us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788263274.066077:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:3.0:1788263274.132195:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263274.136037:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699161984 00000100:00100000:2.0:1788263274.136131:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699161984 00000100:00100000:3.0:1788263274.139480:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00100000:3.0:1788263274.139499:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:10469:x1875129699161984:12345-192.168.203.26@tcp:101:chown.0 00010000:00010000:3.0:1788263274.139534:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263274.139562:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f51c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fd83 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.139702:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba666f523 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.139720:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba666f523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.139735:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba666f523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263274.139824:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788263274.139829:0:10388:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788263274.139877:0:10388:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba666f523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.139910:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f51c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd83 expref: 11 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.139934:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba666f523 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd83 expref: 10 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.139944:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff28314f900) 00010000:00010000:3.0:1788263274.139948:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788263274.139952:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eec200, rc 0) 00000100:00100000:3.0:1788263274.141897:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+10:10469:x1875129699161984:12345-192.168.203.26@tcp:101:chown.0 Request processed in 549us (7864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263274.141915:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00100000:1.0:1788263274.148010:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263274.150274:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699162112 00000100:00100000:2.0:1788263274.150295:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699162112 00000100:00100000:2.0:1788263274.150443:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:2.0:1788263274.150523:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+10:10469:x1875129699162112:12345-192.168.203.26@tcp:101:chown.0 00010000:00010000:2.0:1788263274.150555:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263274.150621:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c400/0x4b1103cba666f52a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fd8a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.150717:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c800/0x4b1103cba666f531 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.150737:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c800/0x4b1103cba666f531 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.150855:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c800/0x4b1103cba666f531 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.150870:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5da00/0x4b1103cba666f538 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.150878:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5da00/0x4b1103cba666f538 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.150885:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5da00/0x4b1103cba666f538 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.150990:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5dc00/0x4b1103cba666f53f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.150999:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5dc00/0x4b1103cba666f53f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.151007:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5dc00/0x4b1103cba666f53f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263274.151994:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788263274.152003:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788263274.152037:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5dc00/0x4b1103cba666f53f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.152663:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c800/0x4b1103cba666f531 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.152672:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c800/0x4b1103cba666f531 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.152702:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c800/0x4b1103cba666f531 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.152709:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff282f5c800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263274.152715:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c800/0x4b1103cba666f531 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.152724:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c800/0x4b1103cba666f531 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.152744:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff28314f900) 00010000:00010000:2.0:1788263274.152823:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263274.153114:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c800/0x4b1103cba666f531 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.153125:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c800/0x4b1103cba666f531 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.153153:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5da00/0x4b1103cba666f538 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.153161:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5da00/0x4b1103cba666f538 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.153168:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5da00/0x4b1103cba666f538 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.153175:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff282f5da00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263274.153179:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5da00/0x4b1103cba666f538 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.153199:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5da00/0x4b1103cba666f538 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.153209:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ff282128600) 00010000:00010000:2.0:1788263274.153212:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263274.153216:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5da00/0x4b1103cba666f538 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.153223:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5da00/0x4b1103cba666f538 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.153279:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c400/0x4b1103cba666f52a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd8a expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.153298:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5dc00/0x4b1103cba666f53f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd8a expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.153307:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ff282128500) 00010000:00010000:2.0:1788263274.153309:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788263274.153312:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff282f5dc00, rc 0) 00000100:00100000:2.0:1788263274.153428:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+11:10469:x1875129699162112:12345-192.168.203.26@tcp:101:chown.0 Request processed in 2900us (5422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263274.153440:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 27 00010000:00010000:2.0:1788263274.159784:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263274.170404:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263274.178186:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699162240 00000100:00100000:2.0:1788263274.178207:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699162240 00000100:00100000:1.0:1788263274.196139:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:1.0:1788263274.196159:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+11:10469:x1875129699162240:12345-192.168.203.26@tcp:900:chown.0 00000100:00100000:1.0:1788263274.196306:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+11:10469:x1875129699162240:12345-192.168.203.26@tcp:900:chown.0 Request processed in 151us (25919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263274.196334:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:3.0:1788263274.200574:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263274.200791:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699162496 00000100:00100000:0.0:1788263274.200805:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699162496 00000100:00100000:0.0:1788263274.200879:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:0.0:1788263274.200892:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+11:10469:x1875129699162496:12345-192.168.203.26@tcp:36:chown.0 00010000:00010000:0.0:1788263274.200965:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263274.201001:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5dc00/0x4b1103cba666f53f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd8a expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.201032:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ff282128500) 00010000:00010000:0.0:1788263274.201038:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788263274.201081:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f546 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.201098:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f546 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.201111:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f546 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788263274.214291:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:0.0:1788263274.214442:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000095870a10 reply state 0000000032ab1096 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f546 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.214491:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f546 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.214503:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ff282128500) 00010000:00010000:0.0:1788263274.214506:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788263274.214533:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788263274.214550:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:0.0:1788263274.214759:0:6491:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788263274.214787:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:10469:x1875129699162496:12345-192.168.203.26@tcp:36:chown.0 Request processed in 13890us (14221us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788263274.214798:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 28 00010000:00010000:1.0:1788263274.215246:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f4f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.215259:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f4f9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.215268:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f4f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.215275:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eeca00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263274.215281:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f4f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.215290:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f4f9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.215307:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ff282128600) 00010000:00010000:1.0:1788263274.215310:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263274.215314:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f4f9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.215320:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f4f9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.215352:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666f500 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.215358:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666f500 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.215382:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666f500 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.215387:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eeda00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263274.215391:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666f500 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.215397:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666f500 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.215405:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ff282128500) 00010000:00010000:1.0:1788263274.215408:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263274.215411:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666f500 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.215416:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666f500 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.215430:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f515 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.215435:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f515 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.215440:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f515 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.215457:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17f800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263274.215460:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f515 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.215475:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f515 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.215485:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff28314f900) 00010000:00010000:1.0:1788263274.215487:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788263274.215490:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f515 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.215496:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f515 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.216573:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f546 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.216661:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f546 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.216668:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f546 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.216675:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17e400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263274.216680:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f546 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.216687:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f546 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.216706:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ff282128500) 00010000:00010000:2.0:1788263274.216709:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788263274.216714:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f546 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.216720:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f546 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263274.242120:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263274.243712:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699162624 00000100:00100000:0.0:1788263274.243725:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699162624 00000100:00100000:0.0:1788263274.243789:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:0.0:1788263274.243799:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:10470:x1875129699162624:12345-192.168.203.26@tcp:101:touch.500 00010000:00010000:0.0:1788263274.243830:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263274.243858:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f54d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fd91 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788263274.245953:0:10388:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2041us 00010000:00010000:1.0:1788263274.277399:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764c00/0x4b1103cba666f554 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.277436:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764c00/0x4b1103cba666f554 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.277449:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764c00/0x4b1103cba666f554 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.277467:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765800/0x4b1103cba666f55b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.277474:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765800/0x4b1103cba666f55b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.277480:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765800/0x4b1103cba666f55b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.277627:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764000/0x4b1103cba666f562 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.277642:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764000/0x4b1103cba666f562 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.277649:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764000/0x4b1103cba666f562 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263274.277683:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788263274.277688:0:10388:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788263274.277723:0:10388:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764000/0x4b1103cba666f562 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.277735:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764c00/0x4b1103cba666f554 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.277742:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764c00/0x4b1103cba666f554 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.277748:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764c00/0x4b1103cba666f554 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.277754:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae764c00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263274.277758:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764c00/0x4b1103cba666f554 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.277765:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764c00/0x4b1103cba666f554 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.277777:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff28314f900) 00010000:00010000:1.0:1788263274.277780:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263274.277785:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764c00/0x4b1103cba666f554 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.277801:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764c00/0x4b1103cba666f554 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.277814:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765800/0x4b1103cba666f55b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.277821:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765800/0x4b1103cba666f55b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.277842:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765800/0x4b1103cba666f55b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.277848:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263274.277851:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765800/0x4b1103cba666f55b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.277858:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765800/0x4b1103cba666f55b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.277866:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ff3c205da00) 00010000:00010000:1.0:1788263274.277869:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263274.277871:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765800/0x4b1103cba666f55b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.277876:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765800/0x4b1103cba666f55b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.277914:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f54d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd91 expref: 8 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.277929:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764000/0x4b1103cba666f562 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd91 expref: 7 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.277943:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ff3c205d000) 00010000:00010000:1.0:1788263274.277945:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788263274.277947:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae764000, rc 0) 00000100:00100000:1.0:1788263274.278024:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:10470:x1875129699162624:12345-192.168.203.26@tcp:101:touch.500 Request processed in 34225us (35911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263274.278032:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:1.0:1788263274.309976:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263274.314310:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699162880 00000100:00100000:2.0:1788263274.316491:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699162880 00000100:00100000:2.0:1788263274.316610:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 30 00000100:00100000:2.0:1788263274.316622:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:10470:x1875129699162880:12345-192.168.203.26@tcp:101:touch.500 00010000:00010000:2.0:1788263274.316641:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263274.316661:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c400/0x4b1103cba666f569 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fd98 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.316779:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5da00/0x4b1103cba666f570 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.316805:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5da00/0x4b1103cba666f570 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.316816:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5da00/0x4b1103cba666f570 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.316869:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c800/0x4b1103cba666f577 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.316877:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c800/0x4b1103cba666f577 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.316884:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c800/0x4b1103cba666f577 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788263274.317851:0:6492:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788263274.318011:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5ca00/0x4b1103cba666f57e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.318752:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5ca00/0x4b1103cba666f57e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.318767:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5ca00/0x4b1103cba666f57e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.318808:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5da00/0x4b1103cba666f570 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.318815:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5da00/0x4b1103cba666f570 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.318823:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5da00/0x4b1103cba666f570 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.318847:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff282f5da00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263274.318852:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5da00/0x4b1103cba666f570 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.318860:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5da00/0x4b1103cba666f570 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.318873:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ff3c205d000) 00010000:00010000:2.0:1788263274.318877:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263274.318882:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5da00/0x4b1103cba666f570 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.318888:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5da00/0x4b1103cba666f570 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788263274.318908:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb86c094 reply state 00000000adee1626 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c800/0x4b1103cba666f577 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.318919:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c800/0x4b1103cba666f577 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.318924:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x8cc2b6f3 (ffff9ff3b3a5ea00) 00010000:00010000:2.0:1788263274.318927:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788263274.318929:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788263274.318966:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c400/0x4b1103cba666f569 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd98 expref: 10 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.318981:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5ca00/0x4b1103cba666f57e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd98 expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.318999:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ff3b3a5e200) 00010000:00010000:2.0:1788263274.319001:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788263274.319004:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff282f5ca00, rc 0) 00000100:00100000:2.0:1788263274.320243:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+10:10470:x1875129699162880:12345-192.168.203.26@tcp:101:touch.500 Request processed in 3617us (10669us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788263274.320255:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 30 00000100:00100000:2.0:1788263274.339921:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263274.340002:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699163136 00000100:00100000:0.0:1788263274.340012:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699163136 00000100:00100000:0.0:1788263274.340068:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 31 00000100:00100000:0.0:1788263274.340078:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+10:10470:x1875129699163136:12345-192.168.203.26@tcp:36:touch.500 00010000:00010000:0.0:1788263274.340132:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263274.340160:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5ca00/0x4b1103cba666f57e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd98 expref: 10 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.340180:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ff3b3a5e200) 00010000:00010000:0.0:1788263274.340190:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788263274.340244:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f58c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.340256:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f58c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.340283:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f58c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788263274.340382:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006fbf46a6 reply state 00000000150df8bf transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f58c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.340396:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f58c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.340403:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ff28314f300) 00010000:00010000:0.0:1788263274.340406:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788263274.340408:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788263274.349343:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+11:10470:x1875129699163136:12345-192.168.203.26@tcp:36:touch.500 Request processed in 9245us (9410us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788263274.349356:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 31 00000100:00100000:1.0:1788263274.368065:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263274.368776:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699163264 00000100:00100000:3.0:1788263274.368787:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699163264 00000100:00100000:3.0:1788263274.368847:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 32 00000100:00100000:3.0:1788263274.368858:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+11:10470:x1875129699163264:12345-192.168.203.26@tcp:101:touch.500 00010000:00010000:3.0:1788263274.368881:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263274.368900:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f593 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fd9f expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.368969:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f593 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd9f expref: 12 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.368984:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f593 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd9f expref: 12 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.369002:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ff28314f300) 00010000:00010000:3.0:1788263274.369006:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788263274.369009:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eec600, rc 0) 00000100:00100000:3.0:1788263274.369068:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+12:10470:x1875129699163264:12345-192.168.203.26@tcp:101:touch.500 Request processed in 210us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263274.369075:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 32 00000100:00100000:1.0:1788263274.373128:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263274.373216:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699163392 00000100:00100000:3.0:1788263274.373226:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699163392 00000100:00100000:3.0:1788263274.373272:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:3.0:1788263274.373280:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2385:x1875129699163392:12345-192.168.203.26@tcp:8:touch.500 00010000:00080000:3.0:1788263274.373310:0:8405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:3.0:1788263274.373339:0:8405:0:(genops.c:1385:class_connect()) connect: client ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea, cookie 0x4b1103cba666f59a 00002000:00100000:3.0:1788263274.373351:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea/ffff9ff283215000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788263274.373361:0:8405:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788263274.373446:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788263274.373474:0:8405:0:(import.c:65:import_set_state_nolock()) ffff9ff283210800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788263274.373531:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2385:x1875129699163392:12345-192.168.203.26@tcp:8:touch.500 Request processed in 250us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263274.373555:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:3.0:1788263274.384231:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263274.384527:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699163520 00000100:00100000:2.0:1788263274.384537:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699163520 00000100:00100000:2.0:1788263274.384646:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:2.0:1788263274.384657:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:0:x1875129699163520:12345-192.168.203.26@tcp:2:touch.500 00000100:00080000:1.0:1788263274.387106:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788263274.387230:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:2.0:1788263274.387240:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea 00000100:00100000:0.0:1788263274.387434:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:0:x1875129699163520:12345-192.168.203.26@tcp:2:touch.500 Request processed in 2775us (3209us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788263274.387444:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:1.0:1788263274.396364:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263274.396619:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699163776 00000100:00100000:2.0:1788263274.396629:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699163776 00000100:00100000:2.0:1788263274.396686:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:2.0:1788263274.396698:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+12:10470:x1875129699163776:12345-192.168.203.26@tcp:35:touch.500 00000100:00100000:2.0:1788263274.397168:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+13:10470:x1875129699163776:12345-192.168.203.26@tcp:35:touch.500 Request processed in 471us (812us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788263274.397176:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:1.0:1788263274.436936:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263274.437028:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699163904 00000100:00100000:2.0:1788263274.437039:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699163904 00000100:00100000:2.0:1788263274.437099:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:2.0:1788263274.437110:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+13:10471:x1875129699163904:12345-192.168.203.26@tcp:101:rm.0 00010000:00010000:2.0:1788263274.437147:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263274.437166:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c400/0x4b1103cba666f5a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fda6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.437243:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5da00/0x4b1103cba666f5a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.437256:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5da00/0x4b1103cba666f5a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.437266:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5da00/0x4b1103cba666f5a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263274.437302:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788263274.437305:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788263274.437348:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5da00/0x4b1103cba666f5a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.437372:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c400/0x4b1103cba666f5a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fda6 expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.437460:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5da00/0x4b1103cba666f5a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fda6 expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.437470:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ff3c205d000) 00010000:00010000:2.0:1788263274.437473:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788263274.437477:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff282f5da00, rc 0) 00000100:00100000:2.0:1788263274.437533:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+14:10471:x1875129699163904:12345-192.168.203.26@tcp:101:rm.0 Request processed in 425us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263274.437540:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:3.0:1788263274.440547:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263274.442572:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699164160 00000100:00100000:2.0:1788263274.442603:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699164160 00000100:00100000:2.0:1788263274.442657:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:2.0:1788263274.442666:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+14:10471:x1875129699164160:12345-192.168.203.26@tcp:101:rm.0 00010000:00010000:2.0:1788263274.442685:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263274.442705:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5ce00/0x4b1103cba666f5af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fdad expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263274.442803:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788263274.442890:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5ce00/0x4b1103cba666f5af lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdad expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.442904:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff28314f900) 00010000:00010000:2.0:1788263274.442907:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788263274.442912:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5ce00/0x4b1103cba666f5af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdad expref: 16 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.442927:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff282f5ce00, rc 0) 00000100:00100000:2.0:1788263274.442979:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+15:10471:x1875129699164160:12345-192.168.203.26@tcp:101:rm.0 Request processed in 313us (2441us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1788263274.442986:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:1.0:1788263274.448448:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263274.448521:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699164288 00000100:00100000:2.0:1788263274.448531:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699164288 00000100:00100000:2.0:1788263274.448617:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:2.0:1788263274.448628:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+15:10471:x1875129699164288:12345-192.168.203.26@tcp:37:rm.0 00000100:00100000:3.0:1788263274.451903:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+15:10471:x1875129699164288:12345-192.168.203.26@tcp:37:rm.0 Request processed in 3267us (3454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263274.451919:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:3.0:1788263274.458943:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263274.459744:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699164544 00000100:00100000:0.0:1788263274.459754:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699164544 00000100:00100000:0.0:1788263274.459810:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:0.0:1788263274.459820:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a973d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+15:10471:x1875129699164544:12345-192.168.203.26@tcp:35:rm.0 00000100:00100000:0.0:1788263274.460030:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a973d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+16:10471:x1875129699164544:12345-192.168.203.26@tcp:35:rm.0 Request processed in 210us (1096us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788263274.460038:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:1.0:1788263274.469519:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263274.469618:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699164800 00000100:00100000:2.0:1788263274.469628:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699164800 00000100:00100000:2.0:1788263274.469712:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00100000:2.0:1788263274.469722:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+16:10471:x1875129699164800:12345-192.168.203.26@tcp:101:rm.0 00010000:00010000:2.0:1788263274.469755:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263274.469775:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5ce00/0x4b1103cba666f5bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fdb4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.469869:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c400/0x4b1103cba666f5c4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.469883:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c400/0x4b1103cba666f5c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.469895:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c400/0x4b1103cba666f5c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263274.469905:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788263274.470021:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5ce00/0x4b1103cba666f5bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdb4 expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.470041:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c400/0x4b1103cba666f5c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdb4 expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.470050:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ff3c205d000) 00010000:00010000:2.0:1788263274.470053:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788263274.470056:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff282f5c400, rc 0) 00000100:00100000:2.0:1788263274.470110:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+18:10471:x1875129699164800:12345-192.168.203.26@tcp:101:rm.0 Request processed in 389us (599us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788263274.470117:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00100000:1.0:1788263274.477058:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263274.477136:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699164928 00000100:00100000:3.0:1788263274.477145:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699164928 00000100:00100000:3.0:1788263274.477206:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 36 00000100:00100000:3.0:1788263274.477215:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+18:10471:x1875129699164928:12345-192.168.203.26@tcp:41:rm.0 00000004:00000024:3.0:1788263274.477264:0:8884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1788263274.477447:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+18:10471:x1875129699164928:12345-192.168.203.26@tcp:41:rm.0 Request processed in 232us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263274.477456:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 36 00000100:00100000:3.0:1788263274.479282:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263274.479387:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699165056 00000100:00100000:2.0:1788263274.479407:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699165056 00000100:00100000:2.0:1788263274.479467:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 37 00000100:00100000:2.0:1788263274.479477:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+18:10471:x1875129699165056:12345-192.168.203.26@tcp:101:rm.0 00010000:00010000:2.0:1788263274.479491:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263274.479510:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5ca00/0x4b1103cba666f5d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fdbb expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.479564:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5dc00/0x4b1103cba666f5d9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.479576:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5dc00/0x4b1103cba666f5d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.479623:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5dc00/0x4b1103cba666f5d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.479791:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f5e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.479801:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f5e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.479808:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f5e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.479879:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666f5e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.479887:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666f5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.479893:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666f5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263274.479987:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788263274.479992:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788263274.480007:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666f5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.480017:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666f5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.480025:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5dc00/0x4b1103cba666f5d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.480032:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5dc00/0x4b1103cba666f5d9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.480038:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5dc00/0x4b1103cba666f5d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.480043:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff282f5dc00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263274.480048:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5dc00/0x4b1103cba666f5d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.480055:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5dc00/0x4b1103cba666f5d9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.480066:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ff3c205d000) 00010000:00010000:2.0:1788263274.480069:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263274.480074:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5dc00/0x4b1103cba666f5d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.480080:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5dc00/0x4b1103cba666f5d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.480104:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f5e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.480109:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f5e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.480115:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f5e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.480120:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0e00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263274.480122:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f5e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.480192:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f5e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.480200:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x8cc2b6f3 (ffff9ff3b3a5ea00) 00010000:00010000:2.0:1788263274.480202:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263274.480205:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f5e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.480210:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f5e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.480235:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5ca00/0x4b1103cba666f5d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdbb expref: 20 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.480247:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666f5e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdbb expref: 19 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.480263:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ff28314f300) 00010000:00010000:2.0:1788263274.480265:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788263274.480268:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d0a00, rc 0) 00000100:00100000:2.0:1788263274.480321:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+19:10471:x1875129699165056:12345-192.168.203.26@tcp:101:rm.0 Request processed in 846us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263274.480328:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 37 00000100:00100000:1.0:1788263274.489281:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263274.489374:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699165312 00000100:00100000:0.0:1788263274.489383:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699165312 00000100:00100000:0.0:1788263274.489459:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 38 00000100:00100000:0.0:1788263274.489469:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+19:10471:x1875129699165312:12345-192.168.203.26@tcp:36:rm.0 00010000:00010000:0.0:1788263274.489520:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788263274.489545:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666f5e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdbb expref: 19 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.489570:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f593 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd9f expref: 18 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.489630:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ff28314f300) 00010000:00010000:0.0:1788263274.489819:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5da00/0x4b1103cba666f5a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fda6 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.489830:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ff3c205d000) 00010000:00010000:0.0:1788263274.489834:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788263274.489853:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f5ee lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.489865:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f5ee lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.489874:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f5ee lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.489884:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f5f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.489890:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f5f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.489971:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f5f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.490089:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f5fc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.490098:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f5fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.490105:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f5fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788263274.490362:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788263274.490371:0:6492:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 283561791756ns, next at 284561789652ns, rc = 0 00010000:00010000:0.0:1788263274.490528:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ee00/0x4b1103cba666f603 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.490538:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ee00/0x4b1103cba666f603 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.490547:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ee00/0x4b1103cba666f603 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.490554:0:6492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ee00/0x4b1103cba666f603 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.490560:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ee00/0x4b1103cba666f603 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263274.490566:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ee00/0x4b1103cba666f603 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.490882:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788263274.490904:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f5fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.490917:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263274.490920:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f5fc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.490926:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ee00/0x4b1103cba666f603 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.490929:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f5fc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.490944:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17ee00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:1.0:1788263274.490945:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17f800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263274.490955:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ee00/0x4b1103cba666f603 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.490955:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f5fc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.490965:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ee00/0x4b1103cba666f603 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.490972:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f5fc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.490979:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ff28314f300) 00010000:00010000:3.0:1788263274.490990:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788263274.490996:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ee00/0x4b1103cba666f603 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.490999:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ff28314f300) 00010000:00010000:3.0:1788263274.491004:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ee00/0x4b1103cba666f603 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.491005:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788263274.491010:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f5fc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.491018:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f5fc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.491030:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263274.491032:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f5ee lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263274.491033:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263274.491037:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263274.491043:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f5ee lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.491049:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f5ee lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.491054:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17e200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263274.491057:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f5ee lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.491062:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f5ee lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.491070:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ff3c205d000) 00010000:00010000:1.0:1788263274.491072:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263274.491075:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f5ee lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.491089:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f5ee lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788263274.491098:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b7a6a1e reply state 0000000016b2fa7e transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f5f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.491109:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f5f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.491116:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x8cc2b6f3 (ffff9ff3b3a5ea00) 00010000:00010000:1.0:1788263274.491118:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788263274.491121:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788263274.491302:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+18:10471:x1875129699165312:12345-192.168.203.26@tcp:36:rm.0 Request processed in 1832us (2027us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788263274.491310:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 38 00000100:00100000:3.0:1788263274.494076:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263274.494154:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699165568 00000100:00100000:0.0:1788263274.494164:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699165568 00000100:00100000:0.0:1788263274.494222:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:0.0:1788263274.494233:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+18:10471:x1875129699165568:12345-192.168.203.26@tcp:35:rm.0 00000100:00100000:0.0:1788263274.494453:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+19:10471:x1875129699165568:12345-192.168.203.26@tcp:35:rm.0 Request processed in 221us (384us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788263274.494460:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:3.0:1788263274.498233:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263274.498347:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699165824 00000100:00100000:2.0:1788263274.498356:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699165824 00000100:00100000:2.0:1788263274.498406:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 39 00000100:00100000:2.0:1788263274.498425:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+19:10471:x1875129699165824:12345-192.168.203.26@tcp:36:rm.0 00010000:00010000:2.0:1788263274.498473:0:8884:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788263274.498495:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c400/0x4b1103cba666f5c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdb4 expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.498516:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764000/0x4b1103cba666f562 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd91 expref: 18 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.498527:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ff3c205d000) 00010000:00010000:2.0:1788263274.498539:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba666f523 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd83 expref: 17 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.498547:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff28314f900) 00010000:00010000:2.0:1788263274.498552:0:8884:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788263274.498571:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f60a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.498635:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f60a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263274.498799:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f60a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.498904:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f611 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.498920:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f611 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.498927:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f611 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.498991:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba666f618 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.498999:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba666f618 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.499005:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba666f618 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263274.499290:0:8884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788263274.499302:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba666f618 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.499309:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba666f618 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.499316:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba666f618 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.499321:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765a00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263274.499326:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba666f618 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.499332:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba666f618 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.499340:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9ff3c205df00) 00010000:00010000:1.0:1788263274.499343:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788263274.499346:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba666f618 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.499353:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba666f618 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.499367:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f60a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.499373:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f60a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.499379:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f60a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.499389:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0e00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263274.499392:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f60a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.499398:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f60a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.499404:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff3b3a5e200) 00010000:00010000:1.0:1788263274.499406:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263274.499409:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f60a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.499497:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f60a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788263274.499512:0:8884:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d68744a3 reply state 00000000a7cfe921 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f611 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.499523:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f611 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263274.499529:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ff3c205da00) 00010000:00010000:1.0:1788263274.499531:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788263274.499533:0:8884:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788263274.499726:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+18:10471:x1875129699165824:12345-192.168.203.26@tcp:36:rm.0 Request processed in 1310us (1499us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788263274.499733:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 39 00010000:00010000:0.0:1788263275.183841:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263275.635369:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263275.635410:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263275.635449:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263275.635501:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263275.635533:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263275.635556:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263275.635612:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699165952 00000100:00100000:1.0:1788263275.635621:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699165952 00000100:00100000:1.0:1788263275.635668:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 340 00000100:00100000:1.0:1788263275.635677:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2386:x1875129699165952:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263275.635738:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2386:x1875129699165952:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 62us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263275.635746:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 340 00000100:00100000:1.0:1788263275.635776:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699166080 00000100:00100000:1.0:1788263275.635779:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699166080 00000100:00100000:1.0:1788263275.635803:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699166592 00000100:00100000:1.0:1788263275.635806:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699166592 00000100:00100000:1.0:1788263275.635843:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699166208 00000100:00100000:1.0:1788263275.635846:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699166208 00000100:00100000:1.0:1788263275.635858:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699166464 00000100:00100000:1.0:1788263275.635860:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699166464 00000100:00100000:1.0:1788263275.635876:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 217 00000100:00100000:1.0:1788263275.635883:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+18:2386:x1875129699166080:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263275.635916:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+18:2386:x1875129699166080:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 33us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263275.635923:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 217 00000100:00100000:1.0:1788263275.635935:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 218 00000100:00100000:1.0:1788263275.635941:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699166592:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263275.635964:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699166592:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 24us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263275.635981:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 218 00000100:00100000:1.0:1788263275.635993:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 219 00000100:00100000:1.0:1788263275.635999:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699166208:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263275.636024:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699166208:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 26us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263275.636030:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 219 00000100:00100000:1.0:1788263275.636041:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 220 00000100:00100000:1.0:1788263275.636047:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699166464:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263275.636066:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699166464:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 20us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263275.636071:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 220 00000100:00080000:1.0:1788263275.636095:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788263275.636099:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788263275.636556:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699166336 00000100:00100000:3.0:1788263275.636562:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699166336 00000100:00100000:3.0:1788263275.636628:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 93 00000100:00100000:3.0:1788263275.636636:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699166336:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263275.636667:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699166336:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 32us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263275.636674:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 93 00010000:00010000:2.0:1788263276.208000:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263276.592186:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709736704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788263276.592258:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263276.596654:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709736704 00000100:00100000:3.0:1788263276.596668:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709736704 00000100:00100000:3.0:1788263276.596737:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788263276.596748:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709736704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788263276.596798:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788263276.596889:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709736704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (4630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263276.596906:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788263276.596975:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709736704:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788263276.603574:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709736832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788263276.603676:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263276.603842:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709736832 00000100:00100000:2.0:1788263276.603851:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709736832 00000100:00100000:2.0:1788263276.603900:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788263276.603910:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709736832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788263276.603942:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788263276.603998:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709736832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263276.604004:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788263276.604090:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709736832:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788263277.233514:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263278.128046:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875129709737344:0@lo:400:kworker.0 00000100:00100000:1.0:1788263278.128161:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263278.128228:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709737856:0@lo:400:kworker.0 00000100:00100000:1.0:1788263278.128260:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263278.128280:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709738368:0@lo:400:kworker.0 00000100:00100000:1.0:1788263278.128303:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263278.128333:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788263278.128339:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709737216:0@lo:400:kworker.0 00000100:00100000:1.0:1788263278.128366:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263278.128384:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875129709737728:0@lo:400:kworker.0 00000100:00100000:1.0:1788263278.128445:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263278.128483:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28329bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875129709738240:0@lo:400:kworker.0 00000100:00100000:1.0:1788263278.128518:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263278.128566:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709737344 00000100:00100000:1.0:1788263278.128576:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709737344 00000100:00100000:1.0:1788263278.128671:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709737728 00000100:00100000:1.0:1788263278.128674:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709737728 00000100:00100000:1.0:1788263278.128705:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709738240 00000100:00100000:1.0:1788263278.128708:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709738240 00000100:00100000:1.0:1788263278.128728:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788263278.128739:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875129709737344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263278.128807:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875129709737344:12345-0@lo:400:kworker.0 Request processed in 69us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263278.128815:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788263278.128839:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788263278.128846:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875129709737728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263278.128874:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875129709737728:12345-0@lo:400:kworker.0 Request processed in 28us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263278.128881:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788263278.128893:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788263278.128898:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875129709738240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263278.128925:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875129709738240:12345-0@lo:400:kworker.0 Request processed in 26us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263278.128931:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788263278.128951:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709737856 00000100:00100000:1.0:1788263278.128954:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709737856 00000100:00100000:1.0:1788263278.128981:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709738368 00000100:00100000:1.0:1788263278.128991:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709738368 00000100:00100000:1.0:1788263278.129014:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788263278.129020:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709737856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263278.129053:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709737856:12345-0@lo:400:kworker.0 Request processed in 33us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263278.129059:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788263278.129070:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788263278.129076:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709738368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263278.129104:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709738368:12345-0@lo:400:kworker.0 Request processed in 29us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263278.129109:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1788263278.129144:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788263278.129149:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788263278.129152:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788263278.129188:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283299880 x1875129709737728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263278.129204:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875129709737728:0@lo:400:kworker.0 00010000:00080000:1.0:1788263278.129217:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28329bb80 x1875129709738240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263278.129226:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28329bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875129709738240:0@lo:400:kworker.0 00000100:00100000:1.0:1788263278.129238:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875129709737344:0@lo:400:kworker.0 00010000:00080000:1.0:1788263278.129249:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283298a80 x1875129709737856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263278.129258:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709737856:0@lo:400:kworker.0 00010000:00080000:1.0:1788263278.129269:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283299500 x1875129709738368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263278.129287:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709738368:0@lo:400:kworker.0 00000100:00100000:3.0:1788263278.130652:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709736960:0@lo:400:kworker.0 00000100:00100000:3.0:1788263278.130918:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263278.130970:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709737472:0@lo:400:kworker.0 00000100:00100000:3.0:1788263278.131002:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263278.131031:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28329ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709737984:0@lo:400:kworker.0 00000100:00100000:3.0:1788263278.131059:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263278.131080:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709738496:0@lo:400:kworker.0 00000100:00100000:3.0:1788263278.131104:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263278.131273:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709737088:0@lo:400:kworker.0 00000100:00100000:2.0:1788263278.131317:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263278.131341:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875129709737600:0@lo:400:kworker.0 00000100:00100000:2.0:1788263278.131364:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263278.131383:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28329b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875129709738112:0@lo:400:kworker.0 00000100:00100000:2.0:1788263278.131417:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263278.131478:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709737216 00000100:00100000:2.0:1788263278.131488:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709737216 00000100:00100000:2.0:1788263278.131734:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709737472 00000100:00100000:2.0:1788263278.131739:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709737472 00000100:00100000:2.0:1788263278.131761:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788263278.131771:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709737216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263278.132045:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709737216:12345-0@lo:400:kworker.0 Request processed in 273us (3675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263278.132054:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788263278.132074:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788263278.132081:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709737472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263278.132186:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709737472:12345-0@lo:400:kworker.0 Request processed in 105us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263278.132193:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000004:00080000:0.0:1788263278.132362:0:9889:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 287203781674ns, next at 288203778037ns, rc = 0 00000100:00100000:0.0:1788263278.132406:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff281e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709738624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263278.132448:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263278.132498:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709738624 00000100:00100000:0.0:1788263278.132502:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709738624 00000100:00100000:0.0:1788263278.132568:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788263278.132575:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709738624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263278.132617:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263278.132658:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709738624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263278.132664:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1788263278.132685:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788263278.133375:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709737472:0@lo:400:kworker.0 00010000:00080000:0.0:1788263278.133448:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff281e3b100 x1875129709738624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263278.133490:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff281e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709738624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263278.133635:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709737984 00000100:00100000:2.0:1788263278.133642:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709737984 00000100:00100000:2.0:1788263278.133682:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709738496 00000100:00100000:2.0:1788263278.133685:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709738496 00000100:00100000:2.0:1788263278.133701:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788263278.133918:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387615f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709737984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263278.133982:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387615f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709737984:12345-0@lo:400:kworker.0 Request processed in 68us (2922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263278.133988:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788263278.134003:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788263278.134008:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709738496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263278.134037:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709738496:12345-0@lo:400:kworker.0 Request processed in 29us (2932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263278.134042:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788263278.134066:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709736960 00000100:00100000:2.0:1788263278.134070:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709736960 00000100:00100000:2.0:1788263278.134099:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788263278.134106:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3618:x1875129709736960:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788263278.134201:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788263278.134265:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709737088 00000100:00100000:0.0:1788263278.134269:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709737088 00000100:00100000:0.0:1788263278.134297:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709737600 00000100:00100000:0.0:1788263278.134300:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709737600 00000100:00100000:0.0:1788263278.134323:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709738112 00000100:00100000:0.0:1788263278.134326:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709738112 00000100:00100000:0.0:1788263278.134342:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788263278.134348:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709737088:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788263278.135611:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28329ad80 x1875129709737984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263278.135629:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28329ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709737984:0@lo:400:kworker.0 00010000:00080000:3.0:1788263278.135644:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283298000 x1875129709738496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263278.135653:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709738496:0@lo:400:kworker.0 00000100:00100000:0.0:1788263278.135909:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709737088:12345-0@lo:400:kworker.0 Request processed in 1559us (4589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263278.135918:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788263278.135945:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788263278.135954:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875129709737600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263278.136008:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875129709737600:12345-0@lo:400:kworker.0 Request processed in 57us (4644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263278.136014:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788263278.136026:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788263278.136033:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875129709738112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263278.136062:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875129709738112:12345-0@lo:400:kworker.0 Request processed in 30us (4645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263278.136068:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788263278.136101:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709737088:0@lo:400:kworker.0 00000100:00100000:2.0:1788263278.136277:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3618:x1875129709736960:12345-0@lo:400:kworker.0 Request processed in 2170us (5358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263278.136285:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00080000:3.0:1788263278.136669:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263278.136713:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709736960:0@lo:400:kworker.0 00000100:00100000:3.0:1788263278.136754:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709737216:0@lo:400:kworker.0 00000100:00100000:0.0:1788263278.136922:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283298700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875129709737600:0@lo:400:kworker.0 00000100:00100000:0.0:1788263278.136948:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28329b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875129709738112:0@lo:400:kworker.0 00010000:00010000:1.0:1788263278.267742:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263278.640756:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788263278.640778:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709738752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788263278.640847:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263278.641002:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709738752 00000100:00100000:1.0:1788263278.641011:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709738752 00000100:00100000:1.0:1788263278.641065:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788263278.641077:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709738752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788263278.641097:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263278.641143:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709738752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263278.641151:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:2.0:1788263278.641395:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6db480 x1875129709738752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263278.641478:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709738752:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1788263278.879107:0:13654:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1788263279.152373:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709738880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788263279.152439:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263279.152630:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709738880 00000100:00100000:2.0:1788263279.152638:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709738880 00000100:00100000:2.0:1788263279.152688:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788263279.152697:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5472680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709738880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788263279.152723:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263279.152770:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5472680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709738880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263279.152777:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:2.0:1788263279.152811:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283821180 x1875129709738880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263279.152828:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709738880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788263279.153126:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788263279.153136:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709739008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263279.153165:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263279.153339:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709739008 00000100:00100000:3.0:1788263279.153355:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709739008 00000100:00100000:3.0:1788263279.153390:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788263279.153402:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709739008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788263279.153416:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263279.153453:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709739008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263279.153460:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:3.0:1788263279.153487:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff387616300 x1875129709739008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263279.153499:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709739008:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788263279.280381:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788263279.688604:0:6470:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788263279.688638:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1788263279.688646:0:6470:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1788263279.688754:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c800/0x4b1103cba666f577 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.688766:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c800/0x4b1103cba666f577 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.688774:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c800/0x4b1103cba666f577 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.688781:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff282f5c800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263279.688785:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c800/0x4b1103cba666f577 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.688793:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c800/0x4b1103cba666f577 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.688820:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x8cc2b6f3 (ffff9ff3b3a5ea00) 00010000:00010000:2.0:1788263279.688823:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263279.688828:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c800/0x4b1103cba666f577 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.688835:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff282f5c800/0x4b1103cba666f577 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.688854:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f58c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.688861:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f58c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.688867:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f58c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.688882:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17e600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263279.688886:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f58c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.688893:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f58c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.688901:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9ff28314f300) 00010000:00010000:2.0:1788263279.688904:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263279.688907:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f58c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.688913:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f58c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.688931:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f5f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.688937:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f5f5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.688944:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f5f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.688949:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17e400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263279.688952:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f5f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.688959:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f5f5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.688976:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x8cc2b6f3 (ffff9ff3b3a5ea00) 00010000:00010000:2.0:1788263279.688978:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263279.688982:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f5f5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.688988:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f5f5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x8cc2b6f3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.689001:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f611 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.689007:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f611 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.689013:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f611 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.689018:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765c00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263279.689021:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f611 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.689026:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f611 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.689033:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ff3c205da00) 00010000:00010000:2.0:1788263279.689036:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263279.689039:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f611 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.689044:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f611 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263279.689080:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709739136:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788263279.689145:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263279.689212:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709739136 00000100:00100000:2.0:1788263279.689218:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709739136 00000100:00100000:2.0:1788263279.689261:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788263279.689271:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709739136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788263279.689298:0:9885:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1788263279.689328:0:9885:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a96bb69, atime: 0x6a96bb69, ctime: 0x6a96bb69, blocks: 0x0 00010000:00010000:2.0:1788263279.689335:0:9885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e16943eb/0x4b1103cba666f61f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.689349:0:9885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1788263279.689353:0:9885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263279.689359:0:9885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e16943eb/0x4b1103cba666f61f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.689374:0:9885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e16943eb/0x4b1103cba666f61f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.689382:0:9885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e16943eb/0x4b1103cba666f61f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.689389:0:9885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e16943eb/0x4b1103cba666f61f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.689406:0:9885:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788263279.689609:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3619:x1875129709739136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 338us (462us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788263279.689617:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788263279.689639:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263279.689645:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e16943eb/0x4b1103cba666f61f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.689652:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1600 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:2.0:1788263279.689656:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e16943eb/0x4b1103cba666f61f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.689663:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e16943eb/0x4b1103cba666f61f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.689676:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e16943eb/0x4b1103cba666f61f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.689684:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e16943eb/0x4b1103cba666f61f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263279.689697:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263279.689700:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263279.689701:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788263279.689731:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ff283821180/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788263279.689738:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709739136:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788263280.305012:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788263280.453235:0:13702:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2eef6cb0 20000000:00000080:1.0:1788263280.453252:0:13702:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ff3bf6c4800 uarg=0000000000000000 20000000:01000000:1.0:1788263280.453292:0:13702:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788263280.453298:0:13702:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788263280.453303:0:13702:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788263280.456792:0:13703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788263280.456974:0:13702:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788263280.468127:0:13702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788263280.468179:0:13702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788263280.468196:0:13702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788263280.468211:0:13702:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788263280.468228:0:13702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ff3bf6d1600/0x4b1103cba666f626 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263280.468247:0:13702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff3ae764a00/0x4b1103cba666f4ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd6e expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263280.468255:0:13702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff282f5d400/0x4b1103cba666f4b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd75 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263280.468264:0:13702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff282f5cc00/0x4b1103cba666f4c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f4ba expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263280.468270:0:13702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff282f5de00/0x4b1103cba666f4cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f4c8 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263280.468276:0:13702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f4dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f4d6 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263280.468282:0:13702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff282f5d000/0x4b1103cba666f4eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f4e4 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263280.468289:0:13702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ff3bf6d1600/0x4b1103cba666f626 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263280.468328:0:13702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff282f5d000/0x4b1103cba666f4eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f4e4 expref: 23 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263280.468353:0:13702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff282f5d000/0x4b1103cba666f4eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f4e4 expref: 23 pid: 6484 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263280.468386:0:13702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283823b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13702:1875129709739264:0@lo:104: 00000100:00100000:2.0:1788263280.468668:0:13702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788263280.468728:0:13702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f4dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f4d6 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263280.468738:0:13702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f4dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f4d6 expref: 23 pid: 6486 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263280.468746:0:13702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283821500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13702:1875129709739392:0@lo:104: 00010000:00010000:2.0:1788263280.468774:0:13702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff282f5de00/0x4b1103cba666f4cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f4c8 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263280.468782:0:13702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff282f5de00/0x4b1103cba666f4cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f4c8 expref: 23 pid: 6485 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263280.468789:0:13702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283822680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13702:1875129709739520:0@lo:104: 00010000:00010000:2.0:1788263280.468812:0:13702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff282f5cc00/0x4b1103cba666f4c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba666f4ba expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263280.468819:0:13702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ff282f5cc00/0x4b1103cba666f4c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba666f4ba expref: 23 pid: 6486 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263280.468826:0:13702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283821f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13702:1875129709739648:0@lo:104: 00010000:00010000:2.0:1788263280.468850:0:13702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff282f5d400/0x4b1103cba666f4b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd75 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263280.468859:0:13702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ff282f5d400/0x4b1103cba666f4b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd75 expref: 12 pid: 6485 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263280.468891:0:13702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283821c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13702:1875129709739776:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788263280.468950:0:13702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff3ae764a00/0x4b1103cba666f4ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd6e expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263280.468958:0:13702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ff3ae764a00/0x4b1103cba666f4ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd6e expref: 12 pid: 6486 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263280.468966:0:13702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283820000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13702:1875129709739904:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788263280.468988:0:13702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2833ac0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263280.469601:0:6475:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788263280.469624:0:6475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263280.469647:0:6475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263280.469657:0:6475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263280.469665:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709739264 00000100:00100000:0.0:1788263280.469672:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709739264 00000100:00100000:0.0:1788263280.469708:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709739392 00000100:00100000:0.0:1788263280.469711:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709739392 00000100:00100000:0.0:1788263280.469720:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709739520 00000100:00100000:0.0:1788263280.469723:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709739520 00000100:00100000:0.0:1788263280.469730:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709739648 00000100:00100000:0.0:1788263280.469732:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709739648 00000100:00100000:0.0:1788263280.469743:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788263280.469751:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283345050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+6:13702:x1875129709739264:12345-0@lo:104: 00010000:00010000:0.0:1788263280.469763:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff398eed600/0x4b1103cba666f4e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f4eb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.469829:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788263280.469835:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283345050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+6:13702:x1875129709739264:12345-0@lo:104: Request processed in 86us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263280.469842:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788263280.469889:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788263280.469895:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5471500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+5:13702:x1875129709739392:12345-0@lo:104: 00010000:00010000:0.0:1788263280.469903:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d800/0x4b1103cba666f4d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f4dd expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.469938:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788263280.469942:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5471500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+5:13702:x1875129709739392:12345-0@lo:104: Request processed in 49us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263280.469948:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788263280.469959:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788263280.469965:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:13702:x1875129709739520:12345-0@lo:104: 00010000:00010000:0.0:1788263280.469972:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d200/0x4b1103cba666f4c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f4cf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.470001:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788263280.470006:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+4:13702:x1875129709739520:12345-0@lo:104: Request processed in 42us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263280.470013:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788263280.470023:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788263280.470028:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:13702:x1875129709739648:12345-0@lo:104: 00010000:00010000:0.0:1788263280.470035:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f4ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f4c1 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.470060:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788263280.470064:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+3:13702:x1875129709739648:12345-0@lo:104: Request processed in 37us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263280.470070:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1788263280.470092:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788263280.470098:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff398eed600/0x4b1103cba666f4e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f4eb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.470105:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eed600 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:0.0:1788263280.470109:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eed600/0x4b1103cba666f4e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f4eb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.470118:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff398eed600/0x4b1103cba666f4e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f4eb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263280.470126:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eed600/0x4b1103cba666f4e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f4eb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263280.470132:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788263280.470159:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff398eed600/0x4b1103cba666f4e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f4eb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.470166:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263280.470186:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff398eed600/0x4b1103cba666f4e4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f4eb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.470193:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff398eed600/0x4b1103cba666f4e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f4eb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.470206:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788263280.470208:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d800/0x4b1103cba666f4d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f4dd expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.470214:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff282f5d800 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:0.0:1788263280.470216:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d800/0x4b1103cba666f4d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f4dd expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.470229:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d800/0x4b1103cba666f4d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f4dd expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263280.470234:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d800/0x4b1103cba666f4d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f4dd expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263280.470238:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788263280.470252:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d800/0x4b1103cba666f4d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f4dd expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.470258:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263280.470265:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d800/0x4b1103cba666f4d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f4dd expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.470272:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d800/0x4b1103cba666f4d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f4dd expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.470280:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788263280.470283:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d200/0x4b1103cba666f4c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f4cf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.470289:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff282f5d200 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:0.0:1788263280.470291:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d200/0x4b1103cba666f4c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f4cf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.470297:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d200/0x4b1103cba666f4c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f4cf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263280.470303:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d200/0x4b1103cba666f4c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f4cf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263280.470314:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788263280.470328:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d200/0x4b1103cba666f4c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f4cf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.470334:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263280.470348:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d200/0x4b1103cba666f4c8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f4cf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.470355:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d200/0x4b1103cba666f4c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f4cf expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.470364:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263280.470367:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f4ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba666f4c1 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.470372:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eed200 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:0.0:1788263280.470375:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f4ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba666f4c1 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.470381:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f4ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba666f4c1 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263280.470387:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f4ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba666f4c1 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263280.470392:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788263280.470406:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f4ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f4c1 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.470422:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263280.470434:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f4ba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f4c1 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.470441:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff398eed200/0x4b1103cba666f4ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba666f4c1 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.470453:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263280.470455:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263280.470456:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263280.470463:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263280.470467:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263280.470479:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709740032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263280.470509:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263280.470532:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788263280.470547:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709740160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263280.470568:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263280.470616:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709740288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263280.470694:0:13702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283823b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13702:1875129709739264:0@lo:104: 00000100:00100000:2.0:1788263280.470705:0:13702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283821500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13702:1875129709739392:0@lo:104: 00000100:00100000:2.0:1788263280.470713:0:13702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283822680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13702:1875129709739520:0@lo:104: 00000100:00100000:2.0:1788263280.470723:0:13702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283821f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13702:1875129709739648:0@lo:104: 00000100:00100000:2.0:1788263280.472644:0:13702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283821c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13702:1875129709739776:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788263280.474898:0:13702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283820000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13702:1875129709739904:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788263280.474938:0:13702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ff3bf6d1600/0x4b1103cba666f626 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263280.478924:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263280.479014:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263280.479028:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709740416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263280.479083:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263280.479128:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709740032 00000100:00100000:0.0:1788263280.479135:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709740032 00010000:00010000:0.0:1788263280.479169:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff282f5d000/0x4b1103cba666f4eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f4e4 expref: 24 pid: 6484 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263280.479192:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709740160 00000100:00100000:0.0:1788263280.479196:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709740160 00010000:00010000:0.0:1788263280.479208:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f4dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f4d6 expref: 25 pid: 6486 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263280.479237:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709740288 00000100:00100000:0.0:1788263280.479240:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709740288 00010000:00010000:0.0:1788263280.479252:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff282f5de00/0x4b1103cba666f4cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f4c8 expref: 26 pid: 6485 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263280.479262:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709740416 00000100:00100000:0.0:1788263280.479264:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709740416 00010000:00010000:0.0:1788263280.479274:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff282f5cc00/0x4b1103cba666f4c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f4ba expref: 27 pid: 6486 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263280.479288:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788263280.479296:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f48257-b19e-4792-92d2-a48eb49d0ad1+27:3620:x1875129709740032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263280.479310:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263280.479316:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff282f5d000/0x4b1103cba666f4eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f4e4 expref: 27 pid: 6484 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.479329:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff282f5d000/0x4b1103cba666f4eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f4e4 expref: 27 pid: 6484 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.479345:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff282f5d000/0x4b1103cba666f4eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f4e4 expref: 27 pid: 6484 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.479360:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263280.479398:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f48257-b19e-4792-92d2-a48eb49d0ad1+26:3620:x1875129709740032:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (8888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263280.479405:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788263280.479420:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788263280.479426:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f48257-b19e-4792-92d2-a48eb49d0ad1+25:3620:x1875129709740160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263280.479441:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263280.479446:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f4dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f4d6 expref: 25 pid: 6486 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.479456:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f4dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f4d6 expref: 25 pid: 6486 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.479467:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff398eece00/0x4b1103cba666f4dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f4d6 expref: 25 pid: 6486 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.479476:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263280.479481:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263280.479551:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699166720 00000100:00100000:3.0:1788263280.479556:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699166720 00010000:00010000:3.0:1788263280.479611:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff282f5d400/0x4b1103cba666f4b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd75 expref: 13 pid: 6485 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263280.479633:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788263280.479641:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3618:x1875129709740288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788263280.479650:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263280.479654:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff282f5de00/0x4b1103cba666f4cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f4c8 expref: 24 pid: 6485 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263280.479664:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff282f5de00/0x4b1103cba666f4cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f4c8 expref: 24 pid: 6485 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263280.479676:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff282f5de00/0x4b1103cba666f4cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f4c8 expref: 24 pid: 6485 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263280.479685:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263280.479705:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:3620:x1875129709740160:12345-0@lo:103:ldlm_bl.0 Request processed in 278us (9134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263280.479713:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788263280.479731:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788263280.479736:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:3618:x1875129709740288:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (9094us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263280.479744:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:3618:x1875129709740416:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788263280.479749:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:0.0:1788263280.479754:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263280.479760:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff282f5cc00/0x4b1103cba666f4c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba666f4ba expref: 21 pid: 6486 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263280.479773:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 50 00000100:00100000:3.0:1788263280.479782:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283820000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2387:x1875129699166720:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263280.479785:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff282f5cc00/0x4b1103cba666f4c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba666f4ba expref: 21 pid: 6486 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.479798:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff282f5cc00/0x4b1103cba666f4c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba666f4ba expref: 21 pid: 6486 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263280.479802:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263280.479808:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263280.479810:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff282f5d400/0x4b1103cba666f4b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd75 expref: 13 pid: 6485 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263280.479822:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff282f5d400/0x4b1103cba666f4b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd75 expref: 13 pid: 6485 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263280.479835:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:3618:x1875129709740416:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (751us total) trans 0 rc 0/0 00010000:00010000:3.0:1788263280.479836:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff282f5d400/0x4b1103cba666f4b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd75 expref: 13 pid: 6485 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263280.479850:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263280.479858:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788263280.479893:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283820000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+12:2387:x1875129699166720:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 112us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263280.479900:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 50 00000100:00100000:0.0:1788263280.479908:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709740160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263280.479921:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709740032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263280.479951:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709740416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263280.479960:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709740288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263280.480062:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263280.489241:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699166848 00000100:00100000:0.0:1788263280.489255:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699166848 00010000:00010000:0.0:1788263280.489305:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff3ae764a00/0x4b1103cba666f4ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd6e expref: 12 pid: 6486 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263280.489354:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 51 00000100:00100000:0.0:1788263280.489364:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283821c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+12:2388:x1875129699166848:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263280.489380:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263280.489385:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff3ae764a00/0x4b1103cba666f4ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd6e expref: 12 pid: 6486 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.489399:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff3ae764a00/0x4b1103cba666f4ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd6e expref: 12 pid: 6486 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.489418:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3ae764a00/0x4b1103cba666f4ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd6e expref: 12 pid: 6486 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.489438:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ff3bf6d1600/0x4b1103cba666f626 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.489447:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3bf6d1600/0x4b1103cba666f626 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.489477:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff3bf6d1600/0x4b1103cba666f626 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.489484:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff3bf6d1600/0x4b1103cba666f626 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.489491:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ff3bf6d1600/0x4b1103cba666f626 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.489498:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ff3bf6d1600/0x4b1103cba666f626 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.489504:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1600 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263280.489508:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ff3bf6d1600/0x4b1103cba666f626 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.489516:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ff3bf6d1600/0x4b1103cba666f626 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.489546:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ff3bf6d1600/0x4b1103cba666f626 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263280.489557:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263280.489633:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283821c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+11:2388:x1875129699166848:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 269us (9570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263280.489642:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 51 00010000:00010000:2.0:1788263280.489816:0:13702:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ff3bf6d1600/0x4b1103cba666f626 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263280.489827:0:13702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ff3bf6d1600/0x4b1103cba666f626 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263280.489845:0:13702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3bf6d1600/0x4b1103cba666f626 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263280.770911:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263280.771008:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263280.771070:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263280.783028:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699167232 00000100:00100000:1.0:1788263280.783043:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699167232 00000100:00080000:1.0:1788263280.783161:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788263280.783210:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 98 00000100:00100000:1.0:1788263280.783220:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699167232:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263280.783296:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283822680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699167232:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 78us (12288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263280.783306:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 98 00000100:00100000:2.0:1788263280.783630:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263280.790787:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699166976 00000100:00100000:0.0:1788263280.790802:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699166976 00000100:00100000:0.0:1788263280.790892:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699167488 00000100:00100000:0.0:1788263280.790895:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699167488 00000100:00100000:0.0:1788263280.790939:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 227 00000100:00100000:0.0:1788263280.790949:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699166976:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263280.791045:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699166976:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 96us (20143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263280.791053:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 227 00000100:00100000:0.0:1788263280.791073:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 228 00000100:00100000:0.0:1788263280.791080:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699167488:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263280.791105:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699167488:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 27us (20035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263280.791112:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 228 00000100:00080000:0.0:1788263280.791134:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788263280.791139:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263280.791624:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263280.793272:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699167104 00000100:00100000:1.0:1788263280.793284:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699167104 00000100:00100000:1.0:1788263280.793349:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699167360 00000100:00100000:1.0:1788263280.793353:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699167360 00000100:00100000:1.0:1788263280.793375:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 229 00000100:00100000:1.0:1788263280.793384:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699167104:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263280.793456:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699167104:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 73us (9827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263280.793463:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 229 00000100:00100000:1.0:1788263280.793479:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 230 00000100:00100000:1.0:1788263280.793486:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699167360:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263280.793510:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699167360:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 25us (1889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263280.793516:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 230 00000100:00080000:2.0:1788263280.793703:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788263280.793707:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788263281.331338:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788263281.523424:0:13752:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd8ad45c10 20000000:00000080:2.0:1788263281.523442:0:13752:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ff283346c00 uarg=0000000000000000 20000000:01000000:2.0:1788263281.523484:0:13752:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788263281.523489:0:13752:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788263281.523495:0:13752:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1788263281.524307:0:13753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1788263281.524495:0:13752:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1788263281.524570:0:13752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1788263281.524624:0:13752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1788263281.524642:0:13752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1788263281.524653:0:13752:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788263281.524671:0:13752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ff3bf6d1e00/0x4b1103cba666f62d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263281.524687:0:13752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3bf6d1e00/0x4b1103cba666f62d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263281.524698:0:13752:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff3bf6d1e00/0x4b1103cba666f62d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263281.524717:0:13752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff3bf6d1e00/0x4b1103cba666f62d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263281.524725:0:13752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ff3bf6d1e00/0x4b1103cba666f62d lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263281.524732:0:13752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ff3bf6d1e00/0x4b1103cba666f62d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263281.524739:0:13752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1e00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:2.0:1788263281.524743:0:13752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ff3bf6d1e00/0x4b1103cba666f62d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263281.524752:0:13752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ff3bf6d1e00/0x4b1103cba666f62d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263281.524766:0:13752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ff3bf6d1e00/0x4b1103cba666f62d lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263281.524774:0:13752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ff3bf6d1e00/0x4b1103cba666f62d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263281.524781:0:13752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3bf6d1e00/0x4b1103cba666f62d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263281.718218:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788263281.718253:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709740544:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788263281.718320:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263281.718396:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709740544 00000100:00100000:3.0:1788263281.718404:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709740544 00000100:00100000:3.0:1788263281.718448:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788263281.718458:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709740544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788263281.718488:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788263281.718546:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709740544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263281.718560:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788263281.719031:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709740544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788263281.719413:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788263281.719426:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709740672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788263281.719464:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263281.719626:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709740672 00000100:00100000:2.0:1788263281.719631:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709740672 00000100:00100000:2.0:1788263281.719664:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788263281.719672:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709740672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788263281.719691:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788263281.719786:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709740672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263281.719794:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788263281.720466:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709740672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788263282.040224:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263282.040334:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699167616 00000100:00100000:1.0:1788263282.040345:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699167616 00000100:00100000:1.0:1788263282.040745:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 342 00000100:00100000:1.0:1788263282.040760:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+11:6158:x1875129699167616:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263282.040777:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263282.040794:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3ae764000/0x4b1103cba666f634 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd405f293d116fdc2 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263282.040832:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3ae764000/0x4b1103cba666f634 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdc2 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263282.040842:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3ae764000/0x4b1103cba666f634 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdc2 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263282.040875:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae764000, rc 0) 00000100:00100000:1.0:1788263282.040937:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+12:6158:x1875129699167616:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 180us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263282.040943:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 342 00000100:00100000:2.0:1788263282.047946:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263282.050207:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699167744 00000100:00100000:0.0:1788263282.050220:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699167744 00000100:00100000:0.0:1788263282.050313:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 343 00000100:00100000:0.0:1788263282.050334:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+12:6158:x1875129699167744:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263282.050520:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+12:6158:x1875129699167744:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 197us (2583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263282.050538:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 343 00000100:00100000:2.0:1788263282.062947:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263282.063093:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699167872 00000100:00100000:0.0:1788263282.063103:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699167872 00000100:00100000:0.0:1788263282.063156:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 344 00000100:00100000:0.0:1788263282.063180:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+12:6158:x1875129699167872:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263282.063329:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+12:6158:x1875129699167872:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 142us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263282.063337:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 344 00000100:00100000:3.0:1788263282.070170:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263282.071390:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699168000 00000100:00100000:1.0:1788263282.071401:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699168000 00000100:00100000:1.0:1788263282.071471:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 345 00000100:00100000:1.0:1788263282.071482:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+12:10757:x1875129699168000:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788263282.071686:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+12:10757:x1875129699168000:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 205us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263282.071694:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 345 00000100:00100000:1.0:1788263282.079778:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263282.079976:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699168128 00000100:00100000:0.0:1788263282.079987:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699168128 00000100:00100000:0.0:1788263282.080040:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 346 00000100:00100000:0.0:1788263282.080051:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+12:10757:x1875129699168128:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788263282.080210:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+12:10757:x1875129699168128:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 159us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263282.080226:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 346 00000100:00100000:3.0:1788263282.089087:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263282.089311:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699168256 00000100:00100000:1.0:1788263282.089321:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699168256 00000100:00100000:1.0:1788263282.089385:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 347 00000100:00100000:1.0:1788263282.089396:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+12:6158:x1875129699168256:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263282.089413:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263282.089430:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3ae765e00/0x4b1103cba666f63b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd405f293d116fdc9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263282.089459:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3ae765e00/0x4b1103cba666f63b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdc9 expref: 13 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263282.089470:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3ae765e00/0x4b1103cba666f63b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdc9 expref: 13 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263282.089498:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae765e00, rc 0) 00000100:00100000:1.0:1788263282.089565:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:6158:x1875129699168256:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 170us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263282.089573:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 347 10000000:01000000:3.0:1788263282.096086:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788263282.096094:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff281faf000 from 7 10000000:01000000:3.0:1788263282.096098:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788263282.096148:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eed000/0x4b1103cba666f642 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263282.096159:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff398eed000/0x4b1103cba666f642 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263282.096170:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff398eed000/0x4b1103cba666f642 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263282.096192:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5403480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709740800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788263282.096258:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263282.096347:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff282239780 going to sleep for 11 seconds 00000100:00100000:0.0:1788263282.096502:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709740800 00000100:00100000:0.0:1788263282.096509:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709740800 00000100:00100000:0.0:1788263282.096568:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788263282.096599:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:6489:x1875129709740800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263282.096613:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263282.096626:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3bd17e800/0x4b1103cba666f649 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f642 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263282.096648:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3bd17e800/0x4b1103cba666f649 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f642 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263282.096658:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3bd17e800/0x4b1103cba666f649 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f642 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263282.096666:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17e800, rc 0) 00000100:00100000:0.0:1788263282.096705:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709740800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263282.096726:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788263282.096838:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5403480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709740800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263282.096962:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff398eed000/0x4b1103cba666f642 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f649 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263282.096973:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff398eed000/0x4b1103cba666f642 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f649 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263282.097032:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5403480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709740928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263282.097066:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263282.097084:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff282239780 going to sleep for 11 seconds 00000100:00100000:2.0:1788263282.097145:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709740928 00000100:00100000:2.0:1788263282.097149:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709740928 00000100:00100000:2.0:1788263282.097181:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1788263282.097188:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709740928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263282.097288:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709740928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263282.097295:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788263282.097707:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5403480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709740928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263282.097735:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709741056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263282.097770:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263282.097803:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2831a1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788263282.097947:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709741056 00000100:00100000:1.0:1788263282.097953:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709741056 00000100:00100000:1.0:1788263282.097986:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788263282.097993:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709741056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263282.098081:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709741056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263282.098088:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788263282.098199:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709741056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263282.099934:0:13765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:13765:1875129709741184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263282.099992:0:13765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263282.100093:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709741184 00000100:00100000:1.0:1788263282.100099:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709741184 00000100:00100000:1.0:1788263282.100134:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788263282.100141:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:13765:x1875129709741184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263282.100230:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:13765:x1875129709741184:12345-0@lo:502:llog_process_th.0 Request processed in 88us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263282.100237:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788263282.100301:0:13765:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2831a19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263282.100321:0:13765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:13765:1875129709741184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788263282.100458:0:13765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263282.100466:0:13765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263282.100468:0:13765:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788263282.100476:0:13765:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ff281faf000 00000020:00000080:0.0:1788263282.100479:0:13765:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788263282.100542:0:13765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263282.100546:0:13765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263282.100547:0:13765:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788263282.100550:0:13765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263282.100552:0:13765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263282.100553:0:13765:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788263282.100556:0:13765:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ff281faf000 00000020:00000080:0.0:1788263282.100558:0:13765:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788263282.102005:0:13765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:13765:1875129709741312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263282.102636:0:13765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263282.103160:0:13765:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2831a19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263282.112501:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709741312 00000100:00100000:2.0:1788263282.112516:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709741312 00000100:00100000:2.0:1788263282.112607:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788263282.112617:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:13765:x1875129709741312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263282.113038:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:13765:x1875129709741312:12345-0@lo:502:llog_process_th.0 Request processed in 421us (10401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263282.113046:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788263282.120872:0:13765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:13765:1875129709741312:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788263282.120914:0:13765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263282.120921:0:13765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263282.120923:0:13765:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788263282.120926:0:13765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788263282.121069:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788263282.121091:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788263282.121108:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eed000/0x4b1103cba666f642 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f649 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263282.121119:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff398eed000/0x4b1103cba666f642 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f649 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263282.121129:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788263282.121131:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff3ae569800 from 7 10000000:01000000:1.0:1788263282.121133:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788263282.121176:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765400/0x4b1103cba666f650 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263282.121182:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765400/0x4b1103cba666f650 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263282.121188:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765400/0x4b1103cba666f650 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263282.121204:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709741440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788263282.121256:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263282.121306:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff383205900 going to sleep for 11 seconds 00000100:00100000:1.0:1788263282.121326:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709741440 00000100:00100000:1.0:1788263282.121332:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709741440 00000100:00100000:1.0:1788263282.121377:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1788263282.121386:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:6489:x1875129709741440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263282.121397:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263282.121409:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3ae764e00/0x4b1103cba666f657 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f650 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263282.121431:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3ae764e00/0x4b1103cba666f657 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f650 expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263282.121556:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3ae764e00/0x4b1103cba666f657 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f650 expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263282.121563:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae764e00, rc 0) 00000100:00100000:1.0:1788263282.121612:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:6489:x1875129709741440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 228us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263282.121617:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1788263282.121647:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709741440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263282.121655:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765400/0x4b1103cba666f650 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f657 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263282.121661:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765400/0x4b1103cba666f650 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f657 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263282.121695:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709741568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263282.121711:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263282.121724:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff383205900 going to sleep for 11 seconds 00000100:00100000:1.0:1788263282.121739:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709741568 00000100:00100000:1.0:1788263282.121741:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709741568 00000100:00100000:1.0:1788263282.121755:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788263282.121759:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:6489:x1875129709741568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263282.121853:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:6489:x1875129709741568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263282.121861:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788263282.121889:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709741568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263282.121924:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709741696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263282.121961:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263282.121973:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2833ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1788263282.121985:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709741696 00000100:00100000:1.0:1788263282.121989:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709741696 00000100:00100000:1.0:1788263282.122024:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788263282.122031:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0499450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:6489:x1875129709741696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263282.122110:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0499450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:6489:x1875129709741696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263282.122116:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788263282.122152:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709741696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263282.122889:0:13767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:13767:1875129709741824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263282.122932:0:13767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263282.122956:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709741824 00000100:00100000:1.0:1788263282.122960:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709741824 00000100:00100000:1.0:1788263282.122985:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788263282.122992:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:13767:x1875129709741824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263282.123090:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:13767:x1875129709741824:12345-0@lo:502:llog_process_th.0 Request processed in 99us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263282.123098:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788263282.123139:0:13767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2833acb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788263282.123154:0:13767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:13767:1875129709741824:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788263282.123188:0:13767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788263282.123196:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263282.123204:0:13767:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788263282.123211:0:13767:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ff3ae569800 00000020:00000080:1.0:1788263282.123213:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788263282.123274:0:13767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263282.124631:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263282.124636:0:13767:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788263282.124643:0:13767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788263282.124647:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263282.124649:0:13767:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788263282.124653:0:13767:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ff3ae569800 00000020:00000080:1.0:1788263282.124655:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788263282.124879:0:13767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:13767:1875129709741952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263282.124943:0:13767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263282.124980:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709741952 00000100:00100000:1.0:1788263282.124986:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709741952 00000100:00100000:1.0:1788263282.125159:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788263282.125168:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:13767:x1875129709741952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263282.125958:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:13767:x1875129709741952:12345-0@lo:502:llog_process_th.0 Request processed in 788us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263282.125967:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788263282.126023:0:13767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2833acb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788263282.126044:0:13767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:13767:1875129709741952:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788263282.126069:0:13767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263282.126074:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263282.126077:0:13767:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788263282.126080:0:13767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788263282.127325:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788263282.127351:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788263282.127361:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765400/0x4b1103cba666f650 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f657 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263282.127669:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765400/0x4b1103cba666f650 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f657 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263282.127682:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788263282.127685:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff38769d000 from 7 10000000:01000000:1.0:1788263282.127687:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788263282.128989:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764c00/0x4b1103cba666f65e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263282.129001:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764c00/0x4b1103cba666f65e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263282.129013:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764c00/0x4b1103cba666f65e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263282.129039:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709742080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788263282.129096:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263282.129817:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2833acb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788263282.135105:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263282.145783:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709742080 00000100:00100000:1.0:1788263282.145797:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709742080 00000100:00100000:1.0:1788263282.145852:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699168384 00000100:00100000:1.0:1788263282.145856:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699168384 00000100:00100000:1.0:1788263282.145882:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788263282.145891:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:6489:x1875129709742080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263282.145907:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1788263282.145918:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 359 00010000:00010000:1.0:1788263282.145923:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3ae764a00/0x4b1103cba666f665 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f65e expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263282.145932:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:6158:x1875129699168384:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00010000:00010000:1.0:1788263282.145955:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3ae764a00/0x4b1103cba666f665 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f65e expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263282.145983:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3ae764a00/0x4b1103cba666f665 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f65e expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263282.145993:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae764a00, rc 0) 00000100:00100000:3.0:1788263282.146079:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:6158:x1875129699168384:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 150us (10982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263282.146088:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 359 00000100:00100000:1.0:1788263282.146505:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:6489:x1875129709742080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 614us (17407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263282.146512:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788263282.146599:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709742080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263282.146617:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764c00/0x4b1103cba666f65e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f665 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263282.146627:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764c00/0x4b1103cba666f65e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f665 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263282.146810:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709742208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263282.146905:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263282.146928:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2833acb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788263282.152398:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709742208 00000100:00100000:0.0:1788263282.152412:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709742208 00000100:00100000:0.0:1788263282.152455:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788263282.152464:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:6489:x1875129709742208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263282.152628:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:6489:x1875129709742208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (5723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263282.152635:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788263282.154676:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709742208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263282.154732:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709742336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263282.154805:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263282.154839:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2833acb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788263282.154995:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709742336 00000100:00100000:1.0:1788263282.155003:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709742336 00000100:00100000:1.0:1788263282.155049:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788263282.155057:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:6489:x1875129709742336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263282.155167:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:6489:x1875129709742336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263282.155174:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788263282.155227:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709742336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263282.155727:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263282.155855:0:13770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:13770:1875129709742464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263282.155904:0:13770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263282.161917:0:13770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2820ff240 going to sleep for 11 seconds 00000100:00100000:2.0:1788263282.170993:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699168512 00000100:00100000:2.0:1788263282.171006:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699168512 00000100:00100000:2.0:1788263282.171080:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709742464 00000100:00100000:2.0:1788263282.171084:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709742464 00000100:00100000:2.0:1788263282.171108:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 362 00000100:00100000:2.0:1788263282.171117:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:6158:x1875129699168512:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263282.171248:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:6158:x1875129699168512:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 131us (15522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263282.171264:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 362 00000100:00100000:2.0:1788263282.171290:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788263282.171304:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:13770:x1875129709742464:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263282.171406:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:13770:x1875129709742464:12345-0@lo:502:llog_process_th.0 Request processed in 109us (15501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263282.171413:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000040:00080000:2.0:1788263282.172140:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788263282.172293:0:13770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:13770:1875129709742464:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788263282.172327:0:13770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788263282.172337:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263282.172339:0:13770:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788263282.172346:0:13770:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ff38769d000 00000020:00000080:1.0:1788263282.172349:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788263282.172394:0:13770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263282.172398:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263282.172399:0:13770:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788263282.172402:0:13770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788263282.172404:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263282.172406:0:13770:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788263282.172409:0:13770:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ff38769d000 00000020:00000080:1.0:1788263282.172411:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788263282.172456:0:13770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:13770:1875129709742592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263282.172508:0:13770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263282.172548:0:13770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2820ff240 going to sleep for 11 seconds 00000100:00100000:2.0:1788263282.174246:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709742592 00000100:00100000:2.0:1788263282.174257:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709742592 00000100:00100000:2.0:1788263282.174601:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788263282.174614:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:13770:x1875129709742592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263282.174780:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:13770:x1875129709742592:12345-0@lo:502:llog_process_th.0 Request processed in 169us (2271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263282.174788:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788263282.179727:0:13770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:13770:1875129709742592:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788263282.179835:0:13770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263282.179853:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263282.179855:0:13770:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788263282.179860:0:13770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788263282.179929:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788263282.179949:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788263282.179960:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764c00/0x4b1103cba666f65e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f665 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263282.179971:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764c00/0x4b1103cba666f65e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f665 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263282.179981:0:6489:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788263282.179983:0:6489:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff3888e6000 from 7 10000000:01000000:1.0:1788263282.179986:0:6489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788263282.180030:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f66c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263282.180038:0:6489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f66c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263282.180047:0:6489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f66c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263282.180066:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709742720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788263282.180124:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263282.180158:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2820ff240 going to sleep for 11 seconds 00000100:00100000:1.0:1788263282.180176:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709742720 00000100:00100000:1.0:1788263282.180194:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709742720 00000100:00100000:1.0:1788263282.180230:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1788263282.180239:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:6489:x1875129709742720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263282.180251:0:8424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263282.180268:0:8424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3ae765200/0x4b1103cba666f673 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba666f66c expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263282.180290:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3ae765200/0x4b1103cba666f673 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba666f66c expref: 24 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263282.180299:0:8424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3ae765200/0x4b1103cba666f673 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba666f66c expref: 24 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263282.180308:0:8424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae765200, rc 0) 00000100:00100000:1.0:1788263282.180343:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:6489:x1875129709742720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263282.180350:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1788263282.180378:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709742720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263282.180390:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f66c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f673 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263282.180398:0:6489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f66c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f673 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263282.180453:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709742848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263282.180478:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263282.180486:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2820ff240 going to sleep for 11 seconds 00000100:00100000:1.0:1788263282.180502:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709742848 00000100:00100000:1.0:1788263282.180505:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709742848 00000100:00100000:1.0:1788263282.180520:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1788263282.180540:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:6489:x1875129709742848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263282.180663:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:6489:x1875129709742848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263282.180676:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1788263282.180699:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709742848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263282.180723:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709742976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263282.180760:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263282.180779:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709742976 00000100:00100000:2.0:1788263282.180785:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709742976 00000100:00100000:1.0:1788263282.180790:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2820ff240 going to sleep for 11 seconds 00000100:00100000:2.0:1788263282.180816:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788263282.180972:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263282.180990:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699168640 00000100:00100000:3.0:1788263282.180994:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699168640 00000100:00100000:3.0:1788263282.181023:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 368 00000100:00100000:3.0:1788263282.181030:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:10761:x1875129699168640:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788263282.181127:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:10761:x1875129699168640:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 98us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263282.181135:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 368 00000100:00100000:2.0:1788263282.182486:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:6489:x1875129709742976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263282.182634:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:6489:x1875129709742976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1810us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263282.182643:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1788263282.182657:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:15f48257-b19e-4792-92d2-a48eb49d0ad1:6489:1875129709742976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263282.183106:0:13771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:13771:1875129709743104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263282.183145:0:13771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263282.183178:0:13771:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff398e9ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263282.183935:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709743104 00000100:00100000:0.0:1788263282.183941:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709743104 00000100:00100000:0.0:1788263282.183983:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1788263282.183991:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:13771:x1875129709743104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263282.184087:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:13771:x1875129709743104:12345-0@lo:502:llog_process_th.0 Request processed in 97us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263282.184095:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788263282.185245:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263282.186252:0:13771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:13771:1875129709743104:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788263282.186304:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788263282.186315:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263282.186317:0:13771:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788263282.186334:0:13771:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ff3888e6000 00000020:00000080:1.0:1788263282.186337:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788263282.186380:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263282.186384:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263282.186385:0:13771:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788263282.186387:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788263282.186390:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263282.186391:0:13771:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788263282.186395:0:13771:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ff3888e6000 00000020:00000080:1.0:1788263282.186397:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788263282.186441:0:13771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:13771:1875129709743232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263282.186494:0:13771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263282.186543:0:13771:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff398e9ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263282.186661:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699168768 00000100:00100000:0.0:1788263282.186668:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699168768 00000100:00100000:0.0:1788263282.186705:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709743232 00000100:00100000:0.0:1788263282.186707:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709743232 00000100:00100000:0.0:1788263282.186727:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 370 00000100:00100000:0.0:1788263282.186735:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:10761:x1875129699168768:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788263282.186841:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:10761:x1875129699168768:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 106us (1598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263282.186850:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 370 00000100:00100000:0.0:1788263282.186884:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1788263282.186889:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:13771:x1875129709743232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263282.186959:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:13771:x1875129709743232:12345-0@lo:502:llog_process_th.0 Request processed in 69us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263282.186965:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1788263282.187135:0:13771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6db480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:15f48257-b19e-4792-92d2-a48eb49d0ad1:13771:1875129709743232:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788263282.187155:0:13771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263282.187160:0:13771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263282.187162:0:13771:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788263282.187165:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788263282.189340:0:6489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788263282.189380:0:6489:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788263282.189391:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f66c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f673 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263282.189403:0:6489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f66c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f673 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788263282.210301:0:13773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788263282.354094:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788263283.186650:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788263283.247909:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709743360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263283.247984:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263283.248124:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709743360 00000100:00100000:0.0:1788263283.248131:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709743360 00000100:00100000:0.0:1788263283.248187:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788263283.248197:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1875129709743360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263283.248233:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263283.248279:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1875129709743360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263283.248286:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788263283.248326:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709743360:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788263283.248460:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1788263283.249532:0:13773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788263283.250092:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709743616:0@lo:400:kworker.0 00000100:00100000:2.0:1788263283.250147:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263283.250188:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709744128:0@lo:400:kworker.0 00000100:00100000:2.0:1788263283.250210:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263283.250242:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b55bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875129709744640:0@lo:400:kworker.0 00000100:00100000:2.0:1788263283.250262:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263283.250277:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788263283.250282:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709743744:0@lo:400:kworker.0 00000100:00100000:2.0:1788263283.250299:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263283.250313:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709744256:0@lo:400:kworker.0 00000100:00100000:2.0:1788263283.250327:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263283.250337:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b55bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875129709744768:0@lo:400:kworker.0 00000100:00100000:2.0:1788263283.250352:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263283.250375:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709743744 00000100:00100000:2.0:1788263283.250381:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709743744 00000100:00100000:2.0:1788263283.250413:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788263283.250421:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709743744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263283.250467:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709743744:12345-0@lo:400:kworker.0 Request processed in 46us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263283.250473:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788263283.250506:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709743744:0@lo:400:kworker.0 00000100:00100000:1.0:1788263283.250674:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709743488:0@lo:400:kworker.0 00000100:00100000:1.0:1788263283.250708:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263283.250741:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709744000:0@lo:400:kworker.0 00000100:00100000:1.0:1788263283.250763:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263283.250780:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709744512:0@lo:400:kworker.0 00000100:00100000:1.0:1788263283.250801:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263283.250821:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788263283.250825:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709743872:0@lo:400:kworker.0 00000100:00100000:1.0:1788263283.250846:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263283.250857:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709744384:0@lo:400:kworker.0 00000100:00100000:1.0:1788263283.250875:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263283.250893:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709744896:0@lo:400:kworker.0 00000100:00100000:1.0:1788263283.250910:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263283.250933:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709744512 00000100:00100000:1.0:1788263283.250937:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709744512 00000100:00100000:1.0:1788263283.250966:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709744384 00000100:00100000:1.0:1788263283.250968:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709744384 00000100:00100000:1.0:1788263283.250978:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709744896 00000100:00100000:1.0:1788263283.250979:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709744896 00000100:00100000:1.0:1788263283.250993:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788263283.251009:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709744512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263283.251044:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709744512:12345-0@lo:400:kworker.0 Request processed in 36us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263283.251050:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788263283.251063:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788263283.251069:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709744384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263283.251095:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709744384:12345-0@lo:400:kworker.0 Request processed in 27us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263283.251101:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788263283.251113:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788263283.251119:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709744896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263283.251143:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709744896:12345-0@lo:400:kworker.0 Request processed in 25us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263283.251148:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1788263283.251171:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788263283.251175:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263283.251183:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709744000 00000100:00100000:1.0:1788263283.251186:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709744000 00000100:00100000:1.0:1788263283.251202:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788263283.251208:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709744000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263283.251339:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709743616 00000100:00100000:3.0:1788263283.251344:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709743616 00000100:00100000:3.0:1788263283.251365:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709744128 00000100:00100000:3.0:1788263283.251368:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709744128 00000100:00100000:3.0:1788263283.251386:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709744640 00000100:00100000:3.0:1788263283.251388:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709744640 00000100:00100000:3.0:1788263283.251399:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709744256 00000100:00100000:3.0:1788263283.251401:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709744256 00000100:00100000:3.0:1788263283.251411:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709744768 00000100:00100000:3.0:1788263283.251413:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709744768 00000100:00100000:3.0:1788263283.251434:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709743872 00000100:00100000:3.0:1788263283.251437:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709743872 00000100:00100000:3.0:1788263283.251447:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788263283.251452:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709743616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263283.251489:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709743616:12345-0@lo:400:kworker.0 Request processed in 37us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263283.251494:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788263283.251506:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788263283.251512:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709744128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263283.251551:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709744128:12345-0@lo:400:kworker.0 Request processed in 39us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263283.251557:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788263283.251567:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788263283.251572:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875129709744640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263283.251635:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875129709744640:12345-0@lo:400:kworker.0 Request processed in 62us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263283.251641:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788263283.251651:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788263283.251657:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709744256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263283.251682:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709744256:12345-0@lo:400:kworker.0 Request processed in 26us (1354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263283.251687:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788263283.251698:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788263283.251703:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28233bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875129709744768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263283.251727:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28233bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875129709744768:12345-0@lo:400:kworker.0 Request processed in 25us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263283.251739:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788263283.251750:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788263283.251755:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709743872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263283.251782:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709743872:12345-0@lo:400:kworker.0 Request processed in 27us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263283.251787:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00010000:00080000:3.0:1788263283.251818:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28312c000 x1875129709744256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263283.251831:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709744256:0@lo:400:kworker.0 00010000:00080000:3.0:1788263283.251842:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b55bed80 x1875129709744768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263283.251851:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b55bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875129709744768:0@lo:400:kworker.0 00000100:00100000:3.0:1788263283.251862:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709743616:0@lo:400:kworker.0 00000100:00100000:3.0:1788263283.251870:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709744128:0@lo:400:kworker.0 00000100:00100000:3.0:1788263283.251879:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b55bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875129709744640:0@lo:400:kworker.0 00000100:00100000:3.0:1788263283.251922:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709743872:0@lo:400:kworker.0 00010000:00080000:3.0:1788263283.251930:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28312e300 x1875129709744384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263283.251939:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709744384:0@lo:400:kworker.0 00000100:00100000:3.0:1788263283.251948:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709744896:0@lo:400:kworker.0 00010000:00080000:3.0:1788263283.251956:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28312dc00 x1875129709744512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263283.251970:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709744512:0@lo:400:kworker.0 00000100:00080000:3.0:1788263283.251995:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788263283.251997:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263283.252086:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709744000:12345-0@lo:400:kworker.0 Request processed in 877us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263283.252093:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788263283.252290:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709744000:0@lo:400:kworker.0 00000100:00100000:2.0:1788263283.252347:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709743488 00000100:00100000:2.0:1788263283.252351:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709743488 00000100:00100000:2.0:1788263283.252386:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1788263283.252398:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3619:x1875129709743488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263283.252442:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3619:x1875129709743488:12345-0@lo:400:kworker.0 Request processed in 45us (1733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263283.252448:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788263283.252636:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709743488:0@lo:400:kworker.0 00010000:00010000:0.0:1788263283.377008:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263283.767015:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709745024:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788263283.767094:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263283.767223:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709745024 00000100:00100000:2.0:1788263283.767232:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709745024 00000100:00100000:2.0:1788263283.767278:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788263283.767288:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709745024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788263283.767319:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263283.767484:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709745024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 197us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263283.767493:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788263283.767984:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709745024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788263284.274185:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788263284.274217:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709745152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263284.274286:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263284.274561:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709745152 00000100:00100000:3.0:1788263284.274569:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709745152 00000100:00100000:3.0:1788263284.274634:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788263284.274644:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709745152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788263284.274671:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263284.274722:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709745152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263284.274730:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:1.0:1788263284.274826:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6d6a00 x1875129709745152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263284.274846:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709745152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263284.275643:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709745280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788263284.275677:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263284.275760:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709745280 00000100:00100000:0.0:1788263284.275765:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709745280 00000100:00100000:0.0:1788263284.275808:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788263284.275825:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709745280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788263284.275841:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263284.275893:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709745280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263284.275900:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:1.0:1788263284.276189:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6d4380 x1875129709745280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263284.276218:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709745280:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788263284.400134:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263285.423866:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788263285.817562:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:1.0:1788263285.875906:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263285.875943:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263285.875971:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263285.876003:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263285.876015:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699169280 00000100:00100000:1.0:1788263285.876027:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263285.876038:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699169280 00000100:00100000:1.0:1788263285.876068:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263285.876100:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699168896 00000100:00100000:2.0:1788263285.876105:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 102 00000100:00100000:1.0:1788263285.876105:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699168896 00000100:00100000:2.0:1788263285.876130:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2389:x1875129699169280:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263285.876142:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 373 00000100:00100000:1.0:1788263285.876151:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2389:x1875129699168896:12345-192.168.203.26@tcp:400:kworker.0 00000100:00080000:3.0:1788263285.876208:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788263285.876215:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2389:x1875129699169280:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 88us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263285.876223:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 102 00000100:00100000:2.0:1788263285.876267:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699169024 00000100:00100000:2.0:1788263285.876272:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699169024 00000100:00100000:2.0:1788263285.876628:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699169536 00000100:00100000:2.0:1788263285.876632:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699169536 00000100:00100000:2.0:1788263285.876645:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699169152 00000100:00100000:2.0:1788263285.876647:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699169152 00000100:00100000:2.0:1788263285.876658:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699169408 00000100:00100000:2.0:1788263285.876660:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699169408 00000100:00100000:2.0:1788263285.876673:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 237 00000100:00100000:2.0:1788263285.876690:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28329b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2389:x1875129699169024:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263285.876886:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 238 00000100:00100000:0.0:1788263285.876895:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:2389:x1875129699169536:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263285.878034:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2389:x1875129699168896:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 1880us (2026us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263285.878045:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 373 00000100:00100000:1.0:1788263285.878092:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 239 00000100:00100000:1.0:1788263285.878101:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28329ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2389:x1875129699169152:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263285.878146:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28329ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2389:x1875129699169152:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 46us (2118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263285.878153:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 239 00000100:00100000:1.0:1788263285.878170:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 240 00000100:00100000:1.0:1788263285.878177:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2389:x1875129699169408:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263285.878201:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2389:x1875129699169408:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 25us (2133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263285.878207:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 240 00000100:00080000:1.0:1788263285.878921:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788263285.878927:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263285.883164:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28329b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2389:x1875129699169024:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 6463us (7257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263285.883179:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 237 00000100:00100000:0.0:1788263285.884568:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:2389:x1875129699169536:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 7668us (8589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263285.884593:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 238 00010000:00010000:0.0:1788263286.447884:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263286.831924:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788263286.831947:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28233a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709745408:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788263286.832018:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263286.832162:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709745408 00000100:00100000:2.0:1788263286.832170:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709745408 00000100:00100000:2.0:1788263286.832217:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788263286.832226:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709745408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788263286.832268:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788263286.832312:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709745408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263286.832318:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788263286.832576:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263286.832612:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709745536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788263286.832650:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263286.832770:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709745536 00000100:00100000:0.0:1788263286.832775:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709745536 00000100:00100000:0.0:1788263286.832794:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788263286.832800:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709745536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788263286.832816:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788263286.832855:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709745536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263286.832861:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788263286.832988:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709745536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788263286.835550:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28233a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709745408:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788263287.471827:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263288.367865:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709745792:0@lo:400:kworker.0 00000100:00100000:3.0:1788263288.367944:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709745920:0@lo:400:kworker.0 00000100:00100000:1.0:1788263288.367952:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263288.367989:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263288.368020:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709746304:0@lo:400:kworker.0 00000100:00100000:3.0:1788263288.368030:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709746432:0@lo:400:kworker.0 00000100:00100000:1.0:1788263288.368054:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263288.368067:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263288.368078:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709746816:0@lo:400:kworker.0 00000100:00100000:3.0:1788263288.368093:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875129709746944:0@lo:400:kworker.0 00000100:00100000:1.0:1788263288.368111:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263288.368125:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263288.368135:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709747328:0@lo:400:kworker.0 00000100:00100000:1.0:1788263288.368159:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263288.368209:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709746304 00000100:00100000:0.0:1788263288.368217:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709746304 00000100:00100000:0.0:1788263288.368267:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788263288.368278:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709746304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263288.368291:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788263288.368300:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709746048:0@lo:400:kworker.0 00000100:00100000:2.0:1788263288.368392:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709745664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788263288.373418:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263288.373464:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709746560:0@lo:400:kworker.0 00000100:00100000:3.0:1788263288.373531:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263288.373564:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709747072:0@lo:400:kworker.0 00000100:00100000:3.0:1788263288.373625:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263288.373677:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788263288.373686:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788263288.373792:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709746048 00000100:00100000:3.0:1788263288.373801:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709746048 00000100:00100000:3.0:1788263288.373919:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788263288.373929:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709746048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263288.373983:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709746048:12345-0@lo:400:kworker.0 Request processed in 55us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263288.373991:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788263288.374028:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709746048:0@lo:400:kworker.0 00000100:00100000:3.0:1788263288.374081:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709745920 00000100:00100000:3.0:1788263288.374086:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709745920 00000100:00100000:3.0:1788263288.374119:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709746432 00000100:00100000:3.0:1788263288.374123:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709746432 00000100:00100000:3.0:1788263288.374154:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709746944 00000100:00100000:3.0:1788263288.374158:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709746944 00000100:00100000:3.0:1788263288.374181:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709746560 00000100:00100000:3.0:1788263288.374184:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709746560 00000100:00100000:3.0:1788263288.374204:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709747072 00000100:00100000:3.0:1788263288.374207:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709747072 00000100:00100000:3.0:1788263288.374222:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788263288.374228:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709745920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263288.374267:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709745920:12345-0@lo:400:kworker.0 Request processed in 39us (6279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263288.374274:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788263288.374285:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788263288.374291:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709746432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263288.374319:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709746432:12345-0@lo:400:kworker.0 Request processed in 28us (6253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263288.374324:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788263288.374335:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788263288.374341:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875129709746944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263288.374368:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875129709746944:12345-0@lo:400:kworker.0 Request processed in 28us (6245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263288.374374:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788263288.374385:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788263288.374391:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709746560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263288.374416:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709746560:12345-0@lo:400:kworker.0 Request processed in 26us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263288.374421:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788263288.374432:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788263288.374437:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875129709747072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263288.374476:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875129709747072:12345-0@lo:400:kworker.0 Request processed in 38us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263288.374492:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00010000:00080000:3.0:1788263288.374522:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6d5f80 x1875129709746560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263288.374533:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709746560:0@lo:400:kworker.0 00010000:00080000:3.0:1788263288.374543:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6d6300 x1875129709747072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263288.374552:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709747072:0@lo:400:kworker.0 00000100:00100000:3.0:1788263288.374563:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709745920:0@lo:400:kworker.0 00000100:00100000:3.0:1788263288.374572:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709746432:0@lo:400:kworker.0 00000100:00100000:3.0:1788263288.374620:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875129709746944:0@lo:400:kworker.0 00000100:00100000:3.0:1788263288.374682:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709746816 00000100:00100000:3.0:1788263288.374686:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709746816 00000100:00100000:3.0:1788263288.374710:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709747328 00000100:00100000:3.0:1788263288.374713:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709747328 00000100:00100000:3.0:1788263288.374730:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788263288.374737:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28329bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709746816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263288.374771:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28329bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709746816:12345-0@lo:400:kworker.0 Request processed in 35us (6662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263288.374777:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788263288.374789:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788263288.374794:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709747328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263288.374834:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709747328:12345-0@lo:400:kworker.0 Request processed in 40us (6675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263288.374841:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788263288.374864:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709745792 00000100:00100000:3.0:1788263288.374868:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709745792 00000100:00100000:3.0:1788263288.374899:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1788263288.374905:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3621:x1875129709745792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263288.374937:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3621:x1875129709745792:12345-0@lo:400:kworker.0 Request processed in 32us (6989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263288.374942:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00080000:3.0:1788263288.374989:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788263288.374993:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788263288.374996:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788263288.374997:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263288.376144:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709746304:12345-0@lo:400:kworker.0 Request processed in 7863us (8084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263288.376156:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788263288.379090:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1788263288.379099:0:3621:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ff283821180, transno 4294967301 00000100:00100000:0.0:1788263288.379129:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709747328:0@lo:400:kworker.0 00000100:00100000:0.0:1788263288.379144:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709745792:0@lo:400:kworker.0 00000100:00100000:0.0:1788263288.379179:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709746304:0@lo:400:kworker.0 00010000:00080000:0.0:1788263288.379194:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6d5880 x1875129709746816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263288.379204:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709746816:0@lo:400:kworker.0 00000100:00100000:2.0:1788263288.386256:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263288.386305:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709745664 00000100:00100000:2.0:1788263288.386312:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709745664 00000100:00100000:2.0:1788263288.386355:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788263288.386364:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709745664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788263288.386395:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263288.386430:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709745664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263288.386453:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788263288.388239:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709745664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263288.388251:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709746176:0@lo:400:kworker.0 00000100:00100000:2.0:1788263288.388301:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263288.388330:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709746176 00000100:00100000:2.0:1788263288.388335:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709746176 00000100:00100000:2.0:1788263288.388371:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788263288.388379:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28233ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709746176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263288.388420:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28233ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709746176:12345-0@lo:400:kworker.0 Request processed in 42us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263288.388426:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788263288.389205:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709746176:0@lo:400:kworker.0 00000100:00100000:2.0:1788263288.389215:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709746688:0@lo:400:kworker.0 00000100:00100000:2.0:1788263288.389248:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263288.389274:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709746688 00000100:00100000:2.0:1788263288.389278:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709746688 00000100:00100000:2.0:1788263288.389317:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788263288.389324:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28233b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709746688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263288.389356:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28233b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709746688:12345-0@lo:400:kworker.0 Request processed in 33us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263288.389362:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:2.0:1788263288.389380:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788263288.389398:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6d4700 x1875129709746688/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263288.389409:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709746688:0@lo:400:kworker.0 00000100:00100000:2.0:1788263288.389429:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709747200:0@lo:400:kworker.0 00000100:00100000:2.0:1788263288.389454:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263288.389617:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709747200 00000100:00100000:2.0:1788263288.389622:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709747200 00000100:00100000:2.0:1788263288.389654:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788263288.389661:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709747200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263288.389706:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709747200:12345-0@lo:400:kworker.0 Request processed in 33us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263288.389712:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1788263288.389729:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788263288.389744:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709747200:0@lo:400:kworker.0 00010000:00010000:0.0:1788263288.498888:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263288.882422:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709747456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788263288.882516:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263288.883386:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709747456 00000100:00100000:2.0:1788263288.883398:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709747456 00000100:00100000:2.0:1788263288.883462:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788263288.883472:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709747456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788263288.883505:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263288.883573:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709747456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263288.883908:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709747456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788263288.883968:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788263289.393616:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263289.393639:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709747584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788263289.393707:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263289.393990:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788263289.394003:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709747712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788263289.394034:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263289.394155:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709747584 00000100:00100000:1.0:1788263289.394163:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709747584 00000100:00100000:1.0:1788263289.394210:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709747712 00000100:00100000:1.0:1788263289.394213:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709747712 00000100:00100000:1.0:1788263289.394229:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788263289.394237:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709747584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788263289.394276:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263289.394330:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709747584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263289.394336:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788263289.394353:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788263289.394359:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709747712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788263289.394370:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263289.394400:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709747712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263289.394405:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:3.0:1788263289.394567:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf704e00 x1875129709747584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263289.394599:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709747584:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788263289.394899:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6d4700 x1875129709747712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263289.394913:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709747712:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788263289.520642:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263290.546456:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263291.002339:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263291.002402:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263291.002707:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699169792 00000100:00100000:1.0:1788263291.002719:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699169792 00000100:00100000:1.0:1788263291.002806:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 247 00000100:00100000:1.0:1788263291.002817:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2388:x1875129699169792:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263291.002890:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2388:x1875129699169792:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 75us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263291.002897:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 247 00000100:00100000:2.0:1788263291.003498:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699169664 00000100:00100000:2.0:1788263291.003504:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699169664 00000100:00100000:2.0:1788263291.003545:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 375 00000100:00100000:2.0:1788263291.003553:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2388:x1875129699169664:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263291.003643:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2388:x1875129699169664:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 90us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263291.003651:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 375 00000100:00080000:3.0:1788263291.003792:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263291.003916:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263291.004243:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263291.004272:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263291.004291:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263291.005050:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699170304 00000100:00100000:2.0:1788263291.005066:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699170304 00000100:00100000:2.0:1788263291.005118:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699169920 00000100:00100000:2.0:1788263291.005122:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699169920 00000100:00100000:2.0:1788263291.005150:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699170176 00000100:00100000:2.0:1788263291.005153:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699170176 00000100:00100000:2.0:1788263291.005170:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 248 00000100:00100000:2.0:1788263291.005178:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8481cd9-d282-4057-bab5-8c571435635f+5:2389:x1875129699170304:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263291.005234:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8481cd9-d282-4057-bab5-8c571435635f+5:2389:x1875129699170304:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 56us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263291.005240:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 248 00000100:00100000:2.0:1788263291.005253:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 249 00000100:00100000:2.0:1788263291.005259:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2389:x1875129699169920:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263291.005303:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2389:x1875129699169920:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 44us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263291.005310:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 249 00000100:00100000:2.0:1788263291.005323:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 250 00000100:00100000:2.0:1788263291.005329:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8481cd9-d282-4057-bab5-8c571435635f+5:2389:x1875129699170176:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263291.005352:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8481cd9-d282-4057-bab5-8c571435635f+5:2389:x1875129699170176:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 24us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263291.005359:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 250 00000100:00080000:1.0:1788263291.006279:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788263291.006285:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788263291.009286:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699170048 00000100:00100000:3.0:1788263291.010248:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699170048 00000100:00100000:3.0:1788263291.010389:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 107 00000100:00100000:3.0:1788263291.010413:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2389:x1875129699170048:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263291.010491:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2389:x1875129699170048:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 80us (6576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263291.010499:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 107 00000100:00080000:1.0:1788263291.014924:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788263291.570149:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263291.951714:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709747840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788263291.951902:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263291.952507:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709747840 00000100:00100000:0.0:1788263291.952515:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709747840 00000100:00100000:0.0:1788263291.952568:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788263291.952592:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709747840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788263291.952624:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788263291.952682:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709747840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263291.952689:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788263291.952981:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709747840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788263291.961926:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788263291.961946:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709747968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788263291.962022:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263291.962078:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709747968 00000100:00100000:0.0:1788263291.962084:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709747968 00000100:00100000:0.0:1788263291.962122:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788263291.962130:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709747968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788263291.962159:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788263291.962199:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709747968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263291.962206:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788263291.962246:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709747968:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788263292.592298:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788263293.428315:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788263293.488168:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709748224:0@lo:400:kworker.0 00000100:00100000:1.0:1788263293.488251:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263293.488310:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709748736:0@lo:400:kworker.0 00000100:00100000:1.0:1788263293.488348:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263293.488377:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875129709749248:0@lo:400:kworker.0 00000100:00100000:1.0:1788263293.488399:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263293.488421:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788263293.488427:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709748352:0@lo:400:kworker.0 00000100:00100000:1.0:1788263293.488460:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263293.488476:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709748864:0@lo:400:kworker.0 00000100:00100000:1.0:1788263293.488495:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263293.488508:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875129709749376:0@lo:400:kworker.0 00000100:00100000:1.0:1788263293.488525:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263293.488550:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709748224 00000100:00100000:1.0:1788263293.488557:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709748224 00000100:00100000:1.0:1788263293.488616:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709748736 00000100:00100000:1.0:1788263293.488620:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709748736 00000100:00100000:1.0:1788263293.488641:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709749248 00000100:00100000:1.0:1788263293.488645:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709749248 00000100:00100000:1.0:1788263293.488656:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709748864 00000100:00100000:1.0:1788263293.488658:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709748864 00000100:00100000:1.0:1788263293.488667:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709749376 00000100:00100000:1.0:1788263293.488670:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709749376 00000100:00100000:1.0:1788263293.488683:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788263293.488691:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709748224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263293.488754:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709748224:12345-0@lo:400:kworker.0 Request processed in 63us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263293.488760:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788263293.489018:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709748480:0@lo:400:kworker.0 00000100:00100000:2.0:1788263293.489053:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263293.489067:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709748992:0@lo:400:kworker.0 00000100:00100000:2.0:1788263293.489090:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263293.489121:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709749504:0@lo:400:kworker.0 00000100:00100000:2.0:1788263293.489142:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263293.489160:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788263293.489165:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709748096:0@lo:400:kworker.0 00000100:00100000:2.0:1788263293.489191:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263293.489211:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709748608:0@lo:400:kworker.0 00000100:00100000:2.0:1788263293.489232:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263293.489247:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709749120:0@lo:400:kworker.0 00000100:00100000:2.0:1788263293.489267:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263293.489281:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709749632:0@lo:400:kworker.0 00000100:00100000:2.0:1788263293.489300:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263293.489326:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709748992 00000100:00100000:2.0:1788263293.489330:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709748992 00000100:00100000:2.0:1788263293.489354:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709749504 00000100:00100000:2.0:1788263293.489357:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709749504 00000100:00100000:2.0:1788263293.489367:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709749120 00000100:00100000:2.0:1788263293.489369:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709749120 00000100:00100000:2.0:1788263293.489379:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709749632 00000100:00100000:2.0:1788263293.489382:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709749632 00000100:00100000:2.0:1788263293.489394:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788263293.489401:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709748992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263293.489440:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709748992:12345-0@lo:400:kworker.0 Request processed in 39us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263293.489469:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788263293.489503:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788263293.489509:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709749504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263293.489538:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709749504:12345-0@lo:400:kworker.0 Request processed in 30us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263293.489544:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788263293.489554:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788263293.489560:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709749120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263293.489601:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709749120:12345-0@lo:400:kworker.0 Request processed in 41us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263293.489607:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788263293.489617:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788263293.489624:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709749632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263293.489650:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709749632:12345-0@lo:400:kworker.0 Request processed in 27us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263293.489655:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000040:00080000:2.0:1788263293.490198:0:13773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00080000:2.0:1788263293.490285:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf704000 x1875129709749120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263293.490299:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709749120:0@lo:400:kworker.0 00000100:00100000:2.0:1788263293.490312:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709749632:0@lo:400:kworker.0 00010000:00080000:2.0:1788263293.490321:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf706d80 x1875129709748992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263293.490329:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709748992:0@lo:400:kworker.0 00000100:00100000:2.0:1788263293.490351:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709749504:0@lo:400:kworker.0 00000100:00080000:2.0:1788263293.490477:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788263293.490481:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788263293.490484:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788263293.490486:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263293.490498:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709748480 00000100:00100000:2.0:1788263293.490503:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709748480 00000100:00100000:3.0:1788263293.490604:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709748352 00000100:00100000:3.0:1788263293.490608:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709748352 00000100:00100000:3.0:1788263293.490633:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709748608 00000100:00100000:3.0:1788263293.490636:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709748608 00000100:00100000:3.0:1788263293.490649:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788263293.490656:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff39870c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709748352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263293.490706:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff39870c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709748352:12345-0@lo:400:kworker.0 Request processed in 51us (2246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263293.490713:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788263293.490726:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788263293.490731:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709748608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263293.490760:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709748608:12345-0@lo:400:kworker.0 Request processed in 30us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263293.490765:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788263293.490781:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709748096 00000100:00100000:3.0:1788263293.490784:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709748096 00000100:00100000:3.0:1788263293.490807:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1788263293.490813:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3618:x1875129709748096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263293.490854:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3618:x1875129709748096:12345-0@lo:400:kworker.0 Request processed in 40us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263293.490860:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1788263293.490902:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709748096:0@lo:400:kworker.0 00000100:00100000:3.0:1788263293.490913:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709748608:0@lo:400:kworker.0 00000100:00100000:2.0:1788263293.492724:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788263293.492739:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff39870ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709748736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263293.492808:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff39870ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709748736:12345-0@lo:400:kworker.0 Request processed in 75us (4459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263293.492816:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788263293.492834:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788263293.492842:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff39870ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875129709749248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263293.492871:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff39870ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875129709749248:12345-0@lo:400:kworker.0 Request processed in 30us (4470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263293.492876:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788263293.492887:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788263293.492894:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff39870dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709748864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263293.492919:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff39870dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709748864:12345-0@lo:400:kworker.0 Request processed in 26us (4423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263293.492925:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788263293.492937:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788263293.492943:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff39870ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875129709749376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263293.492968:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff39870ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875129709749376:12345-0@lo:400:kworker.0 Request processed in 26us (4442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263293.492985:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788263293.492997:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788263293.493002:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28233a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709748480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263293.493037:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28233a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709748480:12345-0@lo:400:kworker.0 Request processed in 34us (3983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263293.493042:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788263293.493072:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788263293.493086:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709749760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263293.494545:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263293.494668:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709748352:0@lo:400:kworker.0 00010000:00080000:2.0:1788263293.494685:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf704a80 x1875129709748864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263293.494696:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709748864:0@lo:400:kworker.0 00000100:00100000:3.0:1788263293.494823:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709748480:0@lo:400:kworker.0 00000100:00100000:2.0:1788263293.495326:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709749760 00000100:00100000:2.0:1788263293.495333:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709749760 00000100:00100000:2.0:1788263293.495380:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788263293.495390:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709749760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788263293.498886:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263293.498986:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709749760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3594us (4441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263293.498996:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788263293.499067:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709749760:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788263293.499545:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf706a00 x1875129709749376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263293.499558:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875129709749376:0@lo:400:kworker.0 00000100:00100000:3.0:1788263293.499571:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709748224:0@lo:400:kworker.0 00000100:00100000:3.0:1788263293.499602:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709748736:0@lo:400:kworker.0 00000100:00100000:3.0:1788263293.499614:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875129709749248:0@lo:400:kworker.0 00010000:00010000:1.0:1788263293.615785:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263294.000907:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788263294.000929:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff39870c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709749888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788263294.000991:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263294.001576:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709749888 00000100:00100000:1.0:1788263294.001614:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709749888 00000100:00100000:1.0:1788263294.001667:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788263294.001677:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709749888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788263294.001697:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263294.001754:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709749888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263294.001761:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788263294.001907:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff39870c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709749888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788263294.512273:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709750016:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788263294.512359:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263294.512648:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709750016 00000100:00100000:3.0:1788263294.512656:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709750016 00000100:00100000:3.0:1788263294.512724:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788263294.512734:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709750016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788263294.512762:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263294.512817:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709750016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263294.512824:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:0.0:1788263294.512947:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6d5880 x1875129709750016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263294.512966:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709750016:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788263294.513417:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263294.513430:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff39870f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709750144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788263294.513472:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263294.513650:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709750144 00000100:00100000:1.0:1788263294.513656:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709750144 00000100:00100000:1.0:1788263294.513709:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788263294.513717:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709750144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788263294.513731:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263294.513772:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709750144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263294.513779:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:2.0:1788263294.513901:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff39870f800 x1875129709750144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263294.513916:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff39870f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709750144:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788263294.640345:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263295.664132:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263296.116215:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263296.116260:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263296.116303:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263296.116370:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699170688 00000100:00100000:1.0:1788263296.116380:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699170688 00000100:00100000:1.0:1788263296.116461:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699170560 00000100:00100000:1.0:1788263296.116465:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699170560 00000100:00100000:1.0:1788263296.116493:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 257 00000100:00100000:1.0:1788263296.116502:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38767a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699170688:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263296.116509:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699170432 00000100:00100000:2.0:1788263296.116514:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699170432 00000100:00100000:2.0:1788263296.116548:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 377 00000100:00100000:2.0:1788263296.116556:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2387:x1875129699170432:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263296.116627:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38767a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699170688:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 124us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263296.116628:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2387:x1875129699170432:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 70us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263296.116644:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 257 00000100:00100000:2.0:1788263296.116645:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 377 00000100:00100000:1.0:1788263296.116669:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 258 00000100:00100000:1.0:1788263296.116693:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699170560:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263296.116725:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699170560:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 34us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263296.116732:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 258 00000100:00080000:0.0:1788263296.116886:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788263296.116890:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788263296.130731:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263296.130795:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263296.130900:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263296.130989:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699170944 00000100:00100000:3.0:1788263296.131001:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699170944 00000100:00100000:3.0:1788263296.131067:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699171072 00000100:00100000:3.0:1788263296.131070:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699171072 00000100:00100000:3.0:1788263296.131092:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 259 00000100:00100000:3.0:1788263296.131101:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699170944:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263296.131171:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699170944:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 71us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263296.131178:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 259 00000100:00100000:3.0:1788263296.131195:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 260 00000100:00100000:3.0:1788263296.131202:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699171072:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263296.131226:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699171072:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 24us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263296.131231:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 260 00000100:00080000:0.0:1788263296.131292:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788263296.131297:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263296.131438:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699170816 00000100:00100000:2.0:1788263296.131442:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699170816 00000100:00100000:2.0:1788263296.131492:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:2.0:1788263296.131500:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38767b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2385:x1875129699170816:12345-192.168.203.26@tcp:9:kworker.0 00000020:00000080:2.0:1788263296.131520:0:8405:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f59a 00000100:00080000:2.0:1788263296.131528:0:8405:0:(import.c:65:import_set_state_nolock()) ffff9ff283210800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788263296.131614:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1788263296.131735:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38767b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+2:2385:x1875129699170816:12345-192.168.203.26@tcp:9:kworker.0 Request processed in 235us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263296.131741:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 27 00010000:00010000:2.0:1788263296.131759:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788263296.131929:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788263296.688020:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263297.072639:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788263297.072665:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709750272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788263297.072736:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263297.072810:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff39870ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709750400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788263297.072836:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263297.073141:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709750272 00000100:00100000:1.0:1788263297.073149:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709750272 00000100:00100000:1.0:1788263297.073195:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709750400 00000100:00100000:1.0:1788263297.073198:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709750400 00000100:00100000:1.0:1788263297.073217:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788263297.073226:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709750272:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788263297.073231:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788263297.073239:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709750400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788263297.073259:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000004:00000024:1.0:1788263297.073259:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788263297.073302:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709750400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263297.073309:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788263297.076650:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709750272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3415us (3904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263297.076665:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788263297.077211:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff39870ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709750400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788263297.077238:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709750272:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788263297.711822:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263298.607843:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff39870f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709750784:0@lo:400:kworker.0 00000100:00100000:1.0:1788263298.607927:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263298.607981:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff39870df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875129709751296:0@lo:400:kworker.0 00000100:00100000:1.0:1788263298.608004:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263298.608030:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff39870e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875129709751808:0@lo:400:kworker.0 00000100:00100000:1.0:1788263298.608051:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263298.608197:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709750784 00000100:00100000:3.0:1788263298.608204:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709750784 00000100:00100000:0.0:1788263298.608205:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709750528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263298.608235:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263298.608248:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709751296 00000100:00100000:3.0:1788263298.608251:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709751296 00000100:00100000:0.0:1788263298.608252:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff39870d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709750656:0@lo:400:kworker.0 00000100:00100000:3.0:1788263298.608275:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709751808 00000100:00100000:3.0:1788263298.608277:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709751808 00000100:00100000:0.0:1788263298.608277:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263298.608293:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788263298.608295:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff39870e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709751168:0@lo:400:kworker.0 00000100:00100000:3.0:1788263298.608300:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709750784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263298.608315:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263298.608329:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff39870f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709751680:0@lo:400:kworker.0 00000100:00100000:0.0:1788263298.608353:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263298.608370:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff39870c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709752192:0@lo:400:kworker.0 00000100:00100000:0.0:1788263298.608401:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263298.608441:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709750656 00000100:00100000:0.0:1788263298.608446:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709750656 00000100:00100000:0.0:1788263298.608473:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788263298.608479:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3618:x1875129709750656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263298.608512:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3618:x1875129709750656:12345-0@lo:400:kworker.0 Request processed in 33us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263298.608520:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788263298.608547:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709751680 00000100:00100000:0.0:1788263298.608550:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709751680 00000100:00100000:0.0:1788263298.608571:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709752192 00000100:00100000:0.0:1788263298.608596:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709752192 00000100:00100000:0.0:1788263298.608620:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788263298.608626:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709751680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263298.608656:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709751680:12345-0@lo:400:kworker.0 Request processed in 31us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263298.608662:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788263298.608673:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788263298.608678:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709752192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263298.608703:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709752192:12345-0@lo:400:kworker.0 Request processed in 25us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263298.608708:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788263298.608726:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709751168 00000100:00100000:0.0:1788263298.608729:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709751168 00000100:00100000:0.0:1788263298.608751:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788263298.608757:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709751168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263298.608789:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709751168:12345-0@lo:400:kworker.0 Request processed in 32us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263298.608795:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788263298.608826:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff39870d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709750656:0@lo:400:kworker.0 00000100:00100000:0.0:1788263298.608837:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff39870e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709751168:0@lo:400:kworker.0 00010000:00080000:0.0:1788263298.608847:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff39870f100 x1875129709751680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263298.608856:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff39870f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709751680:0@lo:400:kworker.0 00000100:00100000:0.0:1788263298.608865:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff39870c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709752192:0@lo:400:kworker.0 00000100:00100000:0.0:1788263298.608913:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff39870fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709750912:0@lo:400:kworker.0 00000100:00100000:0.0:1788263298.608939:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263298.608956:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff39870c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709751424:0@lo:400:kworker.0 00000100:00100000:0.0:1788263298.608974:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263298.608984:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff39870ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875129709751936:0@lo:400:kworker.0 00000100:00100000:0.0:1788263298.608998:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263298.609011:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788263298.609016:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff39870d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709751040:0@lo:400:kworker.0 00000100:00100000:0.0:1788263298.609033:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263298.609042:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff39870d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709751552:0@lo:400:kworker.0 00000100:00100000:0.0:1788263298.609059:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263298.609073:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff39870f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709752064:0@lo:400:kworker.0 00000100:00100000:0.0:1788263298.609090:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263298.609109:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709751552 00000100:00100000:0.0:1788263298.609112:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709751552 00000100:00100000:0.0:1788263298.609127:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709752064 00000100:00100000:0.0:1788263298.609130:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709752064 00000100:00100000:0.0:1788263298.609139:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788263298.609145:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709751552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263298.609176:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709751552:12345-0@lo:400:kworker.0 Request processed in 31us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263298.609181:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788263298.609192:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788263298.609197:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709752064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263298.609234:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709752064:12345-0@lo:400:kworker.0 Request processed in 37us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263298.609245:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:0.0:1788263298.609270:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff39870d880 x1875129709751552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263298.609280:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff39870d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709751552:0@lo:400:kworker.0 00000100:00100000:0.0:1788263298.609289:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff39870f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709752064:0@lo:400:kworker.0 00000100:00100000:0.0:1788263298.609315:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709751424 00000100:00100000:0.0:1788263298.609319:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709751424 00000100:00100000:0.0:1788263298.609336:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709751936 00000100:00100000:0.0:1788263298.609339:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709751936 00000100:00100000:0.0:1788263298.609349:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709751040 00000100:00100000:0.0:1788263298.609351:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709751040 00000100:00100000:0.0:1788263298.609362:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788263298.609368:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875129709751296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263298.610255:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709750528 00000100:00100000:2.0:1788263298.610261:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709750528 00000100:00100000:2.0:1788263298.610296:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788263298.610304:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709750528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788263298.610326:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263298.610373:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709750528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (2137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263298.610380:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788263298.610434:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709750912 00000100:00100000:2.0:1788263298.610438:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709750912 00000100:00100000:2.0:1788263298.610459:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788263298.610465:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709750912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263298.610510:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709750912:12345-0@lo:400:kworker.0 Request processed in 45us (1569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263298.610528:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788263298.610569:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709750528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263298.610621:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788263298.610628:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38541aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875129709751808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263298.610659:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38541aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875129709751808:12345-0@lo:400:kworker.0 Request processed in 32us (2607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263298.610665:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788263298.610678:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788263298.610684:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709751424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263298.610707:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709751424:12345-0@lo:400:kworker.0 Request processed in 24us (1732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263298.610712:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788263298.610723:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788263298.610728:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875129709751936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263298.610753:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875129709751936:12345-0@lo:400:kworker.0 Request processed in 25us (1754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263298.610759:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788263298.610769:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788263298.610774:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709751040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263298.610797:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709751040:12345-0@lo:400:kworker.0 Request processed in 23us (1763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263298.610802:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:2.0:1788263298.610831:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788263298.610836:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788263298.610838:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788263298.610840:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263298.610883:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff39870d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709751040:0@lo:400:kworker.0 00000100:00100000:2.0:1788263298.610893:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff39870fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709750912:0@lo:400:kworker.0 00010000:00080000:2.0:1788263298.610904:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff39870c700 x1875129709751424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263298.610914:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff39870c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709751424:0@lo:400:kworker.0 00010000:00080000:2.0:1788263298.610922:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff39870ce00 x1875129709751936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263298.610931:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff39870ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875129709751936:0@lo:400:kworker.0 00000100:00100000:1.0:1788263298.613784:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff39870f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709750784:0@lo:400:kworker.0 00000100:00100000:3.0:1788263298.613835:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709750784:12345-0@lo:400:kworker.0 Request processed in 5532us (5905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263298.613847:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788263298.614609:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875129709751296:12345-0@lo:400:kworker.0 Request processed in 5236us (6599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263298.614619:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788263298.614736:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff39870df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875129709751296:0@lo:400:kworker.0 00000100:00100000:1.0:1788263298.614752:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff39870e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875129709751808:0@lo:400:kworker.0 00010000:00010000:1.0:1788263298.739570:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263299.121966:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3856a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709752320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788263299.122028:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263299.122156:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709752320 00000100:00100000:0.0:1788263299.122165:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709752320 00000100:00100000:0.0:1788263299.122220:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788263299.122231:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709752320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788263299.122253:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263299.122300:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709752320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263299.122308:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788263299.122325:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3856a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709752320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788263299.632486:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709752448:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788263299.632569:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263299.632715:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709752448 00000100:00100000:3.0:1788263299.632723:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709752448 00000100:00100000:3.0:1788263299.632777:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788263299.632786:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709752448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788263299.632821:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263299.632865:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709752448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263299.632872:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:0.0:1788263299.632952:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6d6d80 x1875129709752448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263299.632970:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709752448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788263299.634827:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385418380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709752576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788263299.634889:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263299.634978:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709752576 00000100:00100000:0.0:1788263299.634987:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709752576 00000100:00100000:0.0:1788263299.635052:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788263299.635062:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709752576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788263299.635082:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1788263299.638284:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff385418380 x1875129709752576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263299.638284:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709752576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3213us (3383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263299.638304:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788263299.638317:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385418380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709752576:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788263299.760658:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263300.784634:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263301.239927:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263301.239972:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263301.240010:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263301.240056:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263301.240092:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699171328 00000100:00100000:1.0:1788263301.240102:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699171328 00000100:00100000:3.0:1788263301.240106:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699171456 00000100:00100000:3.0:1788263301.240117:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699171456 00000100:00100000:1.0:1788263301.240161:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699171584 00000100:00100000:1.0:1788263301.240165:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699171584 00000100:00100000:0.0:1788263301.240180:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699171200 00000100:00100000:0.0:1788263301.240186:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699171200 00000100:00080000:2.0:1788263301.240270:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788263301.240274:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263301.240288:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 267 00000100:00100000:0.0:1788263301.240349:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 379 00000100:00100000:0.0:1788263301.240358:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2386:x1875129699171200:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263301.240491:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2386:x1875129699171200:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 134us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263301.240511:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699171328:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263301.240550:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699171328:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 253us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263301.240557:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 267 00000100:00100000:3.0:1788263301.240736:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 268 00000100:00100000:3.0:1788263301.240745:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699171456:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263301.240848:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 379 00000100:00100000:1.0:1788263301.240966:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 269 00000100:00100000:1.0:1788263301.240977:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699171584:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263301.241103:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699171456:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 359us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263301.241111:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 268 00000100:00100000:1.0:1788263301.242035:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699171584:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 1057us (1975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263301.242044:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 269 00000100:00100000:2.0:1788263301.246441:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263301.246529:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699171712 00000100:00100000:3.0:1788263301.246539:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699171712 00000100:00100000:3.0:1788263301.246631:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 270 00000100:00100000:3.0:1788263301.246641:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699171712:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263301.246712:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699171712:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 72us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263301.246721:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 270 00000100:00080000:2.0:1788263301.246859:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:1.0:1788263301.684089:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea 00000020:00000080:1.0:1788263301.684098:0:9482:0:(genops.c:885:class_export_put()) final put ffff9ff283215000/ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea 00000020:00000080:3.0:1788263301.684170:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff283215000/ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea for lustre-OST0001 00000020:00000080:3.0:1788263301.684221:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff283210800 for lustre-OST0001 00010000:00010000:1.0:1788263301.813742:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263302.195226:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709752704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788263302.195293:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263302.195489:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3856a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709752832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788263302.195520:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263302.195569:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709752704 00000100:00100000:0.0:1788263302.195593:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709752704 00000100:00100000:0.0:1788263302.195633:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709752832 00000100:00100000:0.0:1788263302.195645:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709752832 00000100:00100000:0.0:1788263302.195664:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788263302.195673:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709752704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788263302.195706:0:13780:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788263302.195748:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709752704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263302.195754:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788263302.195771:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788263302.195777:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709752832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788263302.195791:0:13780:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788263302.195821:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709752832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263302.195826:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788263302.195862:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3856a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709752832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788263302.195888:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709752704:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788263302.831718:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788263303.664289:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788263303.727855:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709753216:0@lo:400:kworker.0 00000100:00100000:1.0:1788263303.727917:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263303.727962:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff38541a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709753728:0@lo:400:kworker.0 00000100:00100000:1.0:1788263303.727987:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263303.728010:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff38541b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709754240:0@lo:400:kworker.0 00000100:00100000:1.0:1788263303.728046:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263303.728071:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788263303.728077:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff38541b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709753344:0@lo:400:kworker.0 00000100:00100000:1.0:1788263303.728098:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263303.728114:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385419f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709753856:0@lo:400:kworker.0 00000100:00100000:1.0:1788263303.728135:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263303.728151:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff38541a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709754368:0@lo:400:kworker.0 00000100:00100000:1.0:1788263303.728170:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263303.728281:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709753216 00000100:00100000:1.0:1788263303.728288:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709753216 00000100:00100000:1.0:1788263303.728329:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788263303.728337:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38541ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709753216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263303.728400:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38541ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709753216:12345-0@lo:400:kworker.0 Request processed in 63us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263303.728407:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788263303.728430:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709753728 00000100:00100000:1.0:1788263303.728435:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709753728 00000100:00100000:1.0:1788263303.728469:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709754240 00000100:00100000:1.0:1788263303.728473:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709754240 00000100:00100000:1.0:1788263303.728494:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709753344 00000100:00100000:1.0:1788263303.728498:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709753344 00000100:00100000:1.0:1788263303.728514:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788263303.728520:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709753728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263303.728558:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709753728:12345-0@lo:400:kworker.0 Request processed in 38us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263303.728566:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788263303.728598:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788263303.728606:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875129709754240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263303.728639:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875129709754240:12345-0@lo:400:kworker.0 Request processed in 34us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263303.728645:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788263303.728657:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788263303.728663:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709753344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263303.728688:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709753344:12345-0@lo:400:kworker.0 Request processed in 25us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263303.728849:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff38541b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709752960:0@lo:400:kworker.0 00000100:00100000:3.0:1788263303.728884:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263303.728908:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff38541bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709753472:0@lo:400:kworker.0 00000100:00100000:3.0:1788263303.728929:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263303.728944:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709753984:0@lo:400:kworker.0 00000100:00100000:3.0:1788263303.728975:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263303.728989:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385418a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709754496:0@lo:400:kworker.0 00000100:00100000:3.0:1788263303.729012:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263303.729029:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788263303.729037:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709753088:0@lo:400:kworker.0 00000100:00100000:3.0:1788263303.729061:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263303.729074:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709753600:0@lo:400:kworker.0 00000100:00100000:3.0:1788263303.729095:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263303.729106:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875129709754112:0@lo:400:kworker.0 00000100:00100000:3.0:1788263303.729124:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263303.729144:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709752960 00000100:00100000:3.0:1788263303.729147:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709752960 00000100:00100000:3.0:1788263303.729175:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1788263303.729182:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3620:x1875129709752960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263303.729214:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3620:x1875129709752960:12345-0@lo:400:kworker.0 Request processed in 32us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263303.729221:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1788263303.729260:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff38541b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709752960:0@lo:400:kworker.0 00000100:00080000:2.0:1788263303.729363:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788263303.729387:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709753472 00000100:00100000:2.0:1788263303.729391:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709753472 00000100:00100000:2.0:1788263303.729417:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788263303.729424:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709753472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263303.729463:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709753472:12345-0@lo:400:kworker.0 Request processed in 39us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263303.729469:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788263303.729486:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709753856 00000100:00100000:2.0:1788263303.729490:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709753856 00000100:00100000:2.0:1788263303.729512:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709754368 00000100:00100000:2.0:1788263303.729515:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709754368 00000100:00100000:2.0:1788263303.729526:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709753984 00000100:00100000:2.0:1788263303.729529:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709753984 00000100:00100000:2.0:1788263303.729541:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709754496 00000100:00100000:2.0:1788263303.729543:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709754496 00000100:00100000:2.0:1788263303.729567:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788263303.729573:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709753856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263303.729627:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709753856:12345-0@lo:400:kworker.0 Request processed in 53us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263303.729633:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788263303.729645:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788263303.729651:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709754368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263303.729676:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709754368:12345-0@lo:400:kworker.0 Request processed in 25us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263303.729682:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788263303.729693:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788263303.729699:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709753984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263303.729913:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709753984:12345-0@lo:400:kworker.0 Request processed in 214us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263303.729920:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788263303.729932:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788263303.729939:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709754496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263303.729964:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709754496:12345-0@lo:400:kworker.0 Request processed in 26us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263303.729970:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000040:00080000:2.0:1788263303.730643:0:13773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1788263303.730704:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788263303.730708:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263303.730827:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788263303.730848:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709753088 00000100:00100000:1.0:1788263303.730852:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709753088 00000100:00100000:1.0:1788263303.730870:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709753600 00000100:00100000:1.0:1788263303.730872:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709753600 00000100:00100000:1.0:1788263303.730885:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709754112 00000100:00100000:1.0:1788263303.730887:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709754112 00000100:00100000:1.0:1788263303.730901:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788263303.730908:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709753088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263303.730949:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709753088:12345-0@lo:400:kworker.0 Request processed in 41us (1887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263303.730956:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788263303.730968:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788263303.730975:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709753600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263303.731002:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709753600:12345-0@lo:400:kworker.0 Request processed in 28us (1906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263303.731009:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788263303.731020:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788263303.731026:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875129709754112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263303.731053:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875129709754112:12345-0@lo:400:kworker.0 Request processed in 27us (1928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263303.731059:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788263303.731249:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff38541b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709753344:0@lo:400:kworker.0 00010000:00080000:1.0:1788263303.731263:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff385419f80 x1875129709753856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263303.731275:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385419f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709753856:0@lo:400:kworker.0 00000100:00100000:1.0:1788263303.731297:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff38541a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709754368:0@lo:400:kworker.0 00000100:00100000:1.0:1788263303.731310:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709753216:0@lo:400:kworker.0 00010000:00080000:1.0:1788263303.731321:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff38541a680 x1875129709753728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263303.731330:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff38541a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709753728:0@lo:400:kworker.0 00010000:00080000:1.0:1788263303.731341:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff38541b100 x1875129709754240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263303.731350:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff38541b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709754240:0@lo:400:kworker.0 00000100:00080000:2.0:1788263303.731818:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263303.731834:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709754624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263303.731874:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263303.731944:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709753088:0@lo:400:kworker.0 00000100:00100000:2.0:1788263303.731956:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709753600:0@lo:400:kworker.0 00000100:00100000:2.0:1788263303.731965:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875129709754112:0@lo:400:kworker.0 00000100:00100000:2.0:1788263303.731974:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff38541bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709753472:0@lo:400:kworker.0 00010000:00080000:2.0:1788263303.731985:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff385418700 x1875129709753984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263303.731994:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709753984:0@lo:400:kworker.0 00000100:00100000:2.0:1788263303.732003:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385418a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709754496:0@lo:400:kworker.0 00000100:00100000:0.0:1788263303.733755:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709754624 00000100:00100000:0.0:1788263303.733765:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709754624 00000100:00100000:0.0:1788263303.733819:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788263303.733830:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709754624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263303.733858:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263303.733931:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709754624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (2055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263303.733940:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788263303.733995:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709754624:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788263303.856002:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263304.243932:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788263304.243955:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3856a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709754752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788263304.244022:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263304.244893:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709754752 00000100:00100000:0.0:1788263304.244901:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709754752 00000100:00100000:0.0:1788263304.244951:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788263304.244961:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709754752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788263304.244984:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263304.245038:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709754752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263304.245046:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788263304.245177:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3856a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709754752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788263304.752498:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263304.752520:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709754880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788263304.752614:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263304.752769:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709754880 00000100:00100000:3.0:1788263304.752777:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709754880 00000100:00100000:3.0:1788263304.752833:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788263304.752851:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709754880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788263304.752880:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263304.752929:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709754880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263304.752936:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00080000:3.0:1788263304.752974:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf6d5880 x1875129709754880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263304.752993:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709754880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788263304.762520:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709755008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788263304.762618:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263304.767895:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709755008 00000100:00100000:2.0:1788263304.767908:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709755008 00000100:00100000:2.0:1788263304.768021:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788263304.768032:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709755008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788263304.768054:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263304.768196:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709755008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (5577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263304.768215:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:1.0:1788263304.778201:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283a4ed80 x1875129709755008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263304.778237:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709755008:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788263304.885607:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263305.903843:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263306.355100:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263306.355147:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263306.355165:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699171840 00000100:00100000:2.0:1788263306.355175:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699171840 00000100:00100000:0.0:1788263306.355181:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263306.355229:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 381 00000100:00100000:2.0:1788263306.355240:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b0d9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2387:x1875129699171840:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263306.355316:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b0d9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2387:x1875129699171840:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 75us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263306.355317:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263306.355338:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 381 00000100:00100000:1.0:1788263306.355466:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699172096 00000100:00100000:1.0:1788263306.355470:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699172096 00000100:00100000:1.0:1788263306.355516:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699172352 00000100:00100000:1.0:1788263306.355519:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699172352 00000100:00100000:1.0:1788263306.355543:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699171968 00000100:00100000:1.0:1788263306.355546:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699171968 00000100:00100000:1.0:1788263306.355572:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 277 00000100:00100000:1.0:1788263306.355606:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699172096:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263306.355649:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699172096:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 69us (501us total) trans 0 rc 0/0 00000100:00080000:2.0:1788263306.355690:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788263306.355694:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788263306.355724:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263306.355794:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699172224 00000100:00100000:2.0:1788263306.355799:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699172224 00000100:00100000:0.0:1788263306.356156:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 278 00000100:00100000:0.0:1788263306.356168:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699172352:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263306.356211:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699172352:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 46us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263306.356219:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 278 00000100:00100000:0.0:1788263306.356235:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 279 00000100:00100000:0.0:1788263306.356242:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699171968:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263306.356267:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699171968:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 26us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263306.356282:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 279 00000100:00080000:0.0:1788263306.356374:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263306.360826:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 277 00000100:00100000:2.0:1788263306.363537:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 280 00000100:00100000:2.0:1788263306.363560:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699172224:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263306.363674:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699172224:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 126us (7948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263306.363682:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 280 00010000:00010000:3.0:1788263306.928258:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263307.313229:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788263307.313256:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3856a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709755136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788263307.313335:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263307.313455:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709755136 00000100:00100000:0.0:1788263307.313468:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709755136 00000100:00100000:0.0:1788263307.313538:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788263307.313542:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788263307.313555:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709755136:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788263307.313562:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709755264:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788263307.313627:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1788263307.313635:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788263307.313669:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709755264 00000100:00100000:2.0:1788263307.313677:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709755264 00000100:00100000:2.0:1788263307.313722:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788263307.313731:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709755136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 176us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263307.313740:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709755264:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788263307.313746:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000004:00000024:2.0:1788263307.313786:0:13780:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788263307.313824:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3856a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709755136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788263307.313849:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709755264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263307.313860:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788263307.313919:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709755264:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1788263307.584048:0:14031:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 07:48:25 (1788263305) 00010000:00010000:2.0:1788263307.951711:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263308.854324:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385418a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709755648:0@lo:400:kworker.0 00000100:00100000:3.0:1788263308.854443:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263308.854517:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875129709756160:0@lo:400:kworker.0 00000100:00100000:3.0:1788263308.854543:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263308.854567:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875129709756672:0@lo:400:kworker.0 00000100:00100000:3.0:1788263308.854614:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263308.854641:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788263308.854649:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875129709755520:0@lo:400:kworker.0 00000100:00100000:3.0:1788263308.854674:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263308.854692:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875129709756032:0@lo:400:kworker.0 00000100:00100000:3.0:1788263308.854714:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263308.854734:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff38541a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875129709756544:0@lo:400:kworker.0 00000100:00100000:3.0:1788263308.854781:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263308.854818:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709756160 00000100:00100000:3.0:1788263308.854827:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709756160 00000100:00100000:2.0:1788263308.855052:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709755392:0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.855094:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263308.855123:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff38541bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709755904:0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.855147:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263308.855166:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff38541b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709756416:0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.855203:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263308.855221:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385419f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709756928:0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.855243:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263308.855261:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788263308.855267:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709755776:0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.855289:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263308.855299:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709756288:0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.855317:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263308.855331:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff38541a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709756800:0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.855381:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263308.855408:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709756672 00000100:00100000:2.0:1788263308.855413:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709756672 00000100:00100000:2.0:1788263308.855450:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709755520 00000100:00100000:2.0:1788263308.855452:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709755520 00000100:00100000:2.0:1788263308.855462:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709756032 00000100:00100000:2.0:1788263308.855464:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709756032 00000100:00100000:2.0:1788263308.855475:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709756544 00000100:00100000:2.0:1788263308.855477:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709756544 00000100:00100000:2.0:1788263308.855487:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709755776 00000100:00100000:2.0:1788263308.855488:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709755776 00000100:00100000:2.0:1788263308.855502:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788263308.855510:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875129709756672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.855627:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875129709756672:12345-0@lo:400:kworker.0 Request processed in 116us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263308.855635:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788263308.855653:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788263308.855659:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875129709755520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.855684:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875129709755520:12345-0@lo:400:kworker.0 Request processed in 26us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263308.855689:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788263308.855700:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788263308.855705:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875129709756032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.855726:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875129709756032:12345-0@lo:400:kworker.0 Request processed in 21us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263308.855731:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788263308.855739:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788263308.855744:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875129709756544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.855763:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875129709756544:12345-0@lo:400:kworker.0 Request processed in 20us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263308.855769:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788263308.855777:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788263308.855782:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709755776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.855804:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709755776:12345-0@lo:400:kworker.0 Request processed in 23us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263308.855809:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788263308.855825:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709755392 00000100:00100000:2.0:1788263308.855829:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709755392 00000100:00100000:2.0:1788263308.855862:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1788263308.855881:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a2692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3619:x1875129709755392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.855909:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a2692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3619:x1875129709755392:12345-0@lo:400:kworker.0 Request processed in 30us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263308.855915:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1788263308.855945:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709755648 00000100:00100000:2.0:1788263308.855949:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709755648 00000100:00100000:2.0:1788263308.855970:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709755904 00000100:00100000:2.0:1788263308.855973:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709755904 00000100:00100000:2.0:1788263308.855984:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788263308.855990:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38541b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709755648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.856019:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38541b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709755648:12345-0@lo:400:kworker.0 Request processed in 30us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263308.856025:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788263308.856034:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788263308.856039:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709755904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.856061:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709755904:12345-0@lo:400:kworker.0 Request processed in 22us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263308.856066:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788263308.856085:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709756416 00000100:00100000:2.0:1788263308.856089:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709756416 00000100:00100000:2.0:1788263308.856107:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709756928 00000100:00100000:2.0:1788263308.856111:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709756928 00000100:00100000:2.0:1788263308.856120:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709756288 00000100:00100000:2.0:1788263308.856122:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709756288 00000100:00100000:2.0:1788263308.856130:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709756800 00000100:00100000:2.0:1788263308.856132:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709756800 00000100:00100000:2.0:1788263308.856142:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788263308.856147:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709756416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.856184:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709756416:12345-0@lo:400:kworker.0 Request processed in 36us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263308.856190:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788263308.856202:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788263308.856207:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709756928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.856230:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709756928:12345-0@lo:400:kworker.0 Request processed in 24us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263308.856235:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788263308.856244:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788263308.856248:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709756288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.856266:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709756288:12345-0@lo:400:kworker.0 Request processed in 18us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263308.856271:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788263308.856279:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788263308.856284:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398741180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709756800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.856304:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398741180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709756800:12345-0@lo:400:kworker.0 Request processed in 20us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263308.856309:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788263308.856368:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709755776:0@lo:400:kworker.0 00010000:00080000:2.0:1788263308.856383:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff385418e00 x1875129709756288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263308.856393:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709756288:0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.856402:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff38541a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709756800:0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.856410:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709755392:0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.856430:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff38541bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709755904:0@lo:400:kworker.0 00010000:00080000:2.0:1788263308.856440:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff38541b100 x1875129709756416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263308.856449:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff38541b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709756416:0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.856458:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385419f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709756928:0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.856506:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875129709755520:0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.856518:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875129709756032:0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.856528:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff38541a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875129709756544:0@lo:400:kworker.0 00000100:00100000:2.0:1788263308.856537:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385418a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709755648:0@lo:400:kworker.0 00010000:00080000:2.0:1788263308.856547:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff385419180 x1875129709756672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263308.856556:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875129709756672:0@lo:400:kworker.0 00000100:00100000:1.0:1788263308.857250:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788263308.857268:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38541b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875129709756160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263308.857378:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38541b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875129709756160:12345-0@lo:400:kworker.0 Request processed in 118us (2833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263308.857385:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00010000:00080000:1.0:1788263308.857435:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff385419500 x1875129709756160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263308.857447:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875129709756160:0@lo:400:kworker.0 00000100:00080000:0.0:1788263308.858386:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788263308.858396:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788263308.858400:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788263308.858403:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788263308.859312:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788263308.859337:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709757056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263308.859427:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263308.861023:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709757056 00000100:00100000:2.0:1788263308.861041:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709757056 00000100:00100000:2.0:1788263308.861144:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788263308.861156:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709757056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788263308.861203:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263308.861312:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709757056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (1885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263308.861320:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788263308.861533:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709757056:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788263308.979702:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263309.361008:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788263309.361041:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3856a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709757184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788263309.361186:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263309.361493:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709757184 00000100:00100000:0.0:1788263309.361504:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709757184 00000100:00100000:0.0:1788263309.361606:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788263309.361619:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709757184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788263309.361651:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263309.361721:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709757184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263309.361728:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788263309.361872:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3856a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709757184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788263309.871809:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709757312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263309.871914:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263309.872002:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709757312 00000100:00100000:1.0:1788263309.872011:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709757312 00000100:00100000:1.0:1788263309.872061:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788263309.872071:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709757312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788263309.872107:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263309.872167:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709757312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263309.872175:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:2.0:1788263309.872309:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283a4c000 x1875129709757312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263325 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263309.872341:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709757312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788263309.872522:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398743b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709757440:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788263309.872556:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263309.872619:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709757440 00000100:00100000:2.0:1788263309.872624:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709757440 00000100:00100000:2.0:1788263309.872649:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788263309.872656:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709757440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788263309.872668:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263309.872700:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709757440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263309.872706:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:2.0:1788263309.872729:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff398743b80 x1875129709757440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263325 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263309.872744:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398743b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709757440:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788263310.001465:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263310.300692:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263310.300917:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699172480 00000100:00100000:1.0:1788263310.300930:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699172480 00000100:00100000:1.0:1788263310.301030:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 40 00000100:00100000:1.0:1788263310.301042:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:11050:x1875129699172480:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788263310.301067:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263310.301112:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba666f67a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fdd0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263310.301188:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f681 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263310.301205:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f681 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263310.301220:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f681 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263310.301274:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788263310.301277:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788263310.301319:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f681 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263310.301355:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba666f67a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdd0 expref: 7 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263310.301375:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f681 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdd0 expref: 6 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263310.301392:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff3c205d300) 00000100:00080000:0.0:1788263310.301483:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788263310.301692:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788263310.301697:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae765c00, rc 0) 00000100:00100000:1.0:1788263310.301783:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:11050:x1875129699172480:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 742us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263310.301791:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 40 00000100:00100000:3.0:1788263310.308472:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263310.308619:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699172608 00000100:00100000:2.0:1788263310.308628:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699172608 00000100:00100000:2.0:1788263310.308690:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:2.0:1788263310.308700:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:11051:x1875129699172608:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788263310.308720:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263310.308741:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666f688 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fdd7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263310.308816:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba666f68f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263310.308828:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba666f68f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263310.308839:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba666f68f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263310.308852:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba666f696 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263310.308859:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba666f696 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263310.308866:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba666f696 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263310.308917:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0c00/0x4b1103cba666f69d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263310.308925:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0c00/0x4b1103cba666f69d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263310.308932:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0c00/0x4b1103cba666f69d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263310.308967:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788263310.308971:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788263310.308988:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0c00/0x4b1103cba666f69d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263310.309009:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba666f68f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263310.309016:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba666f68f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263310.309024:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba666f68f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263310.309029:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263310.309033:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba666f68f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263310.309041:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba666f68f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263310.309052:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff3c205d300) 00010000:00010000:2.0:1788263310.309055:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263310.309059:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba666f68f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263310.309065:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba666f68f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263310.309077:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba666f696 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263310.309084:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba666f696 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263310.309090:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba666f696 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263310.309099:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0000 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263310.309102:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba666f696 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263310.309109:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba666f696 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263310.309117:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ff282128000) 00010000:00010000:2.0:1788263310.309119:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263310.309122:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba666f696 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263310.309129:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba666f696 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263310.309156:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666f688 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdd7 expref: 8 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263310.309170:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0c00/0x4b1103cba666f69d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdd7 expref: 7 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263310.309178:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ff282128a00) 00010000:00010000:2.0:1788263310.309180:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788263310.309182:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d0c00, rc 0) 00000100:00100000:2.0:1788263310.309258:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:11051:x1875129699172608:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 560us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263310.309265:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:0.0:1788263310.317245:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263310.317327:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699172736 00000100:00100000:2.0:1788263310.317357:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699172736 00000100:00100000:2.0:1788263310.317413:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:2.0:1788263310.317425:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:11051:x1875129699172736:12345-192.168.203.26@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788263310.317511:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:11051:x1875129699172736:12345-192.168.203.26@tcp:900:lhsmtool_posix.0 Request processed in 87us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263310.317519:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:3.0:1788263310.325322:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263310.325518:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699172992 00000100:00100000:0.0:1788263310.325534:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699172992 00000100:00100000:0.0:1788263310.325635:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:0.0:1788263310.325645:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:11051:x1875129699172992:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788263310.325665:0:8884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263310.325684:0:8884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ea00/0x4b1103cba666f6a4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fdde expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263310.325753:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f6ab lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263310.325767:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f6ab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263310.325777:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f6ab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263310.325837:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e000/0x4b1103cba666f6b2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263310.325846:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e000/0x4b1103cba666f6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263310.325852:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e000/0x4b1103cba666f6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263310.325952:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ee00/0x4b1103cba666f6b9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263310.325960:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ee00/0x4b1103cba666f6b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263310.325968:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ee00/0x4b1103cba666f6b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263310.325982:0:8884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788263310.326058:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f6ab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263310.326065:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f6ab lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263310.326071:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f6ab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263310.326078:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17f600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263310.326082:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f6ab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263310.326090:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f6ab lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263310.326101:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ff282128a00) 00010000:00010000:0.0:1788263310.326104:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263310.326109:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f6ab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263310.326115:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f6ab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263310.326128:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e000/0x4b1103cba666f6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263310.326134:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e000/0x4b1103cba666f6b2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263310.326150:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e000/0x4b1103cba666f6b2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263310.326156:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17e000 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263310.326159:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e000/0x4b1103cba666f6b2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263310.326389:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e000/0x4b1103cba666f6b2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263310.326400:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ff28314f800) 00010000:00010000:0.0:1788263310.326403:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263310.326406:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e000/0x4b1103cba666f6b2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263310.326412:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e000/0x4b1103cba666f6b2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263310.327862:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ea00/0x4b1103cba666f6a4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdde expref: 10 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263310.327885:0:8884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ee00/0x4b1103cba666f6b9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdde expref: 9 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263310.327893:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ff28314fa00) 00010000:00010000:0.0:1788263310.327896:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263310.327899:0:8884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17ee00, rc 0) 00000100:00100000:0.0:1788263310.327966:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:11051:x1875129699172992:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 2322us (2653us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788263310.327984:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:3.0:1788263310.339682:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263310.340176:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699173120 00000100:00100000:2.0:1788263310.340186:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699173120 00000100:00100000:2.0:1788263310.340340:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 43 00000100:00100000:2.0:1788263310.340352:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:11051:x1875129699173120:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788263310.340497:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:11051:x1875129699173120:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 Request processed in 147us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263310.340513:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 43 00000100:00100000:2.0:1788263310.345998:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263310.346418:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699173248 00000100:00100000:0.0:1788263310.346428:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699173248 00000100:00100000:0.0:1788263310.346552:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:0.0:1788263310.346562:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:11051:x1875129699173248:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1788263310.347276:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788263310.350475:0:10388:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3841us 00000100:00100000:3.0:1788263310.385821:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:11051:x1875129699173248:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 Request processed in 39250us (39821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263310.385835:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 44 00000040:00080000:2.0:1788263310.852429:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788263310.898788:0:13773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788263311.025401:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263311.478963:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263311.478992:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263311.479016:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263311.479034:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263311.479051:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263311.479079:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699173632 00000100:00100000:0.0:1788263311.479087:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699173632 00000100:00100000:0.0:1788263311.479126:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699173888 00000100:00100000:0.0:1788263311.479129:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699173888 00000100:00100000:0.0:1788263311.479149:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699173504 00000100:00100000:0.0:1788263311.479151:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699173504 00000100:00100000:0.0:1788263311.479170:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699173760 00000100:00100000:0.0:1788263311.479172:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699173760 00000100:00100000:0.0:1788263311.479188:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 287 00000100:00100000:0.0:1788263311.479197:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff39870e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699173632:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263311.479267:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff39870e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699173632:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 71us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263311.479275:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 287 00000100:00100000:0.0:1788263311.479290:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 288 00000100:00100000:0.0:1788263311.479308:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff39870df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699173888:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263311.479342:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff39870df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699173888:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 35us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263311.479349:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 288 00000100:00100000:0.0:1788263311.479359:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 289 00000100:00100000:0.0:1788263311.479364:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff39870f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:2386:x1875129699173504:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263311.479383:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff39870f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:2386:x1875129699173504:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 19us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263311.479388:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 289 00000100:00100000:0.0:1788263311.479397:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 290 00000100:00100000:0.0:1788263311.479402:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff39870ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699173760:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263311.479420:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff39870ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699173760:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 18us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263311.479425:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 290 00000100:00080000:0.0:1788263311.479439:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788263311.479442:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788263311.479551:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699173376 00000100:00100000:2.0:1788263311.479555:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699173376 00000100:00100000:2.0:1788263311.479610:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 383 00000100:00100000:2.0:1788263311.479617:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a2692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2386:x1875129699173376:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263311.479641:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a2692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2386:x1875129699173376:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 25us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263311.479647:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 383 00010000:00010000:1.0:1788263312.054783:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263312.440421:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709757568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788263312.441928:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263312.445865:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709757568 00000100:00100000:0.0:1788263312.445887:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709757568 00000100:00100000:0.0:1788263312.445966:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788263312.445979:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709757568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788263312.446028:0:13780:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788263312.446148:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709757568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 171us (4222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263312.448343:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788263312.451049:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709757568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788263312.451110:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788263312.454305:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff39870c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709757696:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788263312.454417:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263312.454928:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709757696 00000100:00100000:1.0:1788263312.454940:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709757696 00000100:00100000:1.0:1788263312.455006:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788263312.455018:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff39870fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709757696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788263312.455065:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788263312.455395:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff39870fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709757696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263312.455405:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788263312.455930:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff39870c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709757696:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788263313.078837:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263313.505294:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263313.505437:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699174016 00000100:00100000:0.0:1788263313.505448:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699174016 00000100:00100000:0.0:1788263313.505540:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 45 00000100:00100000:0.0:1788263313.505559:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:11093:x1875129699174016:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788263313.505605:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263313.505623:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f6c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fde5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.505683:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f6ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.505696:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f6ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.505706:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f6ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.505718:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f6d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.505725:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.505731:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.505768:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f6ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.505783:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f6ce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.505790:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f6ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.505797:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17e200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263313.505801:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f6ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.505810:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f6ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.505823:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff3c205d300) 00010000:00010000:0.0:1788263313.505825:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263313.505830:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f6ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.505835:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f6ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.505846:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.505852:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f6d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.505858:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f6d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.505862:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17e600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263313.505871:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f6d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.505878:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f6d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.505885:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ff28314f800) 00010000:00010000:0.0:1788263313.505888:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263313.505890:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f6d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.505895:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f6d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.505925:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f6c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fde5 expref: 10 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.505934:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff3c205d300) 00010000:00010000:0.0:1788263313.505936:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263313.505939:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f6c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fde5 expref: 10 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.505947:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17f800, rc 0) 00000100:00100000:0.0:1788263313.505998:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:11093:x1875129699174016:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 442us (724us total) trans 0 rc 301/301 00000100:00100000:0.0:1788263313.506005:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 45 00000100:00080000:2.0:1788263313.506532:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263313.520765:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263313.520802:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699174272 00000100:00100000:3.0:1788263313.520812:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699174272 00000100:00100000:3.0:1788263313.520864:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 46 00000100:00100000:3.0:1788263313.520875:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:11093:x1875129699174272:12345-192.168.203.26@tcp:36:lfs.0 00010000:00010000:3.0:1788263313.520927:0:8884:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263313.520957:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f681 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdd0 expref: 9 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.520975:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff3c205d300) 00010000:00010000:3.0:1788263313.520985:0:8884:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263313.521043:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba666f6dc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.521056:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba666f6dc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.521075:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba666f6dc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.521087:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f6e3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.521093:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f6e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.521098:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f6e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.521609:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666f6ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.521620:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666f6ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.521627:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666f6ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788263313.521642:0:8884:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba81df7e reply state 000000005209b153 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666f6ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.521651:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666f6ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.521657:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:3.0:1788263313.521659:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788263313.521661:0:8884:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788263313.521666:0:8884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788263313.521672:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba666f6dc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.521686:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba666f6dc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.521692:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba666f6dc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.521698:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eece00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263313.521702:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba666f6dc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.521708:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba666f6dc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.521716:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff282126d00) 00010000:00010000:3.0:1788263313.521719:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263313.521721:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba666f6dc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.521727:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba666f6dc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788263313.521742:0:8884:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba81df7e reply state 000000005209b153 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f6e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.521750:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f6e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.521756:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ff282126400) 00010000:00010000:3.0:1788263313.521758:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788263313.521760:0:8884:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788263313.521848:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+10:11093:x1875129699174272:12345-192.168.203.26@tcp:36:lfs.0 Request processed in 974us (1101us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788263313.521862:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 46 00000100:00100000:0.0:1788263313.688865:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263313.688946:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699174400 00000100:00100000:3.0:1788263313.688956:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699174400 00000100:00100000:3.0:1788263313.689017:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 47 00000100:00100000:3.0:1788263313.689027:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff39870d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+10:11102:x1875129699174400:12345-192.168.203.26@tcp:101:lctl.0 00010000:00010000:3.0:1788263313.689053:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263313.689075:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f6f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fdec expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.689137:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba666f6f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.689158:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba666f6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.689169:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba666f6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263313.689207:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788263313.689210:0:10388:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788263313.689245:0:10388:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba666f6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.689270:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f6f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdec expref: 12 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.689301:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba666f6f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdec expref: 11 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.689336:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff282126d00) 00010000:00010000:3.0:1788263313.689338:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788263313.689342:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eece00, rc 0) 00000100:00100000:3.0:1788263313.689405:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff39870d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+11:11102:x1875129699174400:12345-192.168.203.26@tcp:101:lctl.0 Request processed in 379us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263313.689411:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 47 00000100:00100000:3.0:1788263313.795454:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263313.795702:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699174528 00000100:00100000:0.0:1788263313.795713:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699174528 00000100:00100000:0.0:1788263313.795786:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 48 00000100:00100000:0.0:1788263313.795814:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398cce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+11:11108:x1875129699174528:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1788263313.795835:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263313.795857:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f6ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fdf3 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.795944:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f706 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.795959:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f706 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.795970:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f706 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.795981:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f70d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.795987:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f70d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.795993:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f70d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.796071:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e000/0x4b1103cba666f714 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.796079:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e000/0x4b1103cba666f714 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.796085:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e000/0x4b1103cba666f714 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263313.796134:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788263313.796139:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788263313.796189:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e000/0x4b1103cba666f714 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.796202:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f706 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.796209:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f706 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.796215:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f706 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.796221:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17e200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263313.796225:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f706 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.796232:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f706 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.796244:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff282126d00) 00010000:00010000:0.0:1788263313.796247:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263313.796252:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f706 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.796258:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f706 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.796272:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f70d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.796289:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f70d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.796942:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f70d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.796948:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17f600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263313.796952:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f70d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.796959:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f70d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.796969:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ff282126400) 00010000:00010000:0.0:1788263313.796972:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263313.796974:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f70d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.796980:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f70d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.797010:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f6ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdf3 expref: 13 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.797024:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e000/0x4b1103cba666f714 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdf3 expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263313.797030:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:0.0:1788263313.797033:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788263313.797043:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17e000, rc 0) 00000100:00100000:0.0:1788263313.797168:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398cce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+12:11108:x1875129699174528:12345-192.168.203.26@tcp:101:bash.0 Request processed in 1358us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263313.797176:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 48 00000100:00100000:1.0:1788263313.812367:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263313.812450:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699174784 00000100:00100000:3.0:1788263313.812460:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699174784 00000100:00100000:3.0:1788263313.812528:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00100000:3.0:1788263313.812540:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+12:11108:x1875129699174784:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1788263313.812868:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263313.812892:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f71b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fdfa expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.813107:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba666f722 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.813122:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba666f722 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.813134:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba666f722 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.813182:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f729 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.813190:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f729 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.813210:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f729 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788263313.814032:0:6492:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788263313.814208:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666f730 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.814239:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666f730 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.814248:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666f730 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.814280:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba666f722 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.814287:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba666f722 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.814303:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba666f722 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.814325:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eec200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263313.814329:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba666f722 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.814337:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba666f722 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.814350:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:3.0:1788263313.814353:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263313.814372:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba666f722 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.814380:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba666f722 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788263313.814401:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc74c34a reply state 000000005161b563 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f729 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.814412:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f729 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.814434:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ff282126500) 00010000:00010000:3.0:1788263313.814436:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788263313.814439:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788263313.814489:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f71b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdfa expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.814506:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666f730 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdfa expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.814513:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282126600) 00010000:00010000:3.0:1788263313.814515:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263313.814529:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eeda00, rc 0) 00000100:00100000:3.0:1788263313.816639:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+15:11108:x1875129699174784:12345-192.168.203.26@tcp:101:bash.0 Request processed in 4094us (4274us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788263313.816658:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00100000:1.0:1788263313.829397:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263313.829490:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699174912 00000100:00100000:2.0:1788263313.829500:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699174912 00000100:00100000:2.0:1788263313.829568:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:2.0:1788263313.829616:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2385:x1875129699174912:12345-192.168.203.26@tcp:8:bash.0 00010000:00080000:2.0:1788263313.829649:0:9885:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp t0 exp 0000000000000000 cur 322 last 0 00000020:00000080:2.0:1788263313.829680:0:9885:0:(genops.c:1385:class_connect()) connect: client ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea, cookie 0x4b1103cba666f73e 00002000:00100000:2.0:1788263313.829693:0:9885:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea/ffff9ff28334f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788263313.829711:0:9885:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788263313.829781:0:9885:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788263313.829807:0:9885:0:(import.c:65:import_set_state_nolock()) ffff9ff28334f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263313.829868:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2385:x1875129699174912:12345-192.168.203.26@tcp:8:bash.0 Request processed in 290us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263313.829876:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:2.0:1788263313.833478:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263313.833851:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699175040 00000100:00100000:1.0:1788263313.833860:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699175040 00000100:00100000:1.0:1788263313.833976:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:1.0:1788263313.833987:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:0:x1875129699175040:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1788263313.834005:0:8404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263313.834026:0:8404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d25ec67a/0x4b1103cba666f745 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fe01 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788263313.834050:0:8404:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263313.834065:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=322s v=(0 0) 00010000:00010000:1.0:1788263313.834070:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263313.834079:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d25ec67a/0x4b1103cba666f745 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe01 expref: 7 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263313.834099:0:8404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d25ec67a/0x4b1103cba666f745 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe01 expref: 7 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263313.834131:0:8404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae764400, rc 0) 00000100:00100000:1.0:1788263313.834196:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:0:x1875129699175040:12345-192.168.203.26@tcp:101:bash.0 Request processed in 211us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263313.834203:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00080000:2.0:1788263313.834886:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263313.839331:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263313.839502:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699175168 00000100:00100000:2.0:1788263313.839511:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699175168 00000100:00100000:2.0:1788263313.839642:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 30 00000100:00100000:2.0:1788263313.839653:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:11108:x1875129699175168:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:2.0:1788263313.839671:0:9885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263313.839691:0:9885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666f74c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fe08 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.839723:0:9885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d25ec67a/0x4b1103cba666f745 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe01 expref: 8 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.839751:0:9885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263313.839756:0:9885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263313.839761:0:9885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666f74c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe08 expref: 8 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.839798:0:9885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d25ec67a/0x4b1103cba666f745 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe01 expref: 8 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.839812:0:9885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d25ec67a/0x4b1103cba666f745 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe01 expref: 8 pid: 8404 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263313.839827:0:9885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398743100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9885:1875129709757824:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788263313.839974:0:9885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39019b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263313.847465:0:9885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398743100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9885:1875129709757824:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788263313.847508:0:9885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666f74c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe08 expref: 8 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263313.847531:0:9885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d1c00, rc 0) 00000100:00100000:2.0:1788263313.847784:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:11108:x1875129699175168:12345-192.168.203.26@tcp:101:bash.0 Request processed in 8131us (8461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263313.847794:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 30 00000100:00100000:0.0:1788263313.848052:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263313.848146:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699175296 00000100:00100000:3.0:1788263313.848162:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699175296 00010000:00010000:3.0:1788263313.848192:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d25ec67a/0x4b1103cba666f745 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe01 expref: 8 pid: 8404 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263313.848254:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:3.0:1788263313.848263:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a9660050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2387:x1875129699175296:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263313.848276:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263313.848297:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d25ec67a/0x4b1103cba666f745 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe01 expref: 8 pid: 8404 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.848321:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d25ec67a/0x4b1103cba666f745 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe01 expref: 8 pid: 8404 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.848347:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d25ec67a/0x4b1103cba666f745 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe01 expref: 8 pid: 8404 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.848364:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263313.848368:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263313.848375:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666f74c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe08 expref: 7 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.848385:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666f74c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe08 expref: 7 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263313.848416:0:6477:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666f74c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe08 expref: 7 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263313.848429:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398ccca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6477:1875129709757952:192.168.203.26@tcp:105: 00000100:00100000:3.0:1788263313.848484:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2833ac780 going to sleep for 11 seconds 00000100:00100000:1.0:1788263313.855555:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398ccca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6477:1875129709757952:192.168.203.26@tcp:105: 00010000:00010000:1.0:1788263313.855726:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263313.855782:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a9660050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2387:x1875129699175296:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 7518us (7823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263313.855792:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:0.0:1788263313.857393:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263313.857454:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699175552 00000100:00100000:3.0:1788263313.857464:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699175552 00000100:00100000:3.0:1788263313.857573:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:3.0:1788263313.857611:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff39870f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+15:11108:x1875129699175552:12345-192.168.203.26@tcp:35:bash.0 00000100:00100000:3.0:1788263313.858781:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff39870f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+16:11108:x1875129699175552:12345-192.168.203.26@tcp:35:bash.0 Request processed in 1168us (1388us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788263313.858791:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 6 00000040:00080000:2.0:1788263313.904441:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788263313.968367:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709758080:0@lo:400:kworker.0 00000100:00100000:1.0:1788263313.968440:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263313.968492:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709758592:0@lo:400:kworker.0 00000100:00100000:1.0:1788263313.968520:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263313.968541:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709759104:0@lo:400:kworker.0 00000100:00100000:2.0:1788263313.968678:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875129709758464:0@lo:400:kworker.0 00000100:00100000:3.0:1788263313.968816:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709758080 00000100:00100000:3.0:1788263313.968823:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709758080 00000100:00100000:3.0:1788263313.968870:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1788263313.968879:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3618:x1875129709758080:12345-0@lo:400:kworker.0 00000040:00080000:0.0:1788263313.970385:0:13773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788263313.970470:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709758336:0@lo:400:kworker.0 00000100:00100000:2.0:1788263313.976843:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263313.976892:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709758976:0@lo:400:kworker.0 00000100:00100000:2.0:1788263313.976924:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263313.976944:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709759488:0@lo:400:kworker.0 00000100:00100000:2.0:1788263313.976964:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263313.977020:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709758464 00000100:00100000:2.0:1788263313.977028:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709758464 00000100:00100000:2.0:1788263313.977072:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788263313.977080:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875129709758464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263313.977130:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875129709758464:12345-0@lo:400:kworker.0 Request processed in 50us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263313.977137:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788263313.977188:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875129709758464:0@lo:400:kworker.0 00000100:00100000:2.0:1788263313.977225:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709758976 00000100:00100000:2.0:1788263313.977228:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709758976 00000100:00100000:2.0:1788263313.977261:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709759488 00000100:00100000:2.0:1788263313.977264:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709759488 00000100:00100000:2.0:1788263313.977280:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788263313.977286:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709758976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263313.977334:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709758976:12345-0@lo:400:kworker.0 Request processed in 48us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263313.977340:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788263313.977352:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788263313.977357:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709759488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263313.977384:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709759488:12345-0@lo:400:kworker.0 Request processed in 27us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263313.977517:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:2.0:1788263313.977537:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788263313.977542:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263313.977561:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709758976:0@lo:400:kworker.0 00000100:00100000:2.0:1788263313.977571:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709759488:0@lo:400:kworker.0 00000100:00100000:2.0:1788263313.977647:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709758208:0@lo:400:kworker.0 00000100:00100000:2.0:1788263313.977676:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263313.977700:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875129709758720:0@lo:400:kworker.0 00000100:00100000:2.0:1788263313.977720:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263313.977746:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875129709759232:0@lo:400:kworker.0 00000100:00100000:2.0:1788263313.977765:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263313.977987:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709759744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263313.978013:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263313.978052:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709758208 00000100:00100000:2.0:1788263313.978056:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709758208 00000100:00100000:2.0:1788263313.978077:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709758720 00000100:00100000:2.0:1788263313.978080:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709758720 00000100:00100000:2.0:1788263313.978101:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709759232 00000100:00100000:2.0:1788263313.978103:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709759232 00000100:00100000:2.0:1788263313.978117:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788263313.978122:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709758208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263313.978158:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709758208:12345-0@lo:400:kworker.0 Request processed in 36us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263313.978164:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788263313.978176:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788263313.978190:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875129709758720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263313.978283:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875129709758720:12345-0@lo:400:kworker.0 Request processed in 94us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263313.978289:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788263313.978301:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788263313.978317:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875129709759232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263313.978341:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875129709759232:12345-0@lo:400:kworker.0 Request processed in 35us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263313.978346:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:2.0:1788263313.978363:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263313.978383:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709758208:0@lo:400:kworker.0 00000100:00100000:2.0:1788263313.978392:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875129709758720:0@lo:400:kworker.0 00000100:00100000:2.0:1788263313.978413:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875129709759232:0@lo:400:kworker.0 00000100:00100000:2.0:1788263313.978447:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709759744 00000100:00100000:2.0:1788263313.978451:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709759744 00000100:00100000:2.0:1788263313.978479:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788263313.978484:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398742a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709759744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788263313.978504:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263313.978539:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398742a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709759744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263313.978546:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:2.0:1788263313.978561:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788263313.978606:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709759744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263313.978645:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709758592 00000100:00100000:2.0:1788263313.978655:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709758592 00000100:00100000:2.0:1788263313.978680:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788263313.978687:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709758592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263313.978720:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709758592:12345-0@lo:400:kworker.0 Request processed in 34us (10200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263313.978726:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788263313.980642:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263313.980678:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709758848:0@lo:400:kworker.0 00000100:00100000:0.0:1788263313.980708:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263313.980735:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709758848 00000100:00100000:0.0:1788263313.980740:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709758848 00000100:00100000:0.0:1788263313.980789:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788263313.980798:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff39870c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709758848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263313.980840:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff39870c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709758848:12345-0@lo:400:kworker.0 Request processed in 44us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263313.980846:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00080000:0.0:1788263313.980868:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788263313.980891:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283a4df80 x1875129709758848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263313.980902:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709758848:0@lo:400:kworker.0 00000100:00100000:0.0:1788263313.980910:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875129709759360:0@lo:400:kworker.0 00000100:00100000:0.0:1788263313.980931:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263313.980950:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709759360 00000100:00100000:0.0:1788263313.980954:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709759360 00000100:00100000:0.0:1788263313.980994:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788263313.981001:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff39870f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875129709759360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263313.981030:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff39870f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875129709759360:12345-0@lo:400:kworker.0 Request processed in 30us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263313.981036:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:0.0:1788263313.981051:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788263313.981068:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2833d8000 x1875129709759360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263313.981077:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875129709759360:0@lo:400:kworker.0 00000100:00100000:1.0:1788263313.981164:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263313.981192:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709759616:0@lo:400:kworker.0 00000100:00100000:1.0:1788263313.981242:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263313.981267:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709759104 00000100:00100000:1.0:1788263313.981271:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709759104 00000100:00100000:1.0:1788263313.981318:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709759616 00000100:00100000:1.0:1788263313.981322:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709759616 00000100:00100000:1.0:1788263313.981344:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788263313.981350:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709759104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263313.981390:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709759104:12345-0@lo:400:kworker.0 Request processed in 41us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263313.981396:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788263313.981487:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709758336 00000100:00100000:2.0:1788263313.981491:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709758336 00000100:00100000:2.0:1788263313.981517:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788263313.981524:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff39870d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709758336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263313.981562:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff39870d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709758336:12345-0@lo:400:kworker.0 Request processed in 39us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263313.981568:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:2.0:1788263313.981616:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263313.981628:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788263313.981635:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709759616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263313.981664:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709759616:12345-0@lo:400:kworker.0 Request processed in 30us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263313.981670:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788263313.981764:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3618:x1875129709758080:12345-0@lo:400:kworker.0 Request processed in 12885us (13322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263313.981772:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1788263313.981870:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709759616:0@lo:400:kworker.0 00000100:00100000:1.0:1788263313.981889:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709758080:0@lo:400:kworker.0 00000100:00100000:1.0:1788263313.981900:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709758592:0@lo:400:kworker.0 00000100:00100000:1.0:1788263313.981912:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709759104:0@lo:400:kworker.0 00000100:00100000:0.0:1788263313.982061:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709758336:0@lo:400:kworker.0 00000100:00100000:3.0:1788263314.011361:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263314.011482:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699175808 00000100:00100000:2.0:1788263314.011493:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699175808 00000100:00100000:2.0:1788263314.011698:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 50 00000100:00100000:2.0:1788263314.011710:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398ccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+16:11117:x1875129699175808:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788263314.011733:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263314.011754:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f753 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fe0f expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263314.011873:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788263314.011979:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f753 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe0f expref: 18 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.011993:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff282126d00) 00010000:00010000:2.0:1788263314.011996:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788263314.012001:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f753 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe0f expref: 18 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.012014:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d0e00, rc 0) 00000100:00100000:2.0:1788263314.012067:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398ccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+17:11117:x1875129699175808:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 359us (715us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1788263314.012073:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 50 00000100:00100000:3.0:1788263314.015763:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263314.015976:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699176064 00000100:00100000:2.0:1788263314.015986:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699176064 00000100:00100000:2.0:1788263314.016037:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:2.0:1788263314.016046:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+17:11117:x1875129699176064:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:2.0:1788263314.016265:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+18:11117:x1875129699176064:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 219us (509us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788263314.016273:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 7 00010000:00010000:2.0:1788263314.095855:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263314.178505:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263314.178722:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699176192 00000100:00100000:0.0:1788263314.178733:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699176192 00000100:00100000:0.0:1788263314.178795:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 51 00000100:00100000:0.0:1788263314.178805:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+18:11124:x1875129699176192:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788263314.178828:0:8884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263314.178848:0:8884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f761 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fe16 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.178913:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ea00/0x4b1103cba666f768 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.178926:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ea00/0x4b1103cba666f768 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.178937:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ea00/0x4b1103cba666f768 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263314.178993:0:8884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788263314.179010:0:8884:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788263314.179034:0:8884:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ea00/0x4b1103cba666f768 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.179060:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f761 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe16 expref: 20 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.179077:0:8884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ea00/0x4b1103cba666f768 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe16 expref: 19 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.179085:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:0.0:1788263314.179088:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788263314.179092:0:8884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17ea00, rc 0) 00000100:00100000:0.0:1788263314.179269:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+19:11124:x1875129699176192:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 464us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263314.179277:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 51 00000100:00100000:1.0:1788263314.186914:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263314.187045:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699176448 00000100:00100000:0.0:1788263314.187055:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699176448 00000100:00100000:0.0:1788263314.187113:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:0.0:1788263314.187123:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+19:11124:x1875129699176448:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788263314.187143:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263314.187174:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f76f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fe1d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.187283:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f776 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.187297:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f776 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.187336:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f776 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263314.187347:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788263314.187450:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f76f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe1d expref: 22 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.187469:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f776 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe1d expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.187478:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282126600) 00010000:00010000:0.0:1788263314.187481:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263314.187485:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17f600, rc 0) 00000100:00100000:0.0:1788263314.187551:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+21:11124:x1875129699176448:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 429us (646us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788263314.187557:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:3.0:1788263314.198343:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263314.198388:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263314.198481:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699176704 00000100:00100000:2.0:1788263314.198490:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699176704 00000100:00100000:2.0:1788263314.198619:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:2.0:1788263314.198631:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+21:11124:x1875129699176704:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788263314.198675:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263314.198698:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f784 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fe24 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.198804:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666f78b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.198819:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666f78b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.198831:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666f78b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263314.198843:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788263314.198944:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f784 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe24 expref: 24 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.198962:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666f78b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe24 expref: 23 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.198970:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282126600) 00010000:00010000:2.0:1788263314.198973:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788263314.198976:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d0a00, rc 0) 00000100:00100000:2.0:1788263314.199050:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+23:11124:x1875129699176704:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 422us (716us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788263314.199058:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:0.0:1788263314.199530:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699176832 00000100:00100000:0.0:1788263314.199542:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699176832 00000100:00100000:0.0:1788263314.199622:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:0.0:1788263314.199630:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398ccc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+23:2386:x1875129699176832:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263314.199640:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263314.199655:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f776 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe1d expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.199667:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282126600) 00010000:00010000:0.0:1788263314.199670:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263314.199706:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398ccc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:2386:x1875129699176832:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 77us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263314.199714:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:3.0:1788263314.239082:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263314.239886:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699176960 00000100:00100000:2.0:1788263314.239897:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699176960 00000100:00100000:2.0:1788263314.239973:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 31 00000100:00100000:2.0:1788263314.240001:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398ccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2387:x1875129699176960:12345-192.168.203.26@tcp:1:lfs.0 00010000:00010000:2.0:1788263314.240046:0:9885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dfca47d/0x4b1103cba666f799 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.240069:0:9885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666f74c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe08 expref: 7 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.240078:0:9885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788263314.240081:0:9885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788263314.240086:0:9885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004dfca47d/0x4b1103cba666f799 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.240120:0:9885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666f74c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe08 expref: 7 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.240134:0:9885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666f74c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe08 expref: 7 pid: 9885 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263314.241263:0:9885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398740380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9885:1875129709759872:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788263314.241383:0:9885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39019b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263314.247856:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263314.248086:0:9885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398740380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9885:1875129709759872:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788263314.248108:0:9885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004dfca47d/0x4b1103cba666f799 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263314.252159:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699177088 00000100:00100000:3.0:1788263314.252347:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699177088 00002000:00100000:3.0:1788263314.252398:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9ff398663800 x1875129699177088/t0(0) o4->ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp:525/0 lens 504/0 e 0 to 0 dl 1788263325 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788263314.252409:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ff398663800 with x1875129699177088 ext(0->12) 00010000:00010000:3.0:1788263314.252418:0:8409:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666f74c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe08 expref: 8 pid: 9885 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263314.252446:0:8409:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666f74c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe08 expref: 8 pid: 9885 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788263314.252454:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ff398663800 00000100:00100000:3.0:1788263314.252565:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:3.0:1788263314.252575:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398663800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2387:x1875129699177088:12345-192.168.203.26@tcp:4:lfs.0 00000001:00100000:1.0:1788263314.260906:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea 00000100:00100000:3.0:1788263314.261909:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398663800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:2387:x1875129699177088:12345-192.168.203.26@tcp:4:lfs.0 Request processed in 9330us (14057us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788263314.261919:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 0 00002000:00100000:3.0:1788263314.261929:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9ff398663800 x1875129699177088/t4294967300(0) o4->ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp:525/0 lens 504/448 e 0 to 0 dl 1788263325 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788263314.261936:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ff398663800 with x1875129699177088 ext(0->12) 00010000:00010000:3.0:1788263314.261944:0:8409:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666f74c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe08 expref: 9 pid: 9885 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263314.261964:0:8409:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666f74c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe08 expref: 9 pid: 9885 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788263314.261970:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ff398663800 00000100:00100000:3.0:1788263314.267771:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263314.267827:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699177216 00000100:00100000:2.0:1788263314.267837:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699177216 00010000:00010000:2.0:1788263314.267892:0:9493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666f74c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe08 expref: 9 pid: 9885 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263314.267940:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:2.0:1788263314.267951:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:2386:x1875129699177216:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263314.267966:0:9493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788263314.267983:0:9493:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788263314.267986:0:9493:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788263313 00002000:00010000:2.0:1788263314.267988:0:9493:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788263313 00002000:00010000:2.0:1788263314.267990:0:9493:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788263313 00002000:00010000:2.0:1788263314.267992:0:9493:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788263314.267999:0:9493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666f74c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe08 expref: 9 pid: 9885 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.268012:0:9493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666f74c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe08 expref: 9 pid: 9885 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.268035:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666f74c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe08 expref: 9 pid: 9885 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.268052:0:9493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788263314.268056:0:9493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788263314.268062:0:9493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004dfca47d/0x4b1103cba666f799 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.268071:0:9493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004dfca47d/0x4b1103cba666f799 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.268119:0:9493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263314.268188:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2386:x1875129699177216:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 238us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263314.268196:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 53 00010000:00010000:3.0:1788263314.268715:0:9885:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004dfca47d/0x4b1103cba666f799 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263314.268727:0:9885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004dfca47d/0x4b1103cba666f799 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263314.268755:0:9885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dfca47d/0x4b1103cba666f799 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263314.268763:0:9885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004dfca47d/0x4b1103cba666f799 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263314.268772:0:9885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004dfca47d/0x4b1103cba666f799 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263314.268779:0:9885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0e00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263314.268789:0:9885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004dfca47d/0x4b1103cba666f799 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263314.268798:0:9885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004dfca47d/0x4b1103cba666f799 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263314.268810:0:9885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004dfca47d/0x4b1103cba666f799 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263314.268819:0:9885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dfca47d/0x4b1103cba666f799 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263314.269081:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398ccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2387:x1875129699176960:12345-192.168.203.26@tcp:1:lfs.0 Request processed in 29081us (30005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263314.269090:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 31 00000100:00100000:3.0:1788263314.277371:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263314.277623:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699177472 00000100:00100000:2.0:1788263314.277633:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699177472 00000100:00100000:2.0:1788263314.277687:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00100000:2.0:1788263314.277698:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:11124:x1875129699177472:12345-192.168.203.26@tcp:35:lfs.0 00000004:00010000:2.0:1788263314.277780:0:6495:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666f78b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe24 expref: 22 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788263314.278005:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1788263314.278054:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788263314.281060:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1788263314.281120:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666f7a0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.281139:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666f730 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdfa expref: 26 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.281148:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666f7a0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.281189:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666f730 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdfa expref: 26 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.281205:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666f730 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdfa expref: 26 pid: 6492 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263314.281233:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398740380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6495:1875129709760000:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788263314.281331:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39019b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263314.285734:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398740380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6495:1875129709760000:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788263314.285765:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666f7a0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263314.288179:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263314.288519:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699177600 00000100:00100000:0.0:1788263314.288528:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699177600 00010000:00010000:0.0:1788263314.288570:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666f730 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdfa expref: 27 pid: 6492 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263314.288640:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:0.0:1788263314.288650:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398ccf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+27:2387:x1875129699177600:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263314.288664:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263314.288671:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666f730 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdfa expref: 27 pid: 6492 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.288684:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666f730 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdfa expref: 27 pid: 6492 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.288705:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666f730 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdfa expref: 27 pid: 6492 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.288721:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282126600) 00010000:00010000:0.0:1788263314.288727:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666f7a0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.288735:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666f7a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.288742:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666f7a0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.288829:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263314.288886:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398ccf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+26:2387:x1875129699177600:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 237us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263314.288894:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 54 00010000:00010000:3.0:1788263314.291744:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666f7a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263314.291761:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666f7a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788263314.291878:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1788263314.292114:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1788263314.292373:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398ccfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6495:1875129709760128:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788263314.292444:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263314.292541:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2833ace40 going to sleep for 11 seconds 00000100:00100000:2.0:1788263314.292829:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709760128 00000100:00100000:2.0:1788263314.292837:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709760128 00000100:00100000:2.0:1788263314.292929:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788263314.292948:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398ccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6495:x1875129709760128:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788263314.293048:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398ccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6495:x1875129709760128:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 110us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263314.293055:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788263314.293117:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398ccfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6495:1875129709760128:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788263314.293269:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1788263314.293336:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398ccfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6495:1875129709760256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788263314.293363:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263314.294317:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2831a1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788263314.294433:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709760256 00000100:00100000:1.0:1788263314.294439:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709760256 00000100:00100000:1.0:1788263314.294473:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788263314.294481:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6495:x1875129709760256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788263314.295124:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6495:x1875129709760256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 642us (1757us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788263314.295133:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788263314.295373:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398ccfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6495:1875129709760256:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788263314.295508:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1788263314.295562:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666f7a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263314.295572:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666f7a0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263314.295597:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666f7a0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263314.295604:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1c00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263314.295621:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666f7a0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263314.295631:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666f7a0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263314.295646:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282126600) 00010000:00010000:3.0:1788263314.295649:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788263314.295653:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666f7a0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263314.295660:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666f7a0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788263314.295773:0:6495:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788263314.295836:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788263314.295848:0:6495:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 323367267841ns, next at 324367265968ns, rc = 0 00000001:00080000:3.0:1788263314.295854:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:3.0:1788263314.295878:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282126600) 00010000:00010000:3.0:1788263314.295881:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788263314.295889:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666f78b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe24 expref: 30 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263314.296006:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:11124:x1875129699177472:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 18309us (18643us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1788263314.296014:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 8 00000020:00080000:3.0:1788263314.296019:0:6495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788263314.299893:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263314.300225:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699177728 00000100:00100000:2.0:1788263314.300234:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699177728 00000100:00100000:2.0:1788263314.300401:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:2.0:1788263314.300413:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:11124:x1875129699177728:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788263314.300437:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263314.300460:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f7a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fe2b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.300512:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f7a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe2b expref: 30 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.300525:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f7a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe2b expref: 30 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.300557:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:2.0:1788263314.300560:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263314.300564:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d0e00, rc 0) 00000100:00100000:2.0:1788263314.300727:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+30:11124:x1875129699177728:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 315us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263314.300734:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:3.0:1788263314.315146:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263314.315528:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699177984 00000100:00100000:2.0:1788263314.315539:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699177984 00000100:00100000:2.0:1788263314.315749:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:2.0:1788263314.315762:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a973e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+30:11124:x1875129699177984:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:2.0:1788263314.316007:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a973e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+31:11124:x1875129699177984:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 249us (871us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788263314.316013:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:1.0:1788263314.397885:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263314.397969:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699178240 00000100:00100000:2.0:1788263314.397976:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699178240 00000100:00100000:2.0:1788263314.398023:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:2.0:1788263314.398030:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+31:11134:x1875129699178240:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788263314.398048:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263314.398063:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666f7ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fe32 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263314.398138:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788263314.398215:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666f7ae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe32 expref: 33 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.398245:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff282126d00) 00010000:00010000:2.0:1788263314.398248:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788263314.398253:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666f7ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe32 expref: 33 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.398267:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d0400, rc 0) 00000100:00100000:2.0:1788263314.398338:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+32:11134:x1875129699178240:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 307us (458us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1788263314.398345:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:0.0:1788263314.416223:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263314.416503:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699178368 00000100:00100000:3.0:1788263314.416528:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699178368 00000100:00100000:3.0:1788263314.416619:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:3.0:1788263314.416631:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff39870e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+32:11134:x1875129699178368:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:0.0:1788263314.416749:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f7bc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.416766:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f7bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.416777:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f7bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.416788:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f7c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.416796:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.416802:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.416879:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f7ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.416887:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f7ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.416894:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f7ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788263314.416970:0:8884:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f7ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.416981:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f7bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.416985:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f7bc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.416989:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f7bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.416992:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17f800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263314.416995:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f7bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.416999:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f7bc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.417008:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:0.0:1788263314.417010:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263314.417012:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f7bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.417016:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f7bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.417025:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.417028:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f7c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.417036:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f7c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.417039:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17e400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263314.417041:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f7c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.417044:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f7c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.417049:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ff282126500) 00010000:00010000:0.0:1788263314.417050:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263314.417051:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f7c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.417054:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f7c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.417060:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f7ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.417063:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f7ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.417067:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f7ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.417070:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17e600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263314.417071:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f7ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.417080:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f7ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.417084:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:0.0:1788263314.417086:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263314.417087:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f7ca lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.417090:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f7ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263314.417152:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff39870e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+32:11134:x1875129699178368:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 523us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263314.417159:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:3.0:1788263314.423378:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263314.424642:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699178624 00000100:00100000:2.0:1788263314.424652:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699178624 00000100:00100000:2.0:1788263314.424710:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:2.0:1788263314.424720:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+32:11134:x1875129699178624:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:2.0:1788263314.424926:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+33:11134:x1875129699178624:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 207us (1557us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788263314.424934:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:3.0:1788263314.480266:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788263314.480298:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff39870d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709760384:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788263314.480369:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263314.480491:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709760384 00000100:00100000:1.0:1788263314.480509:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709760384 00000100:00100000:1.0:1788263314.480555:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788263314.480565:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709760384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788263314.480607:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263314.480673:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709760384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263314.480680:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788263314.480814:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff39870d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709760384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788263314.501001:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263314.501522:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699178880 00000100:00100000:2.0:1788263314.501533:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699178880 00000100:00100000:2.0:1788263314.501630:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:2.0:1788263314.501641:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+33:11137:x1875129699178880:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788263314.501666:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263314.501688:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666f7d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fe39 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.501764:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f7d8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.501791:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f7d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.501802:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f7d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.501815:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666f7df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.501822:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666f7df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.501829:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666f7df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.501933:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666f7e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.501959:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666f7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.501967:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666f7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263314.501977:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788263314.502047:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f7d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.502055:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f7d8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.502061:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f7d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.502075:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263314.502079:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f7d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.502087:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f7d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.502099:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:2.0:1788263314.502102:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263314.502106:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f7d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.502112:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f7d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.502127:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666f7df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.502132:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666f7df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.502137:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666f7df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.502142:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1a00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263314.502145:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666f7df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.502150:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666f7df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.502168:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ff282126500) 00010000:00010000:2.0:1788263314.502170:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263314.502173:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666f7df lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.502179:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666f7df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.502228:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666f7d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe39 expref: 36 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.502242:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666f7e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe39 expref: 35 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263314.502249:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:2.0:1788263314.502252:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788263314.502254:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d1000, rc 0) 00000100:00100000:2.0:1788263314.502324:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+35:11137:x1875129699178880:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 686us (1332us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788263314.502332:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:0.0:1788263314.508297:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263314.508548:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699179008 00000100:00100000:1.0:1788263314.508567:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699179008 00000100:00100000:1.0:1788263314.508643:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00100000:1.0:1788263314.508653:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff39870d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+35:11137:x1875129699179008:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:1.0:1788263314.508725:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba666f7f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263314.508741:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba666f7f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263314.508752:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba666f7f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263314.508788:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba666f7f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263314.508795:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba666f7f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263314.508802:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba666f7f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263314.508808:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765a00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263314.508812:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba666f7f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263314.508819:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba666f7f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263314.508843:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:1.0:1788263314.508846:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788263314.508851:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba666f7f4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263314.508857:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba666f7f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263314.508951:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff39870d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+35:11137:x1875129699179008:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 299us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263314.508958:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00100000:3.0:1788263314.523462:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263314.523748:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699179264 00000100:00100000:2.0:1788263314.523758:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699179264 00000100:00100000:2.0:1788263314.523818:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:2.0:1788263314.523828:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+35:11137:x1875129699179264:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:2.0:1788263314.524064:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+36:11137:x1875129699179264:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 237us (609us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788263314.524072:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:2.0:1788263314.944984:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263314.945097:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699179520 00000100:00100000:0.0:1788263314.945107:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699179520 00000100:00100000:0.0:1788263314.945174:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:0.0:1788263314.945186:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+36:11168:x1875129699179520:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:0.0:1788263314.945212:0:8884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263314.945376:0:8884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f7fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fe40 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.945482:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f802 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.945497:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f802 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.945531:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f802 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263314.945543:0:8884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788263314.945705:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f7fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe40 expref: 39 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.945722:0:8884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f802 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe40 expref: 38 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263314.945735:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:0.0:1788263314.945738:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263314.945742:0:8884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17e200, rc 0) 00000100:00100000:0.0:1788263314.945846:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+38:11168:x1875129699179520:12345-192.168.203.26@tcp:101:cat.0 Request processed in 662us (872us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788263314.945854:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:3.0:1788263314.965039:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263314.965355:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263314.965383:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699179904 00000100:00100000:3.0:1788263314.965391:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699179904 00000100:00100000:3.0:1788263314.965499:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:3.0:1788263314.965510:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385673480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+38:2387:x1875129699179904:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263314.965525:0:9493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263314.965549:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f802 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe40 expref: 38 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263314.965568:0:9493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:3.0:1788263314.965573:0:9493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263314.965652:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385673480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+37:2387:x1875129699179904:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 143us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263314.965659:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:2.0:1788263314.965956:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699179776 00000100:00100000:2.0:1788263314.965961:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699179776 00000100:00100000:2.0:1788263314.965997:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:2.0:1788263314.966006:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+37:11168:x1875129699179776:12345-192.168.203.26@tcp:35:cat.0 00000100:00100000:2.0:1788263314.966191:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+38:11168:x1875129699179776:12345-192.168.203.26@tcp:35:cat.0 Request processed in 187us (1161us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1788263314.966198:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:1.0:1788263314.992361:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709760640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788263314.992430:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263314.992722:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709760640 00000100:00100000:3.0:1788263314.992730:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709760640 00000100:00100000:3.0:1788263314.992794:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788263314.992804:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709760640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788263314.992831:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788263314.992878:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709760640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263314.992885:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788263314.992928:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709760640:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788263314.993037:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788263314.993048:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709760512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263314.993089:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263314.993194:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709760512 00000100:00100000:1.0:1788263314.993199:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709760512 00000100:00100000:1.0:1788263314.993237:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788263314.993245:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff39870f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875129709760512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788263314.993256:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788263314.993295:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff39870f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875129709760512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263314.993311:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788263314.994425:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709760512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788263315.025408:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263315.025707:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699180160 00000100:00100000:0.0:1788263315.025721:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699180160 00000100:00100000:0.0:1788263315.025817:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:0.0:1788263315.025832:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+38:11174:x1875129699180160:12345-192.168.203.26@tcp:101:dd.0 00000100:00080000:2.0:1788263315.026003:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788263315.026045:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263315.026049:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788263315.026103:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ea00/0x4b1103cba666f768 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe16 expref: 38 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.026128:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:0.0:1788263315.026144:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788263315.026163:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f810 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fe47 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.033053:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f817 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.033084:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666f7e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe39 expref: 38 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.033096:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f817 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.033165:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666f7e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe39 expref: 38 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.033182:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666f7e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe39 expref: 38 pid: 6493 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263315.033214:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff39870c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6492:1875129709760768:192.168.203.26@tcp:104: 00000100:00100000:1.0:1788263315.033438:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff382a64a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788263315.041975:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263315.042036:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699180288 00000100:00100000:3.0:1788263315.042048:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699180288 00010000:00010000:3.0:1788263315.042102:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666f7e6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe39 expref: 39 pid: 6493 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263315.042162:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:3.0:1788263315.042392:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385671500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+39:2387:x1875129699180288:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263315.042416:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263315.042426:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666f7e6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe39 expref: 39 pid: 6493 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263315.042442:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666f7e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe39 expref: 39 pid: 6493 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263315.042472:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:3.0:1788263315.042479:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f817 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263315.042512:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f817 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263315.042521:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f817 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263315.042548:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263315.042643:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385671500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+39:2387:x1875129699180288:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 470us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263315.042652:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 55 00010000:00010000:1.0:1788263315.066976:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666f7e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe39 expref: 38 pid: 6493 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263315.067005:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff39870c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6492:1875129709760768:192.168.203.26@tcp:104: 00010000:00010000:1.0:1788263315.067036:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f817 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263315.067170:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f817 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263315.067187:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f817 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263315.067217:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788263315.068805:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f810 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe47 expref: 39 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263315.068832:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f817 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe47 expref: 38 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263315.068842:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:3.0:1788263315.068844:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788263315.068848:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17f600, rc 0) 00000100:00100000:3.0:1788263315.068938:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+38:11174:x1875129699180160:12345-192.168.203.26@tcp:101:dd.0 Request processed in 43109us (43543us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788263315.068961:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:3.0:1788263315.080523:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263315.080728:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699180416 00000100:00100000:0.0:1788263315.080742:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699180416 00000100:00100000:0.0:1788263315.080829:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:0.0:1788263315.080842:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+38:11174:x1875129699180416:12345-192.168.203.26@tcp:101:dd.0 00010000:00010000:0.0:1788263315.080900:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263315.080929:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ea00/0x4b1103cba666f825 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fe4e expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.080976:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f82c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.080994:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f82c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.081007:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f82c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.081201:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ea00/0x4b1103cba666f825 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe4e expref: 40 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.081222:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f82c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe4e expref: 39 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.081232:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:0.0:1788263315.081236:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788263315.081240:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17e400, rc 0) 00000100:00100000:0.0:1788263315.081324:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+39:11174:x1875129699180416:12345-192.168.203.26@tcp:101:dd.0 Request processed in 484us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263315.081332:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:0.0:1788263315.089433:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263315.089557:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699180672 00000100:00100000:2.0:1788263315.089606:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699180672 00000100:00100000:2.0:1788263315.089695:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 62 00000100:00100000:2.0:1788263315.089708:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff39870c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+39:11174:x1875129699180672:12345-192.168.203.26@tcp:36:dd.0 00010000:00010000:2.0:1788263315.091485:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f833 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.091507:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f833 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.091519:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f833 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788263315.091565:0:8884:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1788263315.091610:0:8884:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002aa2234a reply state 000000007d62ba6a transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f833 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.091623:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f833 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.091634:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:2.0:1788263315.091653:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788263315.091658:0:8884:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788263315.091774:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff39870c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+42:11174:x1875129699180672:12345-192.168.203.26@tcp:36:dd.0 Request processed in 2065us (2357us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1788263315.091783:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 62 00000020:00080000:2.0:1788263315.091788:0:8884:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788263315.119830:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263315.440224:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263315.440378:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699180800 00000100:00100000:2.0:1788263315.440393:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699180800 00000100:00100000:2.0:1788263315.440461:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 63 00000100:00100000:2.0:1788263315.440472:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+42:11188:x1875129699180800:12345-192.168.203.26@tcp:101:stat.0 00010000:00010000:2.0:1788263315.440496:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263315.440516:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba666f83a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fe55 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.440602:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666f841 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.440617:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666f841 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.440629:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666f841 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.440640:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba666f848 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.440647:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba666f848 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.440655:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba666f848 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.440900:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f84f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.440912:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f817 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe47 expref: 43 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.440919:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f84f lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.440952:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f817 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe47 expref: 43 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.440965:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f817 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe47 expref: 43 pid: 6492 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263315.440977:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398743800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6492:1875129709760896:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788263315.441098:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39019b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788263315.444387:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398743800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6492:1875129709760896:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788263315.444415:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f84f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263315.444514:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263315.444812:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699181056 00000100:00100000:2.0:1788263315.444821:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699181056 00000100:00100000:2.0:1788263315.445330:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:2.0:1788263315.445342:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+44:10746:x1875129699181056:12345-192.168.203.26@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788263315.445646:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+45:10746:x1875129699181056:12345-192.168.203.26@tcp:35:ldlm_bl.0 Request processed in 303us (1404us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788263315.445667:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:3.0:1788263315.448104:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263315.448468:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699181184 00000100:00100000:2.0:1788263315.448477:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699181184 00010000:00010000:2.0:1788263315.448512:0:9493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f817 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe47 expref: 45 pid: 6492 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263315.448558:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:2.0:1788263315.448566:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385671880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+45:2387:x1875129699181184:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263315.448602:0:9493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263315.448609:0:9493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f817 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe47 expref: 45 pid: 6492 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.448622:0:9493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f817 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe47 expref: 45 pid: 6492 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.448643:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f817 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe47 expref: 45 pid: 6492 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.448657:0:9493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:2.0:1788263315.448660:0:9493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f84f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.448668:0:9493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f84f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.448673:0:9493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f84f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.449222:0:9493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788263315.449222:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f84f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.449349:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f84f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263315.449398:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385671880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+44:2387:x1875129699181184:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 831us (1300us total) trans 0 rc 0/0 00000004:00200000:0.0:1788263315.449398:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788263315.449402:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1788263315.449406:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 56 00000004:00010000:0.0:1788263315.449451:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f84f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.449466:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f84f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.449475:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666f841 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.449482:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666f841 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.449488:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666f841 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.449494:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263315.449498:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666f841 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.449506:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666f841 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.449514:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:0.0:1788263315.449517:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263315.449520:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666f841 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.449534:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666f841 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.449545:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba666f848 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.449551:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba666f848 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.449556:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba666f848 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.449560:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263315.449563:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba666f848 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.449569:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba666f848 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.449576:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ff282126500) 00010000:00010000:0.0:1788263315.449618:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263315.449622:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba666f848 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.449629:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba666f848 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.449659:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba666f83a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe55 expref: 44 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.449671:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f84f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe55 expref: 43 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.449684:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:0.0:1788263315.449687:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263315.449689:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d1e00, rc 0) 00000100:00100000:0.0:1788263315.449713:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+43:11188:x1875129699180800:12345-192.168.203.26@tcp:101:stat.0 Request processed in 9245us (9522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263315.449720:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 63 00000001:00080000:0.0:1788263315.451412:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967338 is committed 00000004:00080000:0.0:1788263315.451444:0:6470:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1788263315.451471:0:6470:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ff2833ace40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788263315.451484:0:6470:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ff28310f600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ff2833ac540 00000020:00080000:0.0:1788263315.451487:0:6470:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ff3b39f4100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ff38af1ce00 00010000:00010000:2.0:1788263315.451561:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f6e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451571:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f6e3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451609:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f6e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451615:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eed200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263315.451619:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f6e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451626:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f6e3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451639:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ff282126400) 00010000:00010000:2.0:1788263315.451641:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263315.451645:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f6e3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451651:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f6e3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451670:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666f6ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451693:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666f6ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451699:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666f6ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451714:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eedc00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263315.451717:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666f6ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451723:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666f6ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451730:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:2.0:1788263315.451732:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263315.451735:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666f6ea lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451741:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666f6ea lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451755:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f729 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451761:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f729 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451767:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f729 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451772:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eec600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263315.451780:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f729 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451786:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f729 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451794:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ff282126500) 00010000:00010000:2.0:1788263315.451796:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263315.451799:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f729 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451803:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f729 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451818:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f833 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451824:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f833 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451829:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f833 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451833:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263315.451835:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f833 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451841:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f833 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451847:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:2.0:1788263315.451849:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263315.451857:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f833 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.451863:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f833 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788263315.451880:0:6523:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1788263315.452044:0:6523:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788263315.452700:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263315.452729:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709761024:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788263315.452803:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263315.452935:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709761024 00000100:00100000:1.0:1788263315.452943:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709761024 00000100:00100000:1.0:1788263315.453005:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788263315.453016:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1875129709761024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788263315.453038:0:8405:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1788263315.453065:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a96bb91, atime: 0x6a96bb91, ctime: 0x6a96bb91, blocks: 0x8 00010000:00010000:1.0:1788263315.453073:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6948eb3/0x4b1103cba666f856 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.453088:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=324s v=(0 0) 00010000:00010000:1.0:1788263315.453092:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263315.453097:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6948eb3/0x4b1103cba666f856 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.453112:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6948eb3/0x4b1103cba666f856 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.453120:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6948eb3/0x4b1103cba666f856 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.453127:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6948eb3/0x4b1103cba666f856 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.453151:0:8405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788263315.453268:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3618:x1875129709761024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 256us (465us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788263315.453280:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1788263315.453312:0:9492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263315.453318:0:9492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6948eb3/0x4b1103cba666f856 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.453326:0:9492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765a00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:1.0:1788263315.453330:0:9492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6948eb3/0x4b1103cba666f856 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.453337:0:9492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6948eb3/0x4b1103cba666f856 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.453350:0:9492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6948eb3/0x4b1103cba666f856 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.453356:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6948eb3/0x4b1103cba666f856 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.453496:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263315.453498:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263315.453499:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788263315.453526:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ff398661500/2, rc 0, transno 4294967302 00000100:00100000:1.0:1788263315.453531:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709761024:0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1788263315.453793:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263315.549206:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263315.549380:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699181440 00000100:00100000:2.0:1788263315.549391:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699181440 00000100:00100000:2.0:1788263315.549454:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:2.0:1788263315.549464:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+12:11194:x1875129699181440:12345-192.168.203.26@tcp:36:truncate.0 00010000:00010000:2.0:1788263315.551194:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263315.551228:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f84f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe55 expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.551249:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:2.0:1788263315.551255:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788263315.551442:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f85d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.551456:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f85d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.551465:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f85d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788263315.553324:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1788263315.553375:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004abbfcf5 reply state 000000006df5b1fa transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f85d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.553408:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f85d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263315.553417:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:2.0:1788263315.553420:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788263315.553423:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788263315.553602:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+14:11194:x1875129699181440:12345-192.168.203.26@tcp:36:truncate.0 Request processed in 4136us (4402us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788263315.553611:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 64 00000020:00080000:2.0:1788263315.554928:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788263315.851722:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263315.854638:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699181568 00000100:00100000:1.0:1788263315.854660:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699181568 00000100:00100000:1.0:1788263315.854770:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:1.0:1788263315.854784:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+14:11208:x1875129699181568:12345-192.168.203.26@tcp:101:stat.0 00010000:00010000:1.0:1788263315.854819:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263315.854846:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba666f864 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fe5c expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862269:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f86b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862304:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f86b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862318:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f86b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862336:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba666f872 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862344:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba666f872 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862351:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba666f872 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862436:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666f879 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862446:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666f879 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862454:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666f879 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263315.862517:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788263315.862522:0:10388:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788263315.862544:0:10388:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666f879 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862556:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666f879 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862564:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f86b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862570:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f86b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862577:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f86b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862601:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765c00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263315.862606:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f86b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862614:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f86b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862626:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:1.0:1788263315.862630:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263315.862634:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f86b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862640:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba666f86b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862665:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba666f872 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862671:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba666f872 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862677:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba666f872 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862682:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae764400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263315.862686:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba666f872 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862692:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba666f872 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862700:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ff3986d8a00) 00010000:00010000:1.0:1788263315.862703:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263315.862706:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba666f872 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862712:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba666f872 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862749:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba666f864 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe5c expref: 16 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862762:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666f879 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe5c expref: 15 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263315.862780:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:1.0:1788263315.862783:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788263315.862786:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381681a00, rc 0) 00000100:00100000:1.0:1788263315.862879:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+15:11208:x1875129699181568:12345-192.168.203.26@tcp:101:stat.0 Request processed in 8097us (11170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263315.862888:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:3.0:1788263315.975813:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263315.976015:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699181824 00000100:00100000:0.0:1788263315.976029:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699181824 00000100:00100000:0.0:1788263315.976103:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00100000:0.0:1788263315.976115:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+15:11218:x1875129699181824:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788263315.976151:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263315.976178:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ea00/0x4b1103cba666f880 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fe63 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263315.976351:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788263315.976483:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ea00/0x4b1103cba666f880 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe63 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.976509:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff282126d00) 00010000:00010000:0.0:1788263315.976512:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788263315.976519:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ea00/0x4b1103cba666f880 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe63 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263315.976537:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17ea00, rc 0) 00000100:00100000:0.0:1788263315.976675:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+16:11218:x1875129699181824:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 561us (875us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1788263315.976684:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00100000:3.0:1788263315.980844:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263315.981689:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699182080 00000100:00100000:2.0:1788263315.981705:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699182080 00000100:00100000:2.0:1788263315.981784:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:2.0:1788263315.981795:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+16:11218:x1875129699182080:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:2.0:1788263315.982016:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+17:11218:x1875129699182080:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 222us (1186us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1788263315.982024:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:3.0:1788263316.026720:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263316.026966:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699182336 00000100:00100000:2.0:1788263316.026977:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699182336 00000100:00100000:2.0:1788263316.027105:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00100000:2.0:1788263316.027118:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+17:11224:x1875129699182336:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:2.0:1788263316.027152:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263316.027171:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f88e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fe6a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263316.027276:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666f895 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263316.027311:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666f879 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe5c expref: 18 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263316.027320:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666f895 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263316.027356:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666f879 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe5c expref: 18 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263316.027370:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666f879 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe5c expref: 18 pid: 10388 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263316.027383:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398743800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6493:1875129709761152:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788263316.027478:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39019b180 going to sleep for 11 seconds 00000100:00100000:1.0:1788263316.035040:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263316.035195:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699182464 00000100:00100000:3.0:1788263316.035204:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699182464 00010000:00010000:3.0:1788263316.035258:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666f879 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe5c expref: 19 pid: 10388 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263316.035311:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:3.0:1788263316.035320:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a9661450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+19:2387:x1875129699182464:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263316.035334:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263316.035340:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666f879 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe5c expref: 19 pid: 10388 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.035352:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666f879 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe5c expref: 19 pid: 10388 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.035375:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:3.0:1788263316.035381:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666f895 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.035407:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666f895 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.035414:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666f895 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.035434:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788263316.035768:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666f879 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe5c expref: 19 pid: 10388 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263316.035785:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398743800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6493:1875129709761152:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788263316.035806:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666f895 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263316.035814:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666f895 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263316.035820:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666f895 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263316.036084:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a9661450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+18:2387:x1875129699182464:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 763us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263316.036093:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 57 00000004:00200000:2.0:1788263316.036216:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788263316.036362:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f88e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe6a expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263316.036378:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666f895 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe6a expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263316.036385:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:2.0:1788263316.036388:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788263316.036390:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d0200, rc 0) 00000100:00100000:2.0:1788263316.036416:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+18:11224:x1875129699182336:12345-192.168.203.26@tcp:101:bash.0 Request processed in 9302us (9706us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788263316.036423:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00100000:3.0:1788263316.041682:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263316.042158:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699182720 00000100:00100000:1.0:1788263316.042168:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699182720 00000100:00100000:1.0:1788263316.042353:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 68 00000100:00100000:1.0:1788263316.042364:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+18:11224:x1875129699182720:12345-192.168.203.26@tcp:36:bash.0 00010000:00010000:1.0:1788263316.042576:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681e00/0x4b1103cba666f8a3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.042614:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681e00/0x4b1103cba666f8a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.042625:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681e00/0x4b1103cba666f8a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788263316.042669:0:10388:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:1.0:1788263316.042688:0:10388:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3b2d735 reply state 000000007acb23c5 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681e00/0x4b1103cba666f8a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.042698:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681e00/0x4b1103cba666f8a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.042705:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:1.0:1788263316.042732:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788263316.042735:0:10388:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788263316.042827:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+21:11224:x1875129699182720:12345-192.168.203.26@tcp:36:bash.0 Request processed in 465us (1153us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1788263316.042843:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 68 00000020:00080000:1.0:1788263316.042848:0:10388:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788263316.048434:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263316.048602:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699182848 00000100:00100000:0.0:1788263316.048615:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699182848 00000100:00100000:0.0:1788263316.048685:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 69 00000100:00100000:0.0:1788263316.048697:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+21:11224:x1875129699182848:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1788263316.048729:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263316.048766:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ea00/0x4b1103cba666f8aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fe71 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.048878:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f8b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.048896:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666f895 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe6a expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.048905:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f8b1 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.048948:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666f895 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe6a expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.048980:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666f895 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe6a expref: 22 pid: 6493 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263316.048997:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf77f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6492:1875129709761280:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788263316.049156:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff382a64840 going to sleep for 11 seconds 00000100:00100000:3.0:1788263316.052313:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263316.052880:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699182976 00000100:00100000:1.0:1788263316.052893:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699182976 00010000:00010000:1.0:1788263316.052943:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666f895 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe6a expref: 23 pid: 6493 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263316.052995:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00100000:1.0:1788263316.053005:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385671500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+23:2387:x1875129699182976:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263316.053022:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263316.053030:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666f895 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe6a expref: 23 pid: 6493 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.053044:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666f895 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe6a expref: 23 pid: 6493 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.053071:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:1.0:1788263316.053077:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f8b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.053088:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.053098:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f8b1 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.053467:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263316.053648:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385671500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+23:2387:x1875129699182976:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 641us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263316.053658:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 58 00010000:00010000:0.0:1788263316.054187:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666f895 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe6a expref: 22 pid: 6493 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263316.054217:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf77f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6492:1875129709761280:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788263316.054247:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.054258:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.054264:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263316.054346:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788263316.054351:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788263316.054376:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.054434:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ea00/0x4b1103cba666f8aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe71 expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.054451:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f8b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe71 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.054479:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:0.0:1788263316.054482:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263316.054486:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17e600, rc 0) 00000100:00100000:0.0:1788263316.054539:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+21:11224:x1875129699182848:12345-192.168.203.26@tcp:101:bash.0 Request processed in 5844us (6118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263316.054548:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 69 00000100:00100000:3.0:1788263316.057989:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263316.058122:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699183232 00000100:00100000:2.0:1788263316.058144:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699183232 00000100:00100000:2.0:1788263316.058211:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00100000:2.0:1788263316.058223:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a973dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+21:11224:x1875129699183232:12345-192.168.203.26@tcp:35:bash.0 00000100:00100000:2.0:1788263316.058949:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a973dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:11224:x1875129699183232:12345-192.168.203.26@tcp:35:bash.0 Request processed in 726us (974us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788263316.058958:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 15 00010000:00010000:2.0:1788263316.145258:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263316.179933:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263316.180275:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699183488 00000100:00100000:2.0:1788263316.180298:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699183488 00000100:00100000:2.0:1788263316.180384:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 70 00000100:00100000:2.0:1788263316.180396:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:11234:x1875129699183488:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788263316.180434:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263316.180460:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f8b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fe78 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263316.182811:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788263316.184716:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f8b8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe78 expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263316.184745:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff282126d00) 00010000:00010000:2.0:1788263316.184749:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788263316.184756:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f8b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe78 expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263316.184777:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d1e00, rc 0) 00000100:00100000:2.0:1788263316.184894:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+23:11234:x1875129699183488:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 4499us (4974us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1788263316.184906:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 70 00000100:00100000:3.0:1788263316.189100:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263316.191093:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699183616 00000100:00100000:1.0:1788263316.191114:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699183616 00000100:00100000:1.0:1788263316.191206:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 71 00000100:00100000:1.0:1788263316.191219:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+23:11234:x1875129699183616:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:1.0:1788263316.191350:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666f8c6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.191374:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666f8c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.191390:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666f8c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.191409:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666f8cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.191417:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666f8cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.191424:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666f8cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.191523:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666f8d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.191534:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666f8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.191563:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666f8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788263316.192204:0:10388:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666f8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.192315:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666f8c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.192323:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666f8c6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.192331:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666f8c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.192338:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381681800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263316.192343:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666f8c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.192351:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666f8c6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.192489:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:1.0:1788263316.192493:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263316.192498:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666f8c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.192503:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666f8c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.192979:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666f8cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.193002:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666f8cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.193006:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666f8cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.193009:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381680200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263316.193011:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666f8cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.193015:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666f8cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.193021:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ff3986d8a00) 00010000:00010000:1.0:1788263316.193023:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263316.193080:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666f8cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.193086:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666f8cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.193103:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666f8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.193107:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666f8d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.193110:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666f8d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.193114:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381680c00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263316.193121:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666f8d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.193125:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666f8d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.193278:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:1.0:1788263316.193282:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263316.193286:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666f8d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.193302:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666f8d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263316.193867:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+23:11234:x1875129699183616:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 2644us (4775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263316.193881:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 71 00000100:00100000:3.0:1788263316.200660:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263316.200834:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699183872 00000100:00100000:2.0:1788263316.200849:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699183872 00000100:00100000:2.0:1788263316.200937:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:2.0:1788263316.200949:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+23:11234:x1875129699183872:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:2.0:1788263316.201522:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+24:11234:x1875129699183872:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 573us (875us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788263316.201532:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:3.0:1788263316.262576:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263316.262844:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699184128 00000100:00100000:0.0:1788263316.262860:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699184128 00000100:00100000:0.0:1788263316.263057:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 72 00000100:00100000:0.0:1788263316.263070:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+24:11237:x1875129699184128:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788263316.263104:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263316.263491:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ea00/0x4b1103cba666f8db lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fe7f expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.263621:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f8e2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.263640:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f8e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.263653:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f8e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.263670:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f8e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.263677:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.263707:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.264057:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f8f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.264068:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.264076:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263316.264087:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788263316.264204:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f8e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.264213:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f8e2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.264222:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f8e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.264228:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17f600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263316.264233:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f8e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.264243:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f8e2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.264258:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:0.0:1788263316.264261:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263316.264274:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f8e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.264281:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f8e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.264311:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.264318:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f8e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.264325:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f8e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.264330:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17f800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263316.264333:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f8e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.264339:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f8e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.264347:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ff282279000) 00010000:00010000:0.0:1788263316.264349:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263316.264353:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f8e9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.264359:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f8e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.264412:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ea00/0x4b1103cba666f8db lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe7f expref: 27 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.264439:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f8f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe7f expref: 26 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.264447:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:0.0:1788263316.264450:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263316.264453:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17e200, rc 0) 00000100:00100000:0.0:1788263316.264544:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+26:11237:x1875129699184128:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1476us (1988us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788263316.264554:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 72 00000100:00100000:3.0:1788263316.268529:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263316.268666:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699184384 00000100:00100000:0.0:1788263316.268678:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699184384 00000100:00100000:0.0:1788263316.268772:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:0.0:1788263316.268786:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385670380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+26:2388:x1875129699184384:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263316.268806:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263316.268837:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f8f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe7f expref: 26 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.268859:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:0.0:1788263316.268864:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263316.268997:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385670380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+25:2388:x1875129699184384:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 215us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263316.269005:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:2.0:1788263316.269503:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263316.269737:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699184256 00000100:00100000:0.0:1788263316.269744:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699184256 00000100:00100000:0.0:1788263316.269813:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 73 00000100:00100000:0.0:1788263316.269840:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+25:11237:x1875129699184256:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:0.0:1788263316.269917:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666f8fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.269936:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666f8fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.269948:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666f8fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.269992:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666f8fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.269999:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666f8fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.270006:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666f8fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.270013:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e8800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263316.270018:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666f8fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.270026:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666f8fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.270035:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:0.0:1788263316.270039:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788263316.270043:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666f8fe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.270049:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666f8fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263316.270121:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+25:11237:x1875129699184256:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 282us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263316.270128:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 73 00000100:00100000:1.0:1788263316.273019:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263316.273124:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699184640 00000100:00100000:3.0:1788263316.273137:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699184640 00000100:00100000:3.0:1788263316.273201:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:3.0:1788263316.273213:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+25:11237:x1875129699184640:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1788263316.273516:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+26:11237:x1875129699184640:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 305us (510us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788263316.273525:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:3.0:1788263316.511711:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263316.511923:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699184896 00000100:00100000:1.0:1788263316.511937:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699184896 00000100:00100000:1.0:1788263316.512023:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 74 00000100:00100000:1.0:1788263316.512037:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+26:11255:x1875129699184896:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:1.0:1788263316.512072:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263316.512100:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666f905 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fe86 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.512262:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666f90c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.512281:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666f90c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.512328:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666f90c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263316.512343:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788263316.512495:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666f905 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe86 expref: 29 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.512519:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666f90c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe86 expref: 28 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263316.512529:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:1.0:1788263316.512532:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788263316.512537:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381680200, rc 0) 00000100:00100000:1.0:1788263316.513000:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+28:11255:x1875129699184896:12345-192.168.203.26@tcp:101:cat.0 Request processed in 964us (1302us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1788263316.513011:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 74 00000100:00100000:2.0:1788263316.567931:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263316.568105:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699185024 00000100:00100000:0.0:1788263316.568118:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699185024 00000100:00100000:0.0:1788263316.568199:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 75 00000100:00100000:0.0:1788263316.568212:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+28:11256:x1875129699185024:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788263316.568243:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263316.568269:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666f91a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fe8d expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.568368:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666f921 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.568388:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666f921 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.568403:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666f921 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263316.568465:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788263316.568470:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788263316.568495:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666f921 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.568527:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666f91a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe8d expref: 30 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.568551:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666f921 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe8d expref: 29 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263316.568643:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:0.0:1788263316.568648:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788263316.568652:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3829e9400, rc 0) 00000100:00100000:0.0:1788263316.568734:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:11256:x1875129699185024:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 524us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263316.568742:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 75 00000100:00100000:3.0:1788263316.575113:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263316.575255:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699185408 00000100:00100000:2.0:1788263316.575269:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699185408 00000100:00100000:2.0:1788263316.575351:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:2.0:1788263316.575363:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:11256:x1875129699185408:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:2.0:1788263316.575809:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+30:11256:x1875129699185408:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 447us (712us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788263316.575820:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:3.0:1788263316.579509:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263316.580253:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699185536 00000100:00100000:2.0:1788263316.580268:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699185536 00000100:00100000:2.0:1788263316.580418:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:2.0:1788263316.580432:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385671180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+30:11256:x1875129699185536:12345-192.168.203.26@tcp:103:lfs.0 00010000:00010000:2.0:1788263316.580452:0:9493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788263316.580489:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f8b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe71 expref: 30 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263316.580520:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666f90c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe86 expref: 29 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263316.580538:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f7a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe2b expref: 28 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263316.580563:0:9493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:2.0:1788263316.580569:0:9493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263316.581284:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385671180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+27:11256:x1875129699185536:12345-192.168.203.26@tcp:103:lfs.0 Request processed in 851us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263316.581305:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:0.0:1788263316.588052:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263316.588387:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699185664 00000100:00100000:3.0:1788263316.588403:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699185664 00000100:00100000:3.0:1788263316.588490:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 76 00000100:00100000:3.0:1788263316.588503:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+27:11256:x1875129699185664:12345-192.168.203.26@tcp:58:lfs.0 00010000:00010000:3.0:1788263316.588718:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba666f928 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.588741:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba666f928 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.588755:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba666f928 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788263316.589750:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788263316.589991:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788263316.590084:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788263316.590714:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+27:11256:x1875129699185664:12345-192.168.203.26@tcp:58:lfs.0 Request processed in 2207us (2669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263316.590727:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 76 00000100:00100000:3.0:1788263316.600768:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263316.600825:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263316.601029:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263316.601062:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263316.601101:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263316.602274:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699185792 00000100:00100000:2.0:1788263316.602299:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699185792 00000100:00100000:2.0:1788263316.602376:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 385 00000100:00100000:2.0:1788263316.602387:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2386:x1875129699185792:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263316.602518:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2386:x1875129699185792:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 122us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263316.602528:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 385 00000100:00100000:2.0:1788263316.602698:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699186048 00000100:00100000:2.0:1788263316.602704:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699186048 00000100:00100000:2.0:1788263316.602746:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 128 00000100:00100000:2.0:1788263316.602752:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2386:x1875129699186048:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263316.602781:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2386:x1875129699186048:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 30us (1719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263316.602787:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 128 00000100:00080000:2.0:1788263316.602942:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263316.623462:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699185920 00000100:00100000:1.0:1788263316.623484:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699185920 00000100:00080000:3.0:1788263316.623729:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788263316.623873:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699186176 00000100:00100000:1.0:1788263316.623877:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699186176 00000100:00080000:1.0:1788263316.623898:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263316.623921:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699186304 00000100:00100000:1.0:1788263316.623925:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699186304 00000100:00080000:1.0:1788263316.623936:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788263316.623962:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 297 00000100:00100000:1.0:1788263316.623973:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699185920:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263316.624077:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699185920:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 105us (23323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263316.624106:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 297 00000100:00100000:3.0:1788263316.624382:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 298 00000100:00100000:3.0:1788263316.624395:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699186176:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263316.624428:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699186176:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 38us (23603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263316.624441:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 298 00000100:00100000:3.0:1788263316.624468:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 299 00000100:00100000:3.0:1788263316.624475:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699186304:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263316.624502:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699186304:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 28us (23401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263316.624509:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 299 00000100:00100000:2.0:1788263316.636969:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263316.637067:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699186432 00000100:00100000:3.0:1788263316.637080:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699186432 00000100:00100000:3.0:1788263316.637161:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 77 00000100:00100000:3.0:1788263316.637182:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+27:11258:x1875129699186432:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788263316.637430:0:8884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263316.637467:0:8884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f92f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fe94 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.637698:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f936 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.637715:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f936 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.637728:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f936 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.637743:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f93d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.637750:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f93d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.637781:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f93d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.637882:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666f944 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.637893:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666f944 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.637900:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666f944 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263316.637955:0:8884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788263316.637960:0:8884:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788263316.637983:0:8884:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666f944 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.637996:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666f944 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.638004:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f936 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.638010:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f936 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.638017:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f936 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.638023:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eeca00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263316.638028:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f936 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.638043:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f936 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.638058:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:3.0:1788263316.638061:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263316.638068:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f936 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.638074:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f936 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.638089:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f93d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.638095:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f93d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.638101:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f93d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.638106:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eec600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263316.638109:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f93d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.638116:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f93d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.638320:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ff282126800) 00010000:00010000:3.0:1788263316.638325:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263316.638329:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f93d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.638346:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f93d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.638389:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f92f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe94 expref: 29 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.638425:0:8884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666f944 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe94 expref: 28 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263316.638432:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:3.0:1788263316.638435:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788263316.638438:0:8884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eedc00, rc 0) 00000100:00100000:3.0:1788263316.638914:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+28:11258:x1875129699186432:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1738us (1957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263316.638925:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 77 00000040:00080000:2.0:1788263317.001851:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788263317.001860:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788263317.001905:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788263317.001914:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788263317.002342:0:13769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283326d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13769:1875129709761408:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788263317.002469:0:13769:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3f9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788263317.007076:0:13769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283326d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13769:1875129709761408:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788263317.007361:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263317.007472:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699186560 00000100:00100000:0.0:1788263317.007482:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699186560 00000100:00100000:0.0:1788263317.007619:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 78 00000100:00100000:0.0:1788263317.007633:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+28:11269:x1875129699186560:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788263317.007674:0:6491:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788263317.007800:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+28:11269:x1875129699186560:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 170us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263317.007808:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 78 00000100:00080000:1.0:1788263317.007873:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263317.010856:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263317.011255:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699186688 00000100:00100000:0.0:1788263317.011297:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699186688 00000100:00100000:0.0:1788263317.011381:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 79 00000100:00100000:0.0:1788263317.011393:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+28:11269:x1875129699186688:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788263317.011492:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666f94b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.011513:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666f94b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.011529:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666f94b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.021297:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f952 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.021324:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f952 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.021339:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f952 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.021378:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f959 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.021388:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f959 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.022113:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f959 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263317.022171:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788263317.022175:0:10388:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788263317.022190:0:10388:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f959 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.022202:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666f94b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.022209:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666f94b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.022215:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666f94b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.022241:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e8800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263317.022245:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666f94b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.022252:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666f94b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.022266:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ff28314fa00) 00010000:00010000:0.0:1788263317.022269:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263317.022273:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666f94b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.022278:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666f94b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.022305:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f952 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.022311:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f952 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.022316:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f952 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.022320:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17e600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263317.022322:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f952 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.022327:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f952 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.022344:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9ff282279000) 00010000:00010000:0.0:1788263317.022346:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263317.022349:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f952 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.022354:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666f952 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.022367:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f959 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.022373:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f959 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.022379:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f959 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.022383:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17e200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263317.022385:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f959 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.022390:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f959 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.022407:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:0.0:1788263317.022410:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263317.022412:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f959 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.022417:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f959 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263317.022539:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+28:11269:x1875129699186688:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 Request processed in 11143us (11690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263317.022548:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 79 00000100:00100000:2.0:1788263317.056065:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263317.056203:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699186944 00000100:00100000:1.0:1788263317.056217:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699186944 00000100:00100000:1.0:1788263317.056330:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 80 00000100:00100000:1.0:1788263317.056345:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+28:11269:x1875129699186944:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788263317.056375:0:8884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263317.056418:0:8884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666f960 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fe9b expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.056595:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666f967 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.056615:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666f967 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.056629:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666f967 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263317.056644:0:8884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788263317.056748:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666f967 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.056756:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666f967 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.056763:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666f967 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.056787:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381680c00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263317.056792:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666f967 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.056801:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666f967 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.056817:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:1.0:1788263317.056820:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788263317.056825:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666f967 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.056842:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666f967 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.056898:0:8884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666f960 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe9b expref: 30 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.056909:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ff28314fa00) 00010000:00010000:1.0:1788263317.056911:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788263317.056915:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666f960 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe9b expref: 30 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.056926:0:8884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381681800, rc 0) 00000100:00100000:1.0:1788263317.057003:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:11269:x1875129699186944:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 662us (952us total) trans 4294967353 rc 301/301 00000100:00100000:1.0:1788263317.057011:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 80 00000100:00100000:0.0:1788263317.064232:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263317.064328:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699187072 00000100:00100000:1.0:1788263317.064351:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699187072 00000100:00100000:1.0:1788263317.064432:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 81 00000100:00100000:1.0:1788263317.064445:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:11269:x1875129699187072:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788263317.064495:0:6492:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788263317.064681:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:11269:x1875129699187072:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 238us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263317.064690:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 81 00000100:00100000:1.0:1788263317.072263:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263317.075302:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699187328 00000100:00100000:0.0:1788263317.075324:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699187328 00000100:00100000:0.0:1788263317.075425:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 82 00000100:00100000:0.0:1788263317.075438:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:11269:x1875129699187328:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788263317.075465:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263317.075469:0:10388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788263317.075505:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666f921 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe8d expref: 29 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.075530:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:0.0:1788263317.075535:0:10388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788263317.075552:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f975 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fea2 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788263317.079632:0:10388:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788263317.080669:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f97c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.080695:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f97c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.080710:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f97c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.080821:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666f975 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fea2 expref: 31 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.082495:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f97c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fea2 expref: 30 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.082511:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ff282279000) 00010000:00010000:0.0:1788263317.082514:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263317.082519:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17f600, rc 0) 00000100:00100000:0.0:1788263317.082636:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+30:11269:x1875129699187328:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 7199us (10386us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788263317.082658:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 82 00000100:00100000:0.0:1788263317.088159:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263317.088259:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699187584 00000100:00100000:3.0:1788263317.088273:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699187584 00000100:00100000:3.0:1788263317.088357:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 83 00000100:00100000:3.0:1788263317.088369:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+30:11269:x1875129699187584:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788263317.088459:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263317.088507:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666f97c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fea2 expref: 30 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.088531:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ff282279000) 00010000:00010000:3.0:1788263317.088542:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263317.088571:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f98a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.088626:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f98a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.088636:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f98a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.090180:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f991 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xc6a29745 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.090205:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f991 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc6a29745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.090293:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f991 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc6a29745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.090408:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f98a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.090417:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f98a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.090425:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f98a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.090430:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eed600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263317.090445:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f98a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.090453:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f98a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.090467:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:3.0:1788263317.090673:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263317.090678:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f98a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.090686:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f98a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.090702:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f991 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc6a29745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.090708:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f991 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc6a29745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.090714:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f991 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc6a29745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.090720:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eec600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263317.090724:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f991 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc6a29745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.090732:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f991 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc6a29745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.090740:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xc6a29745 (ffff9ff282126800) 00010000:00010000:3.0:1788263317.090743:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263317.090746:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f991 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xc6a29745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.090751:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f991 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xc6a29745 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263317.090858:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:11269:x1875129699187584:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 2487us (2711us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788263317.090875:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 83 00000100:00100000:0.0:1788263317.094895:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263317.095063:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699187712 00000100:00100000:1.0:1788263317.095076:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699187712 00000100:00100000:1.0:1788263317.095166:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 84 00000100:00100000:1.0:1788263317.095178:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:11269:x1875129699187712:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788263317.095204:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263317.095236:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666f998 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fea9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.095297:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666f99f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.095314:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666f99f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.095331:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666f99f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.095645:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666f998 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fea9 expref: 31 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.095668:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666f99f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fea9 expref: 30 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.095686:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ff3986d8a00) 00010000:00010000:1.0:1788263317.095689:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788263317.095692:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381681a00, rc 0) 00000100:00100000:1.0:1788263317.095771:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+30:11269:x1875129699187712:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 596us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263317.095779:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 84 00000100:00100000:1.0:1788263317.099516:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263317.110786:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699187968 00000100:00100000:0.0:1788263317.110807:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699187968 00000100:00100000:1.0:1788263317.113094:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 85 00000100:00100000:1.0:1788263317.113114:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+30:11269:x1875129699187968:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788263317.113267:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666f9a6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.113295:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666f9a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.113309:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666f9a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788263317.116053:0:10388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1788263317.116074:0:10388:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 326187494233ns, next at 327187490160ns, rc = 0 00000004:00010000:1.0:1788263317.116746:0:10388:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9ad6ebe reply state 000000006b1e1527 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666f9a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.117214:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666f9a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.117226:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ff3986d8a00) 00010000:00010000:1.0:1788263317.117235:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788263317.117240:0:10388:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788263317.120373:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+32:11269:x1875129699187968:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 7246us (20854us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788263317.120389:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 85 00000100:00100000:3.0:1788263317.137940:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263317.138157:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699188096 00000100:00100000:2.0:1788263317.138167:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699188096 00000100:00100000:2.0:1788263317.138221:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 86 00000100:00100000:2.0:1788263317.138232:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+32:11269:x1875129699188096:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788263317.138337:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263317.138423:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f9ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116feb0 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.138493:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f9ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116feb0 expref: 33 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.138509:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f9ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116feb0 expref: 33 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.138526:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ff3986d8a00) 00010000:00010000:2.0:1788263317.138530:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263317.138534:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d0e00, rc 0) 00000100:00100000:2.0:1788263317.138830:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+33:11269:x1875129699188096:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 598us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263317.138837:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 86 00000100:00100000:1.0:1788263317.152348:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263317.152512:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699188224 00000100:00100000:2.0:1788263317.152523:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699188224 00000100:00100000:2.0:1788263317.152570:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:2.0:1788263317.152597:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2385:x1875129699188224:12345-192.168.203.26@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788263317.152632:0:8405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp t0 exp 0000000000000000 cur 326 last 0 00000020:00000080:2.0:1788263317.152661:0:8405:0:(genops.c:1385:class_connect()) connect: client ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea, cookie 0x4b1103cba666f9b4 00002000:00100000:2.0:1788263317.152672:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea/ffff9ff28389e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788263317.152689:0:8405:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788263317.152771:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788263317.152798:0:8405:0:(import.c:65:import_set_state_nolock()) ffff9ff283899800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263317.153215:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2385:x1875129699188224:12345-192.168.203.26@tcp:8:lhsmtool_posix.0 Request processed in 634us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263317.153241:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:1.0:1788263317.157275:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263317.157775:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699188352 00000100:00100000:0.0:1788263317.157786:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699188352 00000100:00100000:0.0:1788263317.157850:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:0.0:1788263317.157861:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:0:x1875129699188352:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788263317.159326:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788263317.160572:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:1.0:1788263317.160603:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea 00000100:00100000:0.0:1788263317.160800:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:0:x1875129699188352:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 2937us (3530us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788263317.160811:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:0.0:1788263317.163821:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263317.163898:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699188608 00000100:00100000:3.0:1788263317.163907:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699188608 00000100:00100000:3.0:1788263317.163964:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:3.0:1788263317.163974:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+33:11269:x1875129699188608:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788263317.164176:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+34:11269:x1875129699188608:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 203us (364us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1788263317.164183:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 19 00010000:00010000:1.0:1788263317.168692:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263317.172493:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263317.172554:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699188864 00000100:00100000:2.0:1788263317.172564:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699188864 00000100:00100000:2.0:1788263317.172642:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 87 00000100:00100000:2.0:1788263317.172655:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+34:11269:x1875129699188864:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788263317.172766:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+34:11269:x1875129699188864:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 113us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263317.172774:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 87 00000100:00100000:1.0:1788263317.179094:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263317.179226:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699188992 00000100:00100000:3.0:1788263317.179236:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699188992 00000100:00100000:3.0:1788263317.179311:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 88 00000100:00100000:3.0:1788263317.179321:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+34:11269:x1875129699188992:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788263317.179340:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263317.179360:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f9bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116feb7 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.179424:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f9c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.179438:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.179448:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263317.179506:0:10388:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788263317.179525:0:10388:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.179562:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666f9bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116feb7 expref: 36 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.179604:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f9c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116feb7 expref: 35 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.179613:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ff3986d8a00) 00010000:00010000:3.0:1788263317.179615:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788263317.179619:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eed600, rc 0) 00000100:00100000:3.0:1788263317.179675:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+35:11269:x1875129699188992:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 356us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263317.179681:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 88 00000100:00100000:0.0:1788263317.189573:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263317.189717:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699189120 00000100:00100000:3.0:1788263317.189726:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699189120 00000100:00100000:3.0:1788263317.189780:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00100000:3.0:1788263317.189790:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699189120:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788263317.189809:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263317.189832:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086a7ad1e/0x4b1103cba666f9c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116febe expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788263317.189857:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96bb94, blocks: 0x0 00010000:00010000:3.0:1788263317.189876:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=326s v=(0 0) 00010000:00010000:3.0:1788263317.189890:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263317.189899:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086a7ad1e/0x4b1103cba666f9c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116febe expref: 6 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.189921:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000086a7ad1e/0x4b1103cba666f9c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116febe expref: 6 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.189935:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eeca00, rc 0) 00000100:00100000:3.0:1788263317.189991:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2386:x1875129699189120:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 203us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263317.189998:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00100000:0.0:1788263317.193001:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263317.193077:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699189376 00000100:00100000:3.0:1788263317.193086:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699189376 00000100:00100000:3.0:1788263317.193148:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 89 00000100:00100000:3.0:1788263317.193158:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+35:11269:x1875129699189376:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788263317.193247:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+35:11269:x1875129699189376:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 91us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263317.193256:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 89 00000100:00100000:2.0:1788263317.200909:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263317.201069:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699189504 00000100:00100000:0.0:1788263317.201079:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699189504 00000100:00100000:0.0:1788263317.201144:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 36 00000100:00100000:0.0:1788263317.201154:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:11269:x1875129699189504:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788263317.201171:0:9885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263317.201190:0:9885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028126ae4/0x4b1103cba666f9d0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fec5 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.201221:0:9885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000086a7ad1e/0x4b1103cba666f9c9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116febe expref: 7 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.201230:0:9885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263317.201235:0:9885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263317.201239:0:9885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028126ae4/0x4b1103cba666f9d0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fec5 expref: 7 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.201271:0:9885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000086a7ad1e/0x4b1103cba666f9c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116febe expref: 7 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.201295:0:9885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000086a7ad1e/0x4b1103cba666f9c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116febe expref: 7 pid: 8405 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263317.201309:0:9885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf77f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9885:1875129709761536:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788263317.201398:0:9885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff382a64a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263317.207776:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263317.207850:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699189632 00000100:00100000:1.0:1788263317.207858:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699189632 00010000:00010000:1.0:1788263317.207897:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000086a7ad1e/0x4b1103cba666f9c9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116febe expref: 8 pid: 8405 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263317.207937:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:1.0:1788263317.207945:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2386:x1875129699189632:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263317.207959:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263317.207981:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000086a7ad1e/0x4b1103cba666f9c9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116febe expref: 8 pid: 8405 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.207995:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000086a7ad1e/0x4b1103cba666f9c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116febe expref: 8 pid: 8405 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.208027:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263317.208044:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263317.208052:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028126ae4/0x4b1103cba666f9d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fec5 expref: 8 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.208063:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028126ae4/0x4b1103cba666f9d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fec5 expref: 8 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.208098:0:6478:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000028126ae4/0x4b1103cba666f9d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fec5 expref: 8 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263317.208111:0:6478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398663480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6478:1875129709761664:192.168.203.26@tcp:105: 00000100:00100000:1.0:1788263317.208182:0:6478:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28213f900 going to sleep for 11 seconds 00010000:00010000:3.0:1788263317.208775:0:9885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086a7ad1e/0x4b1103cba666f9c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116febe expref: 8 pid: 8405 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263317.208791:0:9885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf77f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9885:1875129709761536:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263317.208816:0:9885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028126ae4/0x4b1103cba666f9d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fec5 expref: 7 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.208842:0:9885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17e200, rc 0) 00000100:00100000:3.0:1788263317.208885:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:11269:x1875129699189504:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 7732us (7984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263317.208893:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 36 00000100:00100000:0.0:1788263317.213791:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263317.213881:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699189760 00000100:00100000:3.0:1788263317.213890:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699189760 00002000:00100000:3.0:1788263317.213930:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9ff3bf77ca80 x1875129699189760/t0(0) o4->ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp:528/0 lens 504/0 e 0 to 0 dl 1788263328 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788263317.213942:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ff3bf77ca80 with x1875129699189760 ext(0->8) 00002000:00010000:3.0:1788263317.213947:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ff3bf77ca80 00000100:00100000:3.0:1788263317.213984:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:3.0:1788263317.213994:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2387:x1875129699189760:12345-192.168.203.26@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788263317.214647:0:6478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398663480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6478:1875129709761664:192.168.203.26@tcp:105: 00010000:00010000:1.0:1788263317.214670:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263317.214720:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:2386:x1875129699189632:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 6775us (6952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263317.214729:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:1.0:1788263317.217016:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2387:x1875129699189760:12345-192.168.203.26@tcp:4:lhsmtool_posix.0 Request processed in 3016us (3226us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788263317.217031:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 0 00002000:00100000:1.0:1788263317.217042:0:8411:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9ff3bf77ca80 x1875129699189760/t4294967303(0) o4->ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp:528/0 lens 504/448 e 0 to 0 dl 1788263328 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788263317.217053:0:8411:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ff3bf77ca80 with x1875129699189760 ext(0->8) 00002000:00010000:1.0:1788263317.217059:0:8411:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ff3bf77ca80 00000100:00100000:3.0:1788263317.221372:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263317.221444:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699189888 00000100:00100000:2.0:1788263317.221458:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699189888 00000100:00100000:2.0:1788263317.221514:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 90 00000100:00100000:2.0:1788263317.221535:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+35:11269:x1875129699189888:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788263317.224213:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1788263317.224227:0:6470:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788263317.224271:0:6470:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1788263317.224299:0:6523:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1788263317.224309:0:6523:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788263317.224421:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+17:11269:x1875129699189888:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 Request processed in 2894us (3051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263317.224431:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 90 00000100:00100000:0.0:1788263317.224677:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788263317.224692:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf77ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709761792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788263317.224738:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263317.224779:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709761792 00000100:00100000:0.0:1788263317.224785:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709761792 00000100:00100000:0.0:1788263317.224830:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788263317.224838:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709761792:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788263317.224944:0:8405:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788263317.224947:0:8405:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788263316 00002000:00010000:0.0:1788263317.224950:0:8405:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788263317.224952:0:8405:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788263316 -> 1788263316 00002000:00010000:0.0:1788263317.224955:0:8405:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788263317.224988:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1875129709761792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 150us (248us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788263317.224995:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788263317.225011:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788263317.225039:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ff3bf77ed80/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788263317.225045:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf77ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709761792:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1788263317.225209:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f85d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.225221:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f85d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.225229:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f85d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.225234:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263317.225240:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f85d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.225262:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f85d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.225278:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:3.0:1788263317.225281:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263317.225295:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f85d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.225301:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666f85d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.225316:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681e00/0x4b1103cba666f8a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.225322:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681e00/0x4b1103cba666f8a3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.225328:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681e00/0x4b1103cba666f8a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.225333:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381681e00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263317.225336:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681e00/0x4b1103cba666f8a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.225342:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681e00/0x4b1103cba666f8a3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.225350:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:3.0:1788263317.225353:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263317.225356:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681e00/0x4b1103cba666f8a3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.225372:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681e00/0x4b1103cba666f8a3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.225386:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666f9a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.225392:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666f9a6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.225399:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666f9a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.225404:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381680a00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263317.225408:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666f9a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.225414:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666f9a6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.225422:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ff3986d8a00) 00010000:00010000:3.0:1788263317.225424:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788263317.225427:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666f9a6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.225432:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666f9a6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263317.233744:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263317.246734:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699190016 00000100:00100000:1.0:1788263317.246762:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699190016 00000100:00100000:1.0:1788263317.246824:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 38 00000100:00100000:1.0:1788263317.246834:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2388:x1875129699190016:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788263317.249399:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1788263317.249411:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:2.0:1788263317.249785:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2388:x1875129699190016:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 Request processed in 2948us (16042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263317.249796:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 38 00000100:00100000:1.0:1788263317.262430:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263317.267871:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699190272 00000100:00100000:3.0:1788263317.267884:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699190272 00000100:00100000:3.0:1788263317.267992:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 91 00000100:00100000:3.0:1788263317.268003:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+14:11269:x1875129699190272:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788263317.268060:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263317.268087:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f9c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116feb7 expref: 14 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.268102:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ff3986d8a00) 00010000:00010000:3.0:1788263317.268107:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263317.268146:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f9d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.268166:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f9d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.268176:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f9d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788263317.268299:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aac91e40 reply state 0000000059493794 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f9d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.268310:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f9d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.268316:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ff3986d8a00) 00010000:00010000:3.0:1788263317.268319:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788263317.268321:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788263317.268425:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+15:11269:x1875129699190272:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 424us (6003us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1788263317.268433:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 91 00000100:00100000:1.0:1788263317.275459:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263317.275665:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699190400 00000100:00100000:3.0:1788263317.275675:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699190400 00000100:00100000:3.0:1788263317.275721:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 39 00000100:00100000:3.0:1788263317.275739:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283819f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2389:x1875129699190400:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788263317.275880:0:8405:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788263317.275883:0:8405:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788263316 -> 1788263315 00002000:00010000:3.0:1788263317.275886:0:8405:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788263313 00002000:00010000:3.0:1788263317.275889:0:8405:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788263316 -> 1788263315 00002000:00010000:3.0:1788263317.275891:0:8405:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788263317.275947:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283819f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2389:x1875129699190400:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 209us (495us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788263317.275955:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 39 00000100:00100000:1.0:1788263317.278804:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263317.286102:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699190656 00000100:00100000:3.0:1788263317.286125:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699190656 00000100:00100000:3.0:1788263317.286198:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 92 00000100:00100000:3.0:1788263317.286209:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+15:11269:x1875129699190656:12345-192.168.203.26@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788263317.286276:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f9de lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.287662:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666f99f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fea9 expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.287673:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f9de lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.287730:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666f99f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fea9 expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.287746:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666f99f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fea9 expref: 15 pid: 6493 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263317.287771:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6492:1875129709761920:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788263317.288653:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a27c96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263317.301858:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263317.301901:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6492:1875129709761920:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263317.301924:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f9de lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263317.311007:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699190784 00000100:00100000:1.0:1788263317.311022:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699190784 00010000:00010000:1.0:1788263317.311064:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666f99f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fea9 expref: 16 pid: 6493 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263317.311112:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:1.0:1788263317.311131:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+16:2387:x1875129699190784:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263317.311155:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263317.311161:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666f99f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fea9 expref: 16 pid: 6493 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.311174:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666f99f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fea9 expref: 16 pid: 6493 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.311194:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666f99f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fea9 expref: 16 pid: 6493 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.311208:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ff3986d8a00) 00010000:00010000:1.0:1788263317.311213:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f9de lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.311236:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f9de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.311244:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f9de lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.311273:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263317.311316:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f9de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.311324:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f9de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263317.311336:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+15:2387:x1875129699190784:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 217us (9486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263317.311343:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 60 00010000:00010000:3.0:1788263317.311357:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f9de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.311364:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f9de lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.311370:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f9de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.311375:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eed200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263317.311379:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f9de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.311385:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f9de lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.311404:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ff3986d8a00) 00010000:00010000:3.0:1788263317.311406:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788263317.311410:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f9de lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.311415:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666f9de lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263317.311453:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+14:11269:x1875129699190656:12345-192.168.203.26@tcp:55:lhsmtool_posix.0 Request processed in 25246us (32657us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788263317.311461:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 92 00000100:00100000:2.0:1788263317.339242:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263317.339324:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699190912 00000100:00100000:0.0:1788263317.339334:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699190912 00000100:00100000:0.0:1788263317.339387:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 40 00000100:00100000:0.0:1788263317.339399:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2386:x1875129699190912:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788263317.339452:0:9885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000ff35f5a/0x4b1103cba666f9e5 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.339473:0:9885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028126ae4/0x4b1103cba666f9d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fec5 expref: 7 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.339491:0:9885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263317.339496:0:9885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788263317.339501:0:9885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ff35f5a/0x4b1103cba666f9e5 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.339549:0:9885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028126ae4/0x4b1103cba666f9d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fec5 expref: 7 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.339564:0:9885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028126ae4/0x4b1103cba666f9d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fec5 expref: 7 pid: 9885 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263317.339595:0:9885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf77ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9885:1875129709762048:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788263317.339667:0:9885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff382a64840 going to sleep for 11 seconds 00000100:00100000:0.0:1788263317.343491:0:9885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf77ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9885:1875129709762048:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788263317.343518:0:9885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000ff35f5a/0x4b1103cba666f9e5 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263317.346436:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263317.346833:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699191040 00000100:00100000:0.0:1788263317.346843:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699191040 00010000:00010000:0.0:1788263317.346881:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028126ae4/0x4b1103cba666f9d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fec5 expref: 8 pid: 9885 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263317.346920:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:0.0:1788263317.346930:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2386:x1875129699191040:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263317.346952:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263317.346974:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028126ae4/0x4b1103cba666f9d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fec5 expref: 8 pid: 9885 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.346988:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028126ae4/0x4b1103cba666f9d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fec5 expref: 8 pid: 9885 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.347013:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028126ae4/0x4b1103cba666f9d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fec5 expref: 8 pid: 9885 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.347027:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788263317.347032:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788263317.347038:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000ff35f5a/0x4b1103cba666f9e5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.347049:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ff35f5a/0x4b1103cba666f9e5 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.347086:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263317.347137:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2386:x1875129699191040:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 209us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263317.347156:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 61 00010000:00010000:3.0:1788263317.348675:0:9885:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000ff35f5a/0x4b1103cba666f9e5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.348690:0:9885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ff35f5a/0x4b1103cba666f9e5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.348726:0:9885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000ff35f5a/0x4b1103cba666f9e5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.348735:0:9885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ff35f5a/0x4b1103cba666f9e5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.348742:0:9885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ff35f5a/0x4b1103cba666f9e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.348749:0:9885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17ea00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263317.348766:0:9885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ff35f5a/0x4b1103cba666f9e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.348775:0:9885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ff35f5a/0x4b1103cba666f9e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.348790:0:9885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ff35f5a/0x4b1103cba666f9e5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.348797:0:9885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ff35f5a/0x4b1103cba666f9e5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263317.348862:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2386:x1875129699190912:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 Request processed in 9464us (9627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263317.348871:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 40 00000100:00100000:3.0:1788263317.354392:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263317.354471:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699191296 00000100:00100000:2.0:1788263317.354480:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699191296 00000100:00100000:2.0:1788263317.354626:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 93 00000100:00100000:2.0:1788263317.354652:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+14:11269:x1875129699191296:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788263317.354768:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f9ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.354785:0:8884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f82c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe4e expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.354796:0:8884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f9ec lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.354845:0:8884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f82c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe4e expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.354860:0:8884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f82c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe4e expref: 14 pid: 6491 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263317.354876:0:8884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8884:1875129709762176:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788263317.354972:0:8884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff283a5ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1788263317.365004:0:8884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8884:1875129709762176:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788263317.365033:0:8884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f9ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263317.367237:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263317.367986:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699191424 00000100:00100000:2.0:1788263317.367995:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699191424 00010000:00010000:2.0:1788263317.368043:0:9493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f82c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe4e expref: 15 pid: 6491 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263317.368138:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 62 00000100:00100000:2.0:1788263317.368319:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0455850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+15:2387:x1875129699191424:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263317.368335:0:9493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263317.368342:0:9493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f82c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe4e expref: 15 pid: 6491 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.368355:0:9493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f82c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe4e expref: 15 pid: 6491 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.368376:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666f82c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe4e expref: 15 pid: 6491 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.368389:0:9493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:2.0:1788263317.368394:0:9493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f9ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.368404:0:9493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f9ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.368411:0:9493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f9ec lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.368451:0:9493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263317.368503:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0455850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+14:2387:x1875129699191424:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 357us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263317.368510:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 62 00010000:00010000:0.0:1788263317.368776:0:8884:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f9ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.368785:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f9ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.368995:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f9f3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.369008:0:8884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f9ad lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116feb0 expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.369015:0:8884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f9f3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.369043:0:8884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f9ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116feb0 expref: 14 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.369055:0:8884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f9ad lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116feb0 expref: 14 pid: 6491 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263317.369069:0:8884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf77ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8884:1875129709762304:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788263317.369115:0:8884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a275e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263317.374674:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263317.374698:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699191552 00000100:00100000:0.0:1788263317.374704:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699191552 00010000:00010000:0.0:1788263317.374739:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f9ad lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116feb0 expref: 15 pid: 6491 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263317.374764:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 63 00000100:00100000:0.0:1788263317.374778:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+15:2386:x1875129699191552:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263317.374792:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263317.374798:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f9ad lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116feb0 expref: 15 pid: 6491 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.374821:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f9ad lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116feb0 expref: 15 pid: 6491 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.374842:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ff3986d8a00) 00010000:00010000:0.0:1788263317.374846:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f9f3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.374856:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f9f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.374863:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f9f3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.374880:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263317.374923:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+15:2386:x1875129699191552:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 146us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263317.374931:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 63 00010000:00010000:3.0:1788263317.378029:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666f9ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116feb0 expref: 14 pid: 6491 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263317.378052:0:8884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf77ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8884:1875129709762304:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263317.378075:0:8884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f9f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.378085:0:8884:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f9f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.378091:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f9f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788263317.378221:0:8884:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1788263317.378340:0:8884:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1788263317.378375:0:8884:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1788263317.378462:0:8884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8884:1875129709762432:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788263317.378517:0:8884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263317.378561:0:8884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a275e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263317.378706:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709762432 00000100:00100000:2.0:1788263317.378713:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709762432 00000100:00100000:2.0:1788263317.378762:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788263317.378772:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8884:x1875129709762432:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788263317.378853:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8884:x1875129709762432:12345-0@lo:1000:mdt00_003.0 Request processed in 83us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263317.378860:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788263317.379013:0:8884:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788263317.379018:0:8884:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ff3bf77ed80, transno 4294967304 00000100:00100000:3.0:1788263317.379036:0:8884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8884:1875129709762432:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788263317.379147:0:8884:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1788263317.379185:0:8884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8884:1875129709762560:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788263317.379212:0:8884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263317.379233:0:8884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff382a64900 going to sleep for 11 seconds 00000100:00100000:1.0:1788263317.379389:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709762560 00000100:00100000:1.0:1788263317.379393:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709762560 00000100:00100000:1.0:1788263317.379425:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788263317.379433:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8884:x1875129709762560:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788263317.380912:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8884:x1875129709762560:12345-0@lo:1000:mdt00_003.0 Request processed in 1476us (1695us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788263317.380914:0:8884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8884:1875129709762560:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788263317.380920:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00010000:00010000:3.0:1788263317.380949:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f9f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.380959:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f9f3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.380966:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f9f3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.380973:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17e200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263317.380976:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f9f3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.380984:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f9f3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.381009:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ff3986d8a00) 00010000:00010000:3.0:1788263317.381012:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788263317.381018:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f9f3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.381025:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666f9f3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.384509:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba666f928 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.384686:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba666f928 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.384695:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba666f928 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.384702:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eec200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263317.384707:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba666f928 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.384714:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba666f928 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.384731:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:3.0:1788263317.384734:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788263317.384739:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba666f928 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.384745:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba666f928 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.384780:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f9fa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.384796:0:8884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666f944 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe94 expref: 17 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.384805:0:8884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f9fa lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.384842:0:8884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666f944 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe94 expref: 17 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263317.384857:0:8884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666f944 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe94 expref: 17 pid: 8884 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263317.384872:0:8884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8884:1875129709762688:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788263317.384960:0:8884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39aad6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788263317.388314:0:8884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8884:1875129709762688:192.168.203.26@tcp:104: 00010000:00010000:1.0:1788263317.388341:0:8884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f9fa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263317.390351:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263317.390571:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699191680 00000100:00100000:2.0:1788263317.390915:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699191680 00010000:00010000:2.0:1788263317.390956:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666f944 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe94 expref: 18 pid: 8884 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263317.390996:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:2.0:1788263317.391006:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+18:2387:x1875129699191680:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263317.391019:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263317.391026:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666f944 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe94 expref: 18 pid: 8884 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.391038:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666f944 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe94 expref: 18 pid: 8884 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.391057:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666f944 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fe94 expref: 18 pid: 8884 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.391069:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:2.0:1788263317.391074:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f9fa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.391093:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f9fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.391100:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f9fa lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.391120:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263317.391166:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+17:2387:x1875129699191680:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 161us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263317.391174:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 64 00010000:00010000:1.0:1788263317.391516:0:8884:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f9fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.391524:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f9fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.391537:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f9fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.391550:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f9fa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.391556:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f9fa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.391562:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eed600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263317.391567:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f9fa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.391575:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f9fa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.391610:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:1.0:1788263317.391613:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263317.391617:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f9fa lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.391623:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666f9fa lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.391633:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f9ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.391639:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f9ec lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.391645:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f9ec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.391650:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1e00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263317.391658:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f9ec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.391664:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f9ec lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.391672:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff282128d00) 00010000:00010000:1.0:1788263317.391675:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788263317.391677:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f9ec lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.391683:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666f9ec lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263317.391807:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+16:11269:x1875129699191296:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 37172us (37423us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788263317.391826:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 93 00000020:00080000:1.0:1788263317.391830:0:8884:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788263317.391914:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788263317.391918:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788263317.391934:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788263317.391941:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788263317.398935:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263317.399005:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699191936 00000100:00100000:0.0:1788263317.399015:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699191936 00000100:00100000:0.0:1788263317.399064:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:0.0:1788263317.399073:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+16:11269:x1875129699191936:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788263317.399327:0:6494:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788263317.399356:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1788263317.399385:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fa01 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.399400:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fa01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.399422:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fa01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.399431:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fa01 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.399438:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fa01 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.399444:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fa01 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.399466:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788263317.399549:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+18:11269:x1875129699191936:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 476us (622us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788263317.399556:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 20 00000020:00080000:0.0:1788263317.399561:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788263317.399636:0:9492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263317.399643:0:9492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fa01 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.399649:0:9492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17f800 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:1.0:1788263317.399653:0:9492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fa01 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.399660:0:9492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fa01 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.399680:0:9492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ff3986d8a00) 00010000:00010000:1.0:1788263317.399682:0:9492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788263317.399687:0:9492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fa01 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.399693:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fa01 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.399704:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263317.399706:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263317.399717:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263317.551773:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788263317.551793:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709762816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788263317.551887:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263317.552092:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709762816 00000100:00100000:1.0:1788263317.552101:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709762816 00000100:00100000:1.0:1788263317.552162:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788263317.552172:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709762816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788263317.552202:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788263317.552247:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709762816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263317.552255:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788263317.552510:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709762816:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788263317.552687:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788263317.552697:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf77ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709762944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788263317.552728:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263317.552763:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709762944 00000100:00100000:0.0:1788263317.552767:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709762944 00000100:00100000:0.0:1788263317.552794:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788263317.552801:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709762944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788263317.552819:0:13780:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788263317.552854:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709762944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263317.552860:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788263317.552898:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf77ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709762944:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788263317.625233:0:14180:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788263317.625241:0:14180:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788263317.625265:0:14180:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788263317.625272:0:14180:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788263317.846753:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263317.846830:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699192192 00000100:00100000:0.0:1788263317.846839:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699192192 00000100:00100000:0.0:1788263317.846896:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 94 00000100:00100000:0.0:1788263317.846907:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+18:11279:x1875129699192192:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788263317.846931:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263317.846952:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fa08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fecc expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.847055:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ea00/0x4b1103cba666fa0f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.847069:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ea00/0x4b1103cba666fa0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.847080:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ea00/0x4b1103cba666fa0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263317.847090:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788263317.847181:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fa08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fecc expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.847198:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ea00/0x4b1103cba666fa0f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fecc expref: 20 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263317.847220:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:0.0:1788263317.847224:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788263317.847227:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17ea00, rc 0) 00000100:00100000:0.0:1788263317.847298:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+20:11279:x1875129699192192:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 393us (725us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788263317.847305:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 94 00000100:00100000:2.0:1788263317.856467:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263317.856514:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699192320 00000100:00100000:2.0:1788263317.856523:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699192320 00000100:00100000:2.0:1788263317.856696:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 95 00000100:00100000:2.0:1788263317.856705:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+20:11279:x1875129699192320:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:2.0:1788263317.856776:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fa1d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.856791:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fa1d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.856802:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fa1d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.856828:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fa24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.856836:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fa24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.856843:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fa24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.856921:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fa2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.856930:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fa2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.856937:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fa2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788263317.856980:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fa2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.856991:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fa1d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.856998:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fa1d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.857005:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fa1d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.857011:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263317.857016:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fa1d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.857030:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fa1d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.857041:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:2.0:1788263317.857044:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263317.857049:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fa1d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.857055:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fa1d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.857065:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fa24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.857071:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fa24 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.857077:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fa24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.857082:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1000 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263317.857084:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fa24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.857090:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fa24 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.857096:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ff28227ac00) 00010000:00010000:2.0:1788263317.857098:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263317.857101:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fa24 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.857114:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fa24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.857129:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fa2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.857135:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fa2b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.857141:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fa2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.857146:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1a00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263317.857149:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fa2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.857155:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fa2b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.857162:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff28227ab00) 00010000:00010000:2.0:1788263317.857165:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263317.857167:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fa2b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.857173:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fa2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263317.857239:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+20:11279:x1875129699192320:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 534us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263317.857247:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 95 00000100:00100000:0.0:1788263317.934070:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263317.941253:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699192576 00000100:00100000:1.0:1788263317.941274:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699192576 00000100:00100000:1.0:1788263317.942271:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 96 00000100:00100000:1.0:1788263317.942294:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+20:11282:x1875129699192576:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1788263317.942314:0:8884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263317.942336:0:8884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666fa32 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fed3 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.942409:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666fa39 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.942434:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666fa39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.942448:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666fa39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.942464:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681e00/0x4b1103cba666fa40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.942472:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681e00/0x4b1103cba666fa40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.942480:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681e00/0x4b1103cba666fa40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.944416:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666fa47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.944433:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666fa47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.944452:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666fa47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263317.944476:0:8884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788263317.944574:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666fa39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.945684:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666fa39 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.945697:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666fa39 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.945715:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381681800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263317.945719:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666fa39 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.945726:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666fa39 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.945741:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:1.0:1788263317.945744:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263317.945748:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666fa39 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.945754:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666fa39 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.945769:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681e00/0x4b1103cba666fa40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.945776:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681e00/0x4b1103cba666fa40 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.945782:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681e00/0x4b1103cba666fa40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.945787:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381681e00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263317.945789:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681e00/0x4b1103cba666fa40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.945795:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681e00/0x4b1103cba666fa40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.945813:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ff388845700) 00010000:00010000:1.0:1788263317.945815:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263317.945818:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681e00/0x4b1103cba666fa40 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.945824:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681e00/0x4b1103cba666fa40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.945872:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666fa32 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fed3 expref: 23 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.945886:0:8884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666fa47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fed3 expref: 22 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263317.945892:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff388845f00) 00010000:00010000:1.0:1788263317.945894:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788263317.945896:0:8884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381680a00, rc 0) 00000100:00100000:1.0:1788263317.946235:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:11282:x1875129699192576:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 3953us (12172us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788263317.946245:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 96 00000100:00100000:2.0:1788263317.950172:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263317.952124:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699192704 00000100:00100000:2.0:1788263317.952139:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699192704 00000100:00100000:2.0:1788263317.952324:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 97 00000100:00100000:2.0:1788263317.952336:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:11282:x1875129699192704:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:2.0:1788263317.952399:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fa55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.952415:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fa55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.952427:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fa55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.952458:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fa55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.952465:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fa55 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.952472:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fa55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.952478:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1a00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263317.952483:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fa55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.952491:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fa55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.952502:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff388845f00) 00010000:00010000:2.0:1788263317.952505:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788263317.952517:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fa55 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263317.953327:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fa55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263317.953410:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:11282:x1875129699192704:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 1076us (3243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263317.953419:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 97 00000100:00100000:0.0:1788263317.966669:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263317.966743:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699192960 00000100:00100000:3.0:1788263317.966754:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699192960 00000100:00100000:3.0:1788263317.966806:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:3.0:1788263317.966827:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a973c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:11282:x1875129699192960:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1788263317.967012:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a973c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+23:11282:x1875129699192960:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 196us (351us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1788263317.967019:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:0.0:1788263318.037116:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263318.037295:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699193216 00000100:00100000:2.0:1788263318.037304:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699193216 00000100:00100000:2.0:1788263318.037361:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 98 00000100:00100000:2.0:1788263318.037369:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+23:10808:x1875129699193216:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:2.0:1788263318.037392:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263318.037411:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fa5c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116feda expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.037508:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fa63 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.037520:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666fa47 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fed3 expref: 24 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.037528:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fa63 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.037559:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666fa47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fed3 expref: 24 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.037573:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666fa47 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fed3 expref: 24 pid: 8884 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263318.037631:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6491:1875129709763072:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788263318.037701:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff283a5e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263318.045741:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6491:1875129709763072:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263318.045769:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fa63 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263318.052982:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263318.053109:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699193344 00000100:00100000:2.0:1788263318.053119:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699193344 00010000:00010000:2.0:1788263318.053157:0:9493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666fa47 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fed3 expref: 25 pid: 8884 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263318.053215:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:2.0:1788263318.053224:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+25:2386:x1875129699193344:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263318.053238:0:9493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263318.053245:0:9493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666fa47 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fed3 expref: 25 pid: 8884 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.053258:0:9493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666fa47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fed3 expref: 25 pid: 8884 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.053288:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666fa47 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116fed3 expref: 25 pid: 8884 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.053305:0:9493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff388845f00) 00010000:00010000:2.0:1788263318.053310:0:9493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fa63 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.053319:0:9493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fa63 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.053342:0:9493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fa63 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.053372:0:9493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263318.053425:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+24:2386:x1875129699193344:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 202us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263318.053432:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 65 00010000:00010000:3.0:1788263318.053513:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fa63 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.053523:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fa63 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263318.053551:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788263318.053757:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fa5c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116feda expref: 25 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.053775:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fa63 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116feda expref: 24 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.053783:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff388845f00) 00010000:00010000:2.0:1788263318.053786:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788263318.053789:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d1400, rc 0) 00000100:00100000:2.0:1788263318.053831:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+24:10808:x1875129699193216:12345-192.168.203.26@tcp:101:bash.0 Request processed in 16463us (16724us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1788263318.053839:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 98 00000100:00100000:0.0:1788263318.067362:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263318.067455:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699193472 00000100:00100000:1.0:1788263318.067465:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699193472 00000100:00100000:1.0:1788263318.067522:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 99 00000100:00100000:1.0:1788263318.067532:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+24:10808:x1875129699193472:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1788263318.067557:0:8884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263318.067605:0:8884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666fa71 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fee1 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263318.067662:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666fa78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263318.067677:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666fa78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263318.067688:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666fa78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263318.067794:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666fa71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fee1 expref: 26 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263318.067814:0:8884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666fa78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fee1 expref: 25 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263318.067822:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff388845f00) 00010000:00010000:1.0:1788263318.067824:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788263318.067828:0:8884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381681a00, rc 0) 00000100:00100000:1.0:1788263318.067876:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+25:10808:x1875129699193472:12345-192.168.203.26@tcp:101:bash.0 Request processed in 346us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263318.067883:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 99 00000100:00100000:1.0:1788263318.072430:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263318.075624:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699193728 00000100:00100000:2.0:1788263318.075639:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699193728 00000100:00100000:2.0:1788263318.075710:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 100 00000100:00100000:2.0:1788263318.075722:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+25:10808:x1875129699193728:12345-192.168.203.26@tcp:36:bash.0 00010000:00010000:2.0:1788263318.075927:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fa7f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.075944:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fa7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.075967:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fa7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788263318.076007:0:10388:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:2.0:1788263318.076029:0:10388:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a7e2d67 reply state 00000000ba79dd25 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fa7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.076042:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fa7f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.076049:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff388845f00) 00010000:00010000:2.0:1788263318.076052:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788263318.076055:0:10388:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788263318.076092:0:10388:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1788263318.077860:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:10808:x1875129699193728:12345-192.168.203.26@tcp:36:bash.0 Request processed in 2133us (5431us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788263318.077870:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 100 00000020:00080000:2.0:1788263318.077876:0:10388:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788263318.082785:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263318.083128:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699193856 00000100:00100000:2.0:1788263318.083139:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699193856 00000100:00100000:2.0:1788263318.083255:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 101 00000100:00100000:2.0:1788263318.083266:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:10808:x1875129699193856:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:2.0:1788263318.083296:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263318.083317:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fa86 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fee8 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.083370:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fa86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fee8 expref: 30 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.083404:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fa86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fee8 expref: 30 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.083436:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff388845f00) 00010000:00010000:2.0:1788263318.083449:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263318.083453:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d0a00, rc 0) 00000100:00100000:2.0:1788263318.083518:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+30:10808:x1875129699193856:12345-192.168.203.26@tcp:101:bash.0 Request processed in 254us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263318.083525:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 101 00000100:00100000:0.0:1788263318.087934:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263318.088011:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699193984 00000100:00100000:3.0:1788263318.088021:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699193984 00000100:00100000:3.0:1788263318.088075:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:3.0:1788263318.088086:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:10808:x1875129699193984:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1788263318.088101:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263318.088130:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b8de930/0x4b1103cba666fa8d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116feef expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788263318.088155:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a96bb93, atime: 0x6a96bb91, ctime: 0x6a96bb93, blocks: 0x8 00010000:00010000:3.0:1788263318.088175:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=327s v=(0 0) 00010000:00010000:3.0:1788263318.088180:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263318.088189:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b8de930/0x4b1103cba666fa8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116feef expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.088217:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b8de930/0x4b1103cba666fa8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116feef expref: 7 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.088244:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eec200, rc 0) 00000100:00100000:3.0:1788263318.088309:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:10808:x1875129699193984:12345-192.168.203.26@tcp:101:bash.0 Request processed in 224us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263318.088317:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:3.0:1788263318.090613:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263318.090785:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699194112 00000100:00100000:2.0:1788263318.090792:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699194112 00002000:00010000:2.0:1788263318.090826:0:8409:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1788263318.090830:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ff28381f480 with x1875129699194112 ext(0->18446744073709551615) 00002000:00010000:2.0:1788263318.090841:0:8409:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ff28381f480. 00000100:00100000:2.0:1788263318.090872:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1 00000100:00100000:2.0:1788263318.090882:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2389:x1875129699194112:12345-192.168.203.26@tcp:10:bash.0 00002000:00010000:2.0:1788263318.091133:0:8409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788263318.091137:0:8409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788263315 -> 1788263317 00002000:00010000:2.0:1788263318.091140:0:8409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788263313 -> 1788263313 00002000:00010000:2.0:1788263318.091142:0:8409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788263315 -> 1788263317 00002000:00010000:2.0:1788263318.091145:0:8409:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788263318.091368:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2389:x1875129699194112:12345-192.168.203.26@tcp:10:bash.0 Request processed in 486us (795us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788263318.091376:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1 00002000:00010000:2.0:1788263318.091380:0:8409:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1788263318.091390:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ff28381f480 with x1875129699194112 ext(0->18446744073709551615) 00002000:00010000:2.0:1788263318.091395:0:8409:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ff28381f480. 00000100:00100000:1.0:1788263318.176805:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263318.176893:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699194240 00000100:00100000:3.0:1788263318.176902:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699194240 00000100:00100000:3.0:1788263318.176959:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 102 00000100:00100000:3.0:1788263318.176968:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+30:11296:x1875129699194240:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:3.0:1788263318.177039:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666fa94 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177057:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666fa94 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177069:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666fa94 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177082:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666fa9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177089:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666fa9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177094:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666fa9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177174:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666faa2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177195:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666faa2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177202:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666faa2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788263318.177264:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666faa2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177274:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666fa94 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177289:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666fa94 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177296:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666fa94 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177302:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eed200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263318.177305:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666fa94 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177313:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666fa94 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177324:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:3.0:1788263318.177327:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263318.177332:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666fa94 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177338:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666fa94 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177357:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666fa9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177362:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666fa9b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177367:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666fa9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177370:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eec600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263318.177373:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666fa9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177378:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666fa9b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177383:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ff282126c00) 00010000:00010000:3.0:1788263318.177386:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263318.177388:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666fa9b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177393:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666fa9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177404:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666faa2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177532:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666faa2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177539:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666faa2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177549:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eeda00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263318.177552:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666faa2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177559:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666faa2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177568:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff388845f00) 00010000:00010000:3.0:1788263318.177570:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263318.177573:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666faa2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.177630:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666faa2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263318.177724:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+30:11296:x1875129699194240:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 755us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263318.177733:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 102 00010000:00010000:2.0:1788263318.192362:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263318.262684:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263318.262785:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699194496 00000100:00100000:2.0:1788263318.262796:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699194496 00000100:00100000:2.0:1788263318.262857:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 103 00000100:00100000:2.0:1788263318.262869:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+30:11299:x1875129699194496:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788263318.262890:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263318.262923:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666faa9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fef6 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.262992:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fab0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.263006:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fab0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.263018:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fab0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.263032:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fab7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.263038:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fab7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.263045:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fab7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.263156:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba666fabe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.263180:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba666fabe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.263187:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba666fabe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263318.263211:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788263318.263293:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fab0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.263301:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fab0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.263308:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fab0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.263315:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1a00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263318.263319:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fab0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.263326:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fab0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.263338:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:2.0:1788263318.263342:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263318.263346:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fab0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.263353:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fab0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.263375:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fab7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.263388:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fab7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.263394:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fab7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.263399:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263318.263403:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fab7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.263409:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fab7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.263418:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ff28227ab00) 00010000:00010000:2.0:1788263318.263420:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263318.263423:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fab7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.263430:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fab7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.263468:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666faa9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fef6 expref: 33 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.263483:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba666fabe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fef6 expref: 32 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.263491:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff388845f00) 00010000:00010000:2.0:1788263318.263493:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788263318.263502:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d1200, rc 0) 00000100:00100000:2.0:1788263318.263556:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+32:11299:x1875129699194496:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 689us (881us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788263318.263564:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 103 00000100:00100000:2.0:1788263318.270928:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263318.272154:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699194624 00000100:00100000:0.0:1788263318.272165:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699194624 00000100:00100000:0.0:1788263318.272237:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 104 00000100:00100000:0.0:1788263318.272248:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+32:11299:x1875129699194624:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:0.0:1788263318.272319:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666facc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.272335:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fa63 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116feda expref: 32 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.272344:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666facc lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.272379:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fa63 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116feda expref: 32 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.272406:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fa63 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116feda expref: 32 pid: 6491 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263318.272432:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283ae9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6491:1875129709763200:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788263318.273181:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28323ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263318.277639:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263318.279337:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699194880 00000100:00100000:3.0:1788263318.279352:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699194880 00000100:00100000:3.0:1788263318.279430:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:3.0:1788263318.279441:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+33:6156:x1875129699194880:12345-192.168.203.26@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788263318.279828:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+34:6156:x1875129699194880:12345-192.168.203.26@tcp:35:ldlm_bl.0 Request processed in 388us (2197us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788263318.279835:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:2.0:1788263318.282071:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283ae9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6491:1875129709763200:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788263318.282099:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666facc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263318.286164:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263318.286340:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699195008 00000100:00100000:3.0:1788263318.286350:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699195008 00010000:00010000:3.0:1788263318.286389:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fa63 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116feda expref: 34 pid: 6491 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263318.286456:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00100000:3.0:1788263318.286466:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283818a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+34:2387:x1875129699195008:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263318.286482:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263318.286490:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fa63 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116feda expref: 34 pid: 6491 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.286504:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fa63 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116feda expref: 34 pid: 6491 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.286829:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fa63 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116feda expref: 34 pid: 6491 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.286848:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff388845f00) 00010000:00010000:3.0:1788263318.286854:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666facc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.286863:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666facc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.286870:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666facc lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.286896:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263318.286946:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283818a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+33:2387:x1875129699195008:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 482us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263318.286954:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 66 00010000:00010000:0.0:1788263318.287100:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666facc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.287109:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666facc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.287156:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666facc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.287164:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666facc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.287170:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666facc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.287176:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17f800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263318.287179:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666facc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.287185:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666facc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.287204:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff388845f00) 00010000:00010000:0.0:1788263318.287216:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788263318.287221:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666facc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.287227:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666facc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263318.287285:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+32:11299:x1875129699194624:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 15031us (16358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263318.287294:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 104 00000100:00100000:1.0:1788263318.291704:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263318.291798:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699195264 00000100:00100000:3.0:1788263318.291828:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699195264 00000100:00100000:3.0:1788263318.291894:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:3.0:1788263318.291908:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+32:11299:x1875129699195264:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1788263318.292203:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+33:11299:x1875129699195264:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 298us (714us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788263318.292212:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:3.0:1788263318.419217:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263318.419355:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699195520 00000100:00100000:0.0:1788263318.419369:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699195520 00000100:00100000:0.0:1788263318.419444:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 105 00000100:00100000:0.0:1788263318.419457:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+33:11310:x1875129699195520:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:0.0:1788263318.419502:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263318.419537:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fad3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fefd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.419661:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fada lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.419678:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fada lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.419692:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fada lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.419708:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fae1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.419716:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fae1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.419740:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fae1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.419879:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fae8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.419889:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fae8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.419896:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fae8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263318.419908:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788263318.420001:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fada lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.420009:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fada lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.420017:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fada lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.420023:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17e400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263318.420027:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fada lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.420035:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fada lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.420049:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:0.0:1788263318.420052:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263318.420065:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fada lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.420072:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fada lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.420087:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fae1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.420094:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fae1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.420100:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fae1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.420105:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17f600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263318.420108:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fae1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.420114:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fae1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.420122:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ff282279c00) 00010000:00010000:0.0:1788263318.420124:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263318.420126:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fae1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.420132:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fae1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.420176:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fad3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fefd expref: 36 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.420202:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fae8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fefd expref: 35 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.420210:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff388845f00) 00010000:00010000:0.0:1788263318.420212:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263318.420215:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17e200, rc 0) 00000100:00100000:0.0:1788263318.420426:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+35:11310:x1875129699195520:12345-192.168.203.26@tcp:101:cat.0 Request processed in 970us (1223us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788263318.420434:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 105 00000100:00100000:0.0:1788263318.440105:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263318.440193:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699195776 00000100:00100000:3.0:1788263318.440203:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699195776 00000100:00100000:3.0:1788263318.440287:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:3.0:1788263318.440297:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+35:11310:x1875129699195776:12345-192.168.203.26@tcp:35:cat.0 00000100:00100000:3.0:1788263318.440675:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+36:11310:x1875129699195776:12345-192.168.203.26@tcp:35:cat.0 Request processed in 379us (579us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788263318.440685:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:1.0:1788263318.480559:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263318.481285:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699196032 00000100:00100000:2.0:1788263318.481297:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699196032 00000100:00100000:2.0:1788263318.481371:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 106 00000100:00100000:2.0:1788263318.481383:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+36:11311:x1875129699196032:12345-192.168.203.26@tcp:36:rm.0 00010000:00010000:2.0:1788263318.481469:0:8884:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788263318.481512:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fa86 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fee8 expref: 36 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.481538:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fae8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fefd expref: 35 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.481551:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba666fabe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fef6 expref: 34 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.481563:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666fa78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fee1 expref: 33 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.481575:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff388845f00) 00010000:00010000:2.0:1788263318.481876:0:8884:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788263318.481900:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666faf6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.481916:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666faf6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.481927:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666faf6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.481944:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fafd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.481951:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fafd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.481957:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fafd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.482078:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fb04 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.482086:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fb04 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.482092:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fb04 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788263318.484104:0:8884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1788263318.484505:0:8884:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 327555540538ns, next at 328555537076ns, rc = 0 00010000:00010000:2.0:1788263318.484604:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba666fb0b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.486029:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba666fb0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.486040:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba666fb0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.486049:0:8884:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba666fb0b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.486057:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba666fb0b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.486063:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba666fb0b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.486091:0:8884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263318.486321:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fb04 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.486329:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fb04 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.486335:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fb04 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.486341:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1a00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263318.486345:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fb04 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.486352:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fb04 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.486375:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff388845f00) 00010000:00010000:2.0:1788263318.486377:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788263318.486382:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fb04 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.486388:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba666fb04 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.486410:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666faf6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.486415:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666faf6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263318.486623:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263318.486631:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba666fb0b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263318.486640:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1800 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:1.0:1788263318.486643:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba666fb0b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263318.486650:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba666fb0b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263318.486660:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff388845f00) 00010000:00010000:1.0:1788263318.486662:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788263318.486666:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba666fb0b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263318.486672:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba666fb0b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263318.486684:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263318.486686:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263318.486688:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263318.486895:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666faf6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.486902:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1c00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263318.486905:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666faf6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.486911:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666faf6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.486921:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:2.0:1788263318.486923:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263318.486927:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666faf6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.486933:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba666faf6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788263318.486957:0:8884:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000800bbf74 reply state 00000000da06d610 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fafd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.486969:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fafd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.486976:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ff28227ab00) 00010000:00010000:2.0:1788263318.486979:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788263318.486983:0:8884:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788263318.487666:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+34:11311:x1875129699196032:12345-192.168.203.26@tcp:36:rm.0 Request processed in 6280us (7111us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788263318.487677:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 106 00000100:00100000:1.0:1788263318.588407:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263318.588948:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699196288 00000100:00100000:0.0:1788263318.588958:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699196288 00000100:00100000:0.0:1788263318.589117:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 107 00000100:00100000:0.0:1788263318.589130:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+34:11317:x1875129699196288:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1788263318.589156:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263318.589176:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fb12 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ff04 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.589289:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fb19 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.589304:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fb19 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.589315:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fb19 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.589360:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666fb20 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.589369:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666fb20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.589377:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666fb20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788263318.589906:0:6491:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788263318.590046:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fb27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.590056:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fb27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.590063:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fb27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.590089:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fb19 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.590096:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fb19 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.590103:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fb19 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.590109:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17e400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263318.590114:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fb19 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.590131:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fb19 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.590143:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:0.0:1788263318.590145:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263318.590149:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fb19 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.590155:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fb19 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788263318.590167:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a91f937 reply state 000000008032cf84 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666fb20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.590178:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666fb20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.590184:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ff28227ab00) 00010000:00010000:0.0:1788263318.590186:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788263318.590189:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788263318.590217:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fb12 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff04 expref: 37 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.590232:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fb27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff04 expref: 36 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.590239:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282279c00) 00010000:00010000:0.0:1788263318.590241:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263318.590244:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17f800, rc 0) 00000100:00100000:0.0:1788263318.590740:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+37:11317:x1875129699196288:12345-192.168.203.26@tcp:101:bash.0 Request processed in 1613us (2341us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1788263318.590753:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 107 00000100:00100000:0.0:1788263318.594093:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263318.594351:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699196416 00000100:00100000:2.0:1788263318.594360:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699196416 00000100:00100000:2.0:1788263318.594433:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:2.0:1788263318.594444:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2389:x1875129699196416:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:2.0:1788263318.594469:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263318.594489:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666fb35 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ff0b expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788263318.594514:0:8406:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00080000:0.0:1788263318.594613:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788263318.594759:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=327s v=(0 0) 00010000:00010000:2.0:1788263318.594766:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263318.594776:0:8406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666fb35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff0b expref: 8 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.594796:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666fb35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff0b expref: 8 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.594834:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d1c00, rc 0) 00000100:00100000:2.0:1788263318.594892:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2389:x1875129699196416:12345-192.168.203.26@tcp:101:bash.0 Request processed in 449us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263318.594900:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:1.0:1788263318.604846:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263318.604944:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699196544 00000100:00100000:3.0:1788263318.604954:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699196544 00000100:00100000:0.0:1788263318.605241:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 43 00000100:00100000:0.0:1788263318.605263:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:11317:x1875129699196544:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1788263318.605293:0:8404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263318.605315:0:8404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efcdf847/0x4b1103cba666fb3c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ff12 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.605343:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666fb35 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff0b expref: 9 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.605350:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263318.605353:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263318.605357:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efcdf847/0x4b1103cba666fb3c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff12 expref: 9 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.605382:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666fb35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff0b expref: 9 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.605392:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666fb35 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff0b expref: 9 pid: 8406 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263318.605403:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283aeb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1875129709763328:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788263318.605482:0:8404:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28323e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263318.608207:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283aeb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8404:1875129709763328:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788263318.608235:0:8404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000efcdf847/0x4b1103cba666fb3c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff12 expref: 9 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.608253:0:8404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17f600, rc 0) 00000100:00100000:0.0:1788263318.608343:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:11317:x1875129699196544:12345-192.168.203.26@tcp:101:bash.0 Request processed in 3084us (3505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263318.608349:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 43 00000100:00100000:2.0:1788263318.608869:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263318.608964:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699196672 00000100:00100000:3.0:1788263318.608972:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699196672 00010000:00010000:3.0:1788263318.609005:0:9493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666fb35 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff0b expref: 9 pid: 8406 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263318.609039:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00100000:3.0:1788263318.609048:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:2386:x1875129699196672:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263318.609074:0:9493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263318.609099:0:9493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666fb35 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff0b expref: 9 pid: 8406 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.609192:0:9493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666fb35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff0b expref: 9 pid: 8406 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.609215:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba270ae9/0x4b1103cba666fb35 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff0b expref: 9 pid: 8406 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.609229:0:9493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263318.609233:0:9493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263318.609240:0:9493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000efcdf847/0x4b1103cba666fb3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff12 expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.609251:0:9493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efcdf847/0x4b1103cba666fb3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff12 expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.609296:0:9493:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000efcdf847/0x4b1103cba666fb3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff12 expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263318.609311:0:9493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9493:1875129709763456:192.168.203.26@tcp:105: 00000100:00100000:3.0:1788263318.609642:0:9493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39aad6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788263318.620234:0:9493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9493:1875129709763456:192.168.203.26@tcp:105: 00010000:00010000:3.0:1788263318.620283:0:9493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263318.620372:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2386:x1875129699196672:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 11323us (11503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263318.620386:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00100000:1.0:1788263318.622390:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263318.622721:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699196928 00000100:00100000:3.0:1788263318.622735:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699196928 00000100:00100000:3.0:1788263318.622829:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:3.0:1788263318.622841:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+37:11317:x1875129699196928:12345-192.168.203.26@tcp:35:bash.0 00000100:00100000:3.0:1788263318.623630:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+38:11317:x1875129699196928:12345-192.168.203.26@tcp:35:bash.0 Request processed in 739us (1202us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788263318.623641:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:2.0:1788263318.885671:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263318.885862:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699197056 00000100:00100000:0.0:1788263318.885875:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699197056 00000100:00100000:0.0:1788263318.885961:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 108 00000100:00100000:0.0:1788263318.885975:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+38:11334:x1875129699197056:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788263318.886010:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263318.886040:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fb43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ff19 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.886145:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fb4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.886162:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fb4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.886188:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fb4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263318.886248:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788263318.886254:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788263318.886288:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fb4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.887314:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fb43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff19 expref: 40 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.887344:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fb4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff19 expref: 39 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.887354:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:0.0:1788263318.887357:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788263318.887362:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17e200, rc 0) 00000100:00100000:0.0:1788263318.887457:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+39:11334:x1875129699197056:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1485us (1804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263318.887468:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 108 00000100:00100000:1.0:1788263318.893822:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263318.893984:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699197312 00000100:00100000:2.0:1788263318.893999:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699197312 00000100:00100000:2.0:1788263318.894079:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 109 00000100:00100000:2.0:1788263318.894093:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+39:11334:x1875129699197312:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788263318.894133:0:8884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263318.894163:0:8884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fb51 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ff20 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.894333:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666fb58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.894350:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666fb58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.894365:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666fb58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263318.894380:0:8884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788263318.894519:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fb51 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff20 expref: 42 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.894621:0:8884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666fb58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff20 expref: 41 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.894632:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282279c00) 00010000:00010000:2.0:1788263318.894635:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788263318.894639:0:8884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d0200, rc 0) 00000100:00100000:2.0:1788263318.894717:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+41:11334:x1875129699197312:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 627us (1240us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1788263318.894725:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 109 00000100:00100000:1.0:1788263318.898150:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263318.898267:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699197568 00000100:00100000:0.0:1788263318.898288:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699197568 00000100:00100000:0.0:1788263318.898358:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 110 00000100:00100000:0.0:1788263318.898370:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+41:11334:x1875129699197568:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788263318.898403:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263318.898429:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fb66 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ff27 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.898571:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fb6d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.898626:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fb6d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.898640:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fb6d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263318.898675:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788263318.898828:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fb66 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff27 expref: 44 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.898850:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fb6d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff27 expref: 43 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.898860:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282279c00) 00010000:00010000:0.0:1788263318.898863:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788263318.898867:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3829e9400, rc 0) 00000100:00100000:0.0:1788263318.898942:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+43:11334:x1875129699197568:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 574us (806us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1788263318.898950:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 110 00000100:00100000:0.0:1788263318.902868:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263318.903259:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699197696 00000100:00100000:3.0:1788263318.903281:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699197696 00000100:00100000:3.0:1788263318.903373:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:3.0:1788263318.903385:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+43:2386:x1875129699197696:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263318.903405:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263318.903440:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666fb58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff20 expref: 43 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.903466:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282279c00) 00010000:00010000:3.0:1788263318.903472:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263318.903559:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+42:2386:x1875129699197696:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 175us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263318.903569:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:1.0:1788263318.909449:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263318.915008:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699197824 00000100:00100000:3.0:1788263318.915032:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699197824 00000100:00100000:3.0:1788263318.915199:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:3.0:1788263318.915213:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283819180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2387:x1875129699197824:12345-192.168.203.26@tcp:1:lfs.0 00010000:00010000:3.0:1788263318.915288:0:9885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9ea01c2/0x4b1103cba666fb7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.915337:0:9885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000efcdf847/0x4b1103cba666fb3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff12 expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.915347:0:9885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263318.915352:0:9885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788263318.915357:0:9885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9ea01c2/0x4b1103cba666fb7b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.915406:0:9885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000efcdf847/0x4b1103cba666fb3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff12 expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.915421:0:9885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000efcdf847/0x4b1103cba666fb3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff12 expref: 8 pid: 8404 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263318.915439:0:9885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9885:1875129709763584:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788263318.915607:0:9885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39aad6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788263318.922049:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263318.922081:0:9885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9885:1875129709763584:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263318.922132:0:9885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d9ea01c2/0x4b1103cba666fb7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263318.922244:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699197952 00000100:00100000:0.0:1788263318.922254:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699197952 00002000:00100000:0.0:1788263318.922329:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9ff28381b480 x1875129699197952/t0(0) o4->ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp:529/0 lens 504/0 e 0 to 0 dl 1788263329 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788263318.922340:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ff28381b480 with x1875129699197952 ext(0->8) 00010000:00010000:0.0:1788263318.922349:0:8410:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000efcdf847/0x4b1103cba666fb3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff12 expref: 9 pid: 8404 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.922367:0:8410:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000efcdf847/0x4b1103cba666fb3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff12 expref: 9 pid: 8404 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788263318.922376:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ff28381b480 00000100:00100000:0.0:1788263318.922428:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1 00000100:00100000:0.0:1788263318.922438:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:2387:x1875129699197952:12345-192.168.203.26@tcp:4:lfs.0 00000100:00100000:0.0:1788263318.923935:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+11:2387:x1875129699197952:12345-192.168.203.26@tcp:4:lfs.0 Request processed in 1489us (1892us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788263318.923947:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1 00002000:00100000:0.0:1788263318.923957:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9ff28381b480 x1875129699197952/t4294967303(0) o4->ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp:529/0 lens 504/448 e 0 to 0 dl 1788263329 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788263318.923965:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ff28381b480 with x1875129699197952 ext(0->8) 00010000:00010000:0.0:1788263318.923973:0:8410:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000efcdf847/0x4b1103cba666fb3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff12 expref: 11 pid: 8404 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.923987:0:8410:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000efcdf847/0x4b1103cba666fb3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff12 expref: 11 pid: 8404 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788263318.923993:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ff28381b480 00000100:00100000:1.0:1788263318.931957:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263318.934511:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699198080 00000100:00100000:0.0:1788263318.934529:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699198080 00010000:00010000:0.0:1788263318.934592:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000efcdf847/0x4b1103cba666fb3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff12 expref: 11 pid: 8404 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263318.934643:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 68 00000100:00100000:0.0:1788263318.934652:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0456450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+11:2387:x1875129699198080:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263318.934668:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788263318.934685:0:6478:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788263318.934688:0:6478:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788263317 00002000:00010000:0.0:1788263318.934705:0:6478:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788263318 00002000:00010000:0.0:1788263318.934707:0:6478:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788263317 00002000:00010000:0.0:1788263318.934709:0:6478:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788263318.934717:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000efcdf847/0x4b1103cba666fb3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff12 expref: 11 pid: 8404 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.934730:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000efcdf847/0x4b1103cba666fb3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff12 expref: 11 pid: 8404 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.934757:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efcdf847/0x4b1103cba666fb3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff12 expref: 11 pid: 8404 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.934774:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1788263318.934779:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 1) 00010000:00010000:0.0:1788263318.934785:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9ea01c2/0x4b1103cba666fb7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.934795:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9ea01c2/0x4b1103cba666fb7b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263318.934826:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263318.934900:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0456450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+10:2387:x1875129699198080:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 248us (2952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263318.934909:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 68 00010000:00010000:3.0:1788263318.935728:0:9885:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d9ea01c2/0x4b1103cba666fb7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.935743:0:9885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9ea01c2/0x4b1103cba666fb7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.935779:0:9885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9ea01c2/0x4b1103cba666fb7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.935788:0:9885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9ea01c2/0x4b1103cba666fb7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.935795:0:9885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9ea01c2/0x4b1103cba666fb7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.935802:0:9885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eeda00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263318.935806:0:9885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9ea01c2/0x4b1103cba666fb7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.935814:0:9885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9ea01c2/0x4b1103cba666fb7b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.935829:0:9885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9ea01c2/0x4b1103cba666fb7b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.935837:0:9885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9ea01c2/0x4b1103cba666fb7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263318.935919:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283819180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:2387:x1875129699197824:12345-192.168.203.26@tcp:1:lfs.0 Request processed in 20708us (26485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263318.935928:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:1.0:1788263318.950931:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263318.951033:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699198336 00000100:00100000:3.0:1788263318.951043:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699198336 00000100:00100000:3.0:1788263318.951100:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00100000:3.0:1788263318.951112:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a973f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+42:11334:x1875129699198336:12345-192.168.203.26@tcp:35:lfs.0 00000004:00010000:3.0:1788263318.951169:0:6494:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fb6d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff27 expref: 42 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788263318.951424:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1788263318.951462:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788263318.953076:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1788263318.953128:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fb82 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.953145:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fb27 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff04 expref: 46 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.953154:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fb82 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.953191:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fb27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff04 expref: 46 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263318.953206:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fb27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff04 expref: 46 pid: 6491 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263318.953220:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6494:1875129709763712:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788263318.953324:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff283a5ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263318.957702:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263318.957812:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6494:1875129709763712:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788263318.957839:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fb82 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263318.957907:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699198464 00000100:00100000:3.0:1788263318.957915:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699198464 00010000:00010000:3.0:1788263318.957950:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fb27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff04 expref: 47 pid: 6491 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263318.957985:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 69 00000100:00100000:3.0:1788263318.957993:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+47:2386:x1875129699198464:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263318.958008:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263318.958023:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fb27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff04 expref: 47 pid: 6491 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.958034:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fb27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff04 expref: 47 pid: 6491 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.958056:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fb27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff04 expref: 47 pid: 6491 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.958080:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282279c00) 00010000:00010000:3.0:1788263318.958087:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fb82 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.958111:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fb82 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.958119:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fb82 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.958149:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788263318.958261:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fb82 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263318.958266:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+46:2386:x1875129699198464:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 271us (572us total) trans 0 rc 0/0 00010000:00010000:0.0:1788263318.958288:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fb82 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263318.958289:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 69 00000001:00080000:0.0:1788263318.958831:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:0.0:1788263318.958950:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1788263318.959033:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283aeb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6494:1875129709763840:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788263318.959085:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263318.959174:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff38393ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263318.959201:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709763840 00000100:00100000:2.0:1788263318.959207:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709763840 00000100:00080000:0.0:1788263318.959243:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263318.959459:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788263318.959468:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6494:x1875129709763840:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788263318.959557:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6494:x1875129709763840:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 90us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263318.959564:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788263318.959712:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283aeb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6494:1875129709763840:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788263318.959845:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1788263318.959901:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6494:1875129709763968:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788263318.959933:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263318.959958:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28323e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788263318.960281:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709763968 00000100:00100000:0.0:1788263318.960286:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709763968 00000100:00100000:0.0:1788263318.960315:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788263318.960322:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6494:x1875129709763968:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788263318.960664:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6494:x1875129709763968:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 341us (729us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788263318.960703:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788263318.960779:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6494:1875129709763968:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788263318.960828:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1788263318.960856:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fb82 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.960863:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fb82 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.960870:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fb82 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.960876:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0a00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263318.960881:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fb82 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.960896:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fb82 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.960912:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282279c00) 00010000:00010000:3.0:1788263318.960915:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788263318.960920:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fb82 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.960926:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fb82 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788263318.962074:0:6494:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788263318.962142:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1788263318.962154:0:6494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 328033574327ns, next at 329033571664ns, rc = 0 00000001:00080000:3.0:1788263318.962161:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1788263318.962195:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282279c00) 00010000:00010000:3.0:1788263318.962198:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788263318.962206:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fb6d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff27 expref: 50 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263318.962318:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a973f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+49:11334:x1875129699198336:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 11208us (11396us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1788263318.962327:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 26 00000020:00080000:3.0:1788263318.962331:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788263318.969875:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263318.970009:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699198592 00000100:00100000:3.0:1788263318.970019:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699198592 00000100:00100000:3.0:1788263318.970082:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 111 00000100:00100000:3.0:1788263318.970092:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+49:11334:x1875129699198592:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788263318.970136:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263318.970159:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666fb89 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ff2e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.970212:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666fb89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff2e expref: 50 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.970226:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666fb89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff2e expref: 50 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263318.970242:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:3.0:1788263318.970245:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788263318.970249:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eeda00, rc 0) 00000100:00100000:3.0:1788263318.970313:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+50:11334:x1875129699198592:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 222us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263318.970319:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 111 00000100:00100000:1.0:1788263318.974356:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263318.974640:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699198848 00000100:00100000:0.0:1788263318.974651:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699198848 00000100:00100000:0.0:1788263318.974708:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:0.0:1788263318.974719:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+50:11334:x1875129699198848:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:0.0:1788263318.975804:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+51:11334:x1875129699198848:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 1081us (1451us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788263318.975815:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:2.0:1788263319.088233:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263319.088256:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709764096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263319.088342:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263319.125305:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709764096 00000100:00100000:1.0:1788263319.125320:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709764096 00000100:00100000:1.0:1788263319.125400:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788263319.125413:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1875129709764096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788263319.125445:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263319.126035:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1875129709764096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (37178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263319.126044:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1788263319.126310:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788263319.126359:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709764096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263319.128646:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875129709764352:0@lo:400:kworker.0 00000100:00100000:0.0:1788263319.128708:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263319.128830:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709764224:0@lo:400:kworker.0 00000100:00100000:2.0:1788263319.128868:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263319.128935:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709764480:0@lo:400:kworker.0 00000100:00100000:1.0:1788263319.128965:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263319.130518:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875129709764864:0@lo:400:kworker.0 00000100:00100000:0.0:1788263319.130818:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263319.131095:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709764608:0@lo:400:kworker.0 00000100:00100000:0.0:1788263319.131124:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875129709765376:0@lo:400:kworker.0 00000100:00100000:3.0:1788263319.131140:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263319.131164:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263319.131171:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709765120:0@lo:400:kworker.0 00000100:00100000:0.0:1788263319.131197:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788263319.131204:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263319.131225:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788263319.131231:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875129709764992:0@lo:400:kworker.0 00000100:00100000:3.0:1788263319.131254:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263319.131283:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709765504:0@lo:400:kworker.0 00000100:00100000:0.0:1788263319.131394:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709764736:0@lo:400:kworker.0 00000100:00100000:0.0:1788263319.132006:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263319.132045:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875129709765248:0@lo:400:kworker.0 00000100:00100000:0.0:1788263319.132154:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263319.132191:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709764352 00000100:00100000:0.0:1788263319.132198:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709764352 00000100:00100000:0.0:1788263319.132325:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709764864 00000100:00100000:0.0:1788263319.132329:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709764864 00000100:00100000:0.0:1788263319.132360:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709764608 00000100:00100000:0.0:1788263319.132364:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709764608 00000100:00100000:0.0:1788263319.132373:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709765376 00000100:00100000:0.0:1788263319.132376:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709765376 00000100:00100000:0.0:1788263319.132758:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709764992 00000100:00100000:0.0:1788263319.132762:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709764992 00000100:00100000:0.0:1788263319.132775:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709765248 00000100:00100000:0.0:1788263319.132777:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709765248 00000100:00100000:0.0:1788263319.132791:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788263319.132799:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875129709764352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263319.132861:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875129709764352:12345-0@lo:400:kworker.0 Request processed in 62us (4153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263319.132868:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788263319.132908:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875129709764352:0@lo:400:kworker.0 00000100:00100000:0.0:1788263319.132930:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788263319.132937:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875129709764864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263319.132969:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875129709764864:12345-0@lo:400:kworker.0 Request processed in 33us (2151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263319.132983:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788263319.132996:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788263319.133002:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709764608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263319.133152:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709764608:12345-0@lo:400:kworker.0 Request processed in 149us (2013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263319.133159:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788263319.133172:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788263319.133178:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875129709765376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263319.133362:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875129709765376:12345-0@lo:400:kworker.0 Request processed in 183us (2199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263319.133369:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788263319.133382:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788263319.133388:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28233b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875129709764992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263319.133418:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28233b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875129709764992:12345-0@lo:400:kworker.0 Request processed in 30us (2163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263319.133424:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788263319.133433:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788263319.133439:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875129709765248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263319.133461:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875129709765248:12345-0@lo:400:kworker.0 Request processed in 23us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263319.133467:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788263319.133494:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875129709765248:0@lo:400:kworker.0 00000100:00100000:0.0:1788263319.133505:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875129709764864:0@lo:400:kworker.0 00010000:00080000:0.0:1788263319.133665:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff398661c00 x1875129709765376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263319.133678:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875129709765376:0@lo:400:kworker.0 00000100:00100000:0.0:1788263319.133721:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709764480 00000100:00100000:0.0:1788263319.133726:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709764480 00000100:00100000:0.0:1788263319.133750:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709764736 00000100:00100000:0.0:1788263319.133753:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709764736 00000100:00100000:0.0:1788263319.133764:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788263319.133770:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709764480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263319.133807:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709764480:12345-0@lo:400:kworker.0 Request processed in 36us (4840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263319.133814:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788263319.133824:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788263319.133830:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709764736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263319.133859:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709764736:12345-0@lo:400:kworker.0 Request processed in 29us (1854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263319.133865:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788263319.133890:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709764736:0@lo:400:kworker.0 00000100:00100000:0.0:1788263319.134176:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709764224 00000100:00100000:0.0:1788263319.134181:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709764224 00000100:00100000:0.0:1788263319.134354:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788263319.134362:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3620:x1875129709764224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263319.134398:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3620:x1875129709764224:12345-0@lo:400:kworker.0 Request processed in 36us (5529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263319.134404:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00080000:0.0:1788263319.134440:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788263319.134446:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263319.134498:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709765120 00000100:00100000:0.0:1788263319.134502:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709765120 00000100:00100000:0.0:1788263319.135047:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788263319.135118:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709765120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263319.135166:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709765120:12345-0@lo:400:kworker.0 Request processed in 112us (3964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263319.135173:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1788263319.135191:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263319.143729:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709764224:0@lo:400:kworker.0 00000100:00100000:3.0:1788263319.153091:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263319.153185:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709764608:0@lo:400:kworker.0 00000100:00100000:3.0:1788263319.153217:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709765120:0@lo:400:kworker.0 00010000:00080000:3.0:1788263319.153247:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28381c700 x1875129709764992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263319.153258:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875129709764992:0@lo:400:kworker.0 00000100:00100000:2.0:1788263319.153548:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709765504 00000100:00100000:2.0:1788263319.153554:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709765504 00000100:00100000:2.0:1788263319.153637:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788263319.153646:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709765504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263319.153708:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709765504:12345-0@lo:400:kworker.0 Request processed in 64us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263319.153715:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:0.0:1788263319.153780:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788263319.153914:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709765504:0@lo:400:kworker.0 00000100:00100000:0.0:1788263319.154068:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709764480:0@lo:400:kworker.0 00000100:00100000:1.0:1788263319.175905:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263319.176156:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699198976 00000100:00100000:0.0:1788263319.176164:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699198976 00000100:00100000:0.0:1788263319.176360:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 112 00000100:00100000:0.0:1788263319.176370:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+51:11344:x1875129699198976:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:0.0:1788263319.176446:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fb90 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176463:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fb90 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176476:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fb90 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176488:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fb97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176495:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fb97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176520:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fb97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176645:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fb9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176654:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fb9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176662:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fb9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788263319.176709:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fb9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176722:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fb90 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176730:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fb90 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176736:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fb90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176743:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e8800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263319.176747:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fb90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176755:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fb90 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176767:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:0.0:1788263319.176776:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263319.176782:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fb90 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176790:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fb90 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176805:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fb97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176811:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fb97 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176817:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fb97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176822:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263319.176825:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fb97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176832:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fb97 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176839:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ff28227ab00) 00010000:00010000:0.0:1788263319.176842:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263319.176845:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fb97 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176850:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fb97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176858:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fb9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176870:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fb9e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176875:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fb9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176881:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17f800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263319.176885:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fb9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176891:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fb9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176899:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:0.0:1788263319.176901:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263319.176905:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fb9e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.176910:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fb9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263319.176978:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+51:11344:x1875129699198976:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 610us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263319.176986:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 112 00000100:00080000:2.0:1788263319.178853:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788263319.215869:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263319.243069:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263319.243156:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699199232 00000100:00100000:0.0:1788263319.243166:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699199232 00000100:00100000:0.0:1788263319.243227:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 113 00000100:00100000:0.0:1788263319.243237:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+51:11347:x1875129699199232:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788263319.243258:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263319.243303:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fba5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ff35 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.243372:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fbac lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.243387:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fbac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.243399:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fbac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.243410:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fbb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.243418:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fbb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.243423:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fbb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.243527:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fbba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.243536:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fbba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.243544:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fbba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263319.243554:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788263319.243704:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fbac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.243723:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fbac lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.243729:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fbac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.243734:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17f600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263319.243738:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fbac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.243745:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fbac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.243757:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:0.0:1788263319.243761:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263319.243765:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fbac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.243771:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fbac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.243784:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fbb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.243790:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fbb3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.243797:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fbb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.243802:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17e400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263319.243811:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fbb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.243818:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fbb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.243826:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ff28227ab00) 00010000:00010000:0.0:1788263319.243829:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263319.243833:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fbb3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.243840:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fbb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.243871:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fba5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff35 expref: 54 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.243885:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fbba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff35 expref: 53 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.243893:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:0.0:1788263319.243895:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263319.243898:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3829e9400, rc 0) 00000100:00100000:0.0:1788263319.243948:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+53:11347:x1875129699199232:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 713us (888us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788263319.243956:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 113 00000100:00100000:1.0:1788263319.255306:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263319.255415:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699199360 00000100:00100000:0.0:1788263319.255424:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699199360 00000100:00100000:0.0:1788263319.255493:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 114 00000100:00100000:0.0:1788263319.255503:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283819f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+53:11347:x1875129699199360:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:0.0:1788263319.255615:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fbc8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.255632:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fbc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.255643:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fbc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.255675:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fbc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.255682:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fbc8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.255688:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fbc8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.255695:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e8800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263319.255699:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fbc8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.255706:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fbc8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.255717:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:0.0:1788263319.255720:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788263319.255725:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fbc8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.255730:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fbc8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263319.255819:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283819f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+53:11347:x1875129699199360:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 318us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263319.255828:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 114 00000100:00100000:1.0:1788263319.259748:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263319.260016:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699199616 00000100:00100000:3.0:1788263319.260031:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699199616 00000100:00100000:3.0:1788263319.260113:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:3.0:1788263319.260126:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+53:11347:x1875129699199616:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1788263319.260485:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+54:11347:x1875129699199616:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 359us (750us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1788263319.260495:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:1.0:1788263319.415282:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263319.416288:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699199872 00000100:00100000:3.0:1788263319.416308:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699199872 00000100:00100000:3.0:1788263319.416386:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 115 00000100:00100000:3.0:1788263319.416844:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+54:11357:x1875129699199872:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1788263319.416886:0:8884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263319.416891:0:8884:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788263319.416931:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fb4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff19 expref: 54 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.416957:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:3.0:1788263319.416964:0:8884:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263319.416985:0:8884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666fbcf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ff3c expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.417366:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666fbd6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.417384:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666fbd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.417397:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666fbd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263319.417808:0:8884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788263319.417972:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666fbcf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff3c expref: 56 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.417993:0:8884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666fbd6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff3c expref: 55 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.418002:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:3.0:1788263319.418005:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263319.418009:0:8884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eed200, rc 0) 00000100:00100000:3.0:1788263319.418294:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+55:11357:x1875129699199872:12345-192.168.203.26@tcp:101:bash.0 Request processed in 1895us (3035us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1788263319.418306:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 115 00000100:00100000:1.0:1788263319.426797:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263319.426851:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263319.426976:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699200000 00000100:00100000:2.0:1788263319.426990:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699200000 00000100:00100000:2.0:1788263319.427098:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00100000:2.0:1788263319.427122:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+55:2388:x1875129699200000:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263319.427147:0:9493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263319.427182:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba666fbd6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff3c expref: 55 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263319.427208:0:9493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:2.0:1788263319.427213:0:9493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263319.427309:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+54:2388:x1875129699200000:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 188us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263319.427318:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00100000:3.0:1788263319.427716:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699200128 00000100:00100000:3.0:1788263319.427726:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699200128 00000100:00100000:3.0:1788263319.427783:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 116 00000100:00100000:3.0:1788263319.427793:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+54:11357:x1875129699200128:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1788263319.427829:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263319.427873:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666fbe4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ff43 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.427926:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666fbeb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.427942:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666fbeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.427957:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666fbeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.428129:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba666fbe4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff43 expref: 56 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.428147:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666fbeb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff43 expref: 55 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.428156:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:3.0:1788263319.428159:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788263319.428162:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eed600, rc 0) 00000100:00100000:3.0:1788263319.428224:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+55:11357:x1875129699200128:12345-192.168.203.26@tcp:101:bash.0 Request processed in 433us (1445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263319.428231:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 116 00000100:00100000:1.0:1788263319.437867:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263319.437964:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699200384 00000100:00100000:2.0:1788263319.437978:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699200384 00000100:00100000:2.0:1788263319.438059:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 117 00000100:00100000:2.0:1788263319.438072:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+55:11357:x1875129699200384:12345-192.168.203.26@tcp:36:bash.0 00010000:00010000:2.0:1788263319.438162:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263319.438199:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fbba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff35 expref: 55 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263319.438239:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:2.0:1788263319.438244:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788263319.438492:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666fbf2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263319.438508:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666fbf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263319.438539:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666fbf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788263319.438643:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1788263319.438669:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000312a069b reply state 00000000247bc938 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666fbf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263319.438684:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666fbf2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263319.438691:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:2.0:1788263319.438694:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788263319.438697:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788263319.438818:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+57:11357:x1875129699200384:12345-192.168.203.26@tcp:36:bash.0 Request processed in 747us (969us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788263319.438827:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 117 00000020:00080000:2.0:1788263319.438833:0:6491:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788263319.442039:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263319.442144:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699200512 00000100:00100000:3.0:1788263319.442157:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699200512 00000100:00100000:3.0:1788263319.442245:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 118 00000100:00100000:3.0:1788263319.442257:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+57:11357:x1875129699200512:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1788263319.442299:0:8884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263319.442344:0:8884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666fbf9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ff4a expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.442485:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031a00/0x4b1103cba666fc00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.442503:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031a00/0x4b1103cba666fc00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.442528:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031a00/0x4b1103cba666fc00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263319.442564:0:8884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788263319.442569:0:8884:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788263319.442622:0:8884:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031a00/0x4b1103cba666fc00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.442655:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba666fbf9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff4a expref: 59 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.442677:0:8884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031a00/0x4b1103cba666fc00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff4a expref: 58 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.442687:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:3.0:1788263319.442690:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263319.442694:0:8884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff380031a00, rc 0) 00000100:00100000:3.0:1788263319.442774:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+58:11357:x1875129699200512:12345-192.168.203.26@tcp:101:bash.0 Request processed in 518us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263319.442781:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 118 00000100:00100000:1.0:1788263319.447287:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263319.447443:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699200768 00000100:00100000:0.0:1788263319.447457:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699200768 00000100:00100000:0.0:1788263319.447543:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:0.0:1788263319.447556:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+58:11357:x1875129699200768:12345-192.168.203.26@tcp:35:bash.0 00000100:00100000:0.0:1788263319.447918:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+59:11357:x1875129699200768:12345-192.168.203.26@tcp:35:bash.0 Request processed in 363us (653us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1788263319.447927:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:2.0:1788263319.525999:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263319.526129:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699200896 00000100:00100000:0.0:1788263319.526143:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699200896 00000100:00100000:0.0:1788263319.526216:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 119 00000100:00100000:0.0:1788263319.526227:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+59:11363:x1875129699200896:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788263319.526258:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263319.526296:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fc07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ff51 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.526385:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fc0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.526403:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fc0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.526418:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fc0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263319.526499:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788263319.526503:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788263319.526530:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fc0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.526560:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fc07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff51 expref: 61 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.526657:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fc0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff51 expref: 60 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263319.526667:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:0.0:1788263319.526670:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788263319.526674:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3829e9400, rc 0) 00000100:00100000:0.0:1788263319.526752:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+60:11363:x1875129699200896:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 525us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263319.526759:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 119 00000100:00100000:1.0:1788263319.539911:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263319.540018:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699201024 00000100:00100000:3.0:1788263319.540053:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699201024 00000100:00100000:3.0:1788263319.540141:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 120 00000100:00100000:3.0:1788263319.540153:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+60:11363:x1875129699201024:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788263319.540179:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263319.540207:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380030800/0x4b1103cba666fc15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ff58 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540300:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031200/0x4b1103cba666fc1c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540318:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031200/0x4b1103cba666fc1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540332:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031200/0x4b1103cba666fc1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540344:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031e00/0x4b1103cba666fc23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540352:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031e00/0x4b1103cba666fc23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540359:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031e00/0x4b1103cba666fc23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540457:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666fc2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540467:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666fc2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540474:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666fc2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263319.540536:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788263319.540541:0:10388:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788263319.540565:0:10388:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666fc2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540632:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666fc2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540642:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031200/0x4b1103cba666fc1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540648:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031200/0x4b1103cba666fc1c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540656:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031200/0x4b1103cba666fc1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540662:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff380031200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263319.540667:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031200/0x4b1103cba666fc1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540675:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031200/0x4b1103cba666fc1c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540689:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:3.0:1788263319.540692:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263319.540699:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031200/0x4b1103cba666fc1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540705:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031200/0x4b1103cba666fc1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540736:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031e00/0x4b1103cba666fc23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540742:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031e00/0x4b1103cba666fc23 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540749:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031e00/0x4b1103cba666fc23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540754:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff380031e00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263319.540757:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031e00/0x4b1103cba666fc23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540763:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031e00/0x4b1103cba666fc23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540771:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ff28227ab00) 00010000:00010000:3.0:1788263319.540773:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263319.540776:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031e00/0x4b1103cba666fc23 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540781:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031e00/0x4b1103cba666fc23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540812:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380030800/0x4b1103cba666fc15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff58 expref: 62 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540829:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666fc2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff58 expref: 61 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.540848:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:3.0:1788263319.540850:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263319.540853:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150e600, rc 0) 00000100:00100000:3.0:1788263319.541140:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+61:11363:x1875129699201024:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 987us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263319.541150:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 120 00000100:00100000:1.0:1788263319.548365:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263319.548462:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263319.548688:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699201408 00000100:00100000:2.0:1788263319.548701:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699201408 00000100:00100000:2.0:1788263319.548783:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:2.0:1788263319.548796:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398741880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+61:2387:x1875129699201408:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263319.548816:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263319.548849:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666fc2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff58 expref: 61 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263319.548873:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:2.0:1788263319.548878:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263319.548957:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398741880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+60:2387:x1875129699201408:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 163us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263319.548967:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:3.0:1788263319.550912:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699201280 00000100:00100000:3.0:1788263319.550931:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699201280 00000100:00100000:3.0:1788263319.551033:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 121 00000100:00100000:3.0:1788263319.551044:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+60:11363:x1875129699201280:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788263319.551070:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263319.551096:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e000/0x4b1103cba666fc31 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ff5f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.551250:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666fc38 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.551278:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031a00/0x4b1103cba666fc00 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff4a expref: 61 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.551290:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666fc38 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.551336:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031a00/0x4b1103cba666fc00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff4a expref: 61 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.551352:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031a00/0x4b1103cba666fc00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff4a expref: 61 pid: 8884 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263319.551386:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff38767b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6493:1875129709765632:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788263319.557941:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28323ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263319.558228:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263319.558307:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699201536 00000100:00100000:2.0:1788263319.558318:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699201536 00010000:00010000:2.0:1788263319.558369:0:9493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031a00/0x4b1103cba666fc00 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff4a expref: 62 pid: 8884 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263319.558418:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 70 00000100:00100000:2.0:1788263319.558429:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398742300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+62:2386:x1875129699201536:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263319.558447:0:9493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263319.558455:0:9493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031a00/0x4b1103cba666fc00 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff4a expref: 62 pid: 8884 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263319.558471:0:9493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031a00/0x4b1103cba666fc00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff4a expref: 62 pid: 8884 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263319.558499:0:9493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:2.0:1788263319.558506:0:9493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666fc38 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263319.558517:0:9493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666fc38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263319.558526:0:9493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666fc38 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263319.558546:0:9493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263319.558630:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398742300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+62:2386:x1875129699201536:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 202us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263319.558656:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 70 00010000:00010000:3.0:1788263319.559093:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031a00/0x4b1103cba666fc00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff4a expref: 61 pid: 8884 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263319.559130:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff38767b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6493:1875129709765632:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263319.559160:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666fc38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.559171:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666fc38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.559177:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666fc38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263319.559201:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788263319.559388:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e000/0x4b1103cba666fc31 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff5f expref: 62 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.559406:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666fc38 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff5f expref: 61 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.559414:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:3.0:1788263319.559417:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788263319.559420:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150e800, rc 0) 00000100:00100000:3.0:1788263319.559456:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+61:11363:x1875129699201280:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 8415us (11106us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1788263319.559477:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 121 00000100:00100000:2.0:1788263319.566136:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263319.566431:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699201792 00000100:00100000:3.0:1788263319.566445:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699201792 00000100:00100000:3.0:1788263319.566538:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:3.0:1788263319.566550:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+61:11363:x1875129699201792:12345-192.168.203.26@tcp:103:lfs.0 00010000:00010000:3.0:1788263319.566571:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263319.566646:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeda00/0x4b1103cba666fb89 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff2e expref: 61 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.566673:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:3.0:1788263319.566679:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263319.566749:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+60:11363:x1875129699201792:12345-192.168.203.26@tcp:103:lfs.0 Request processed in 201us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263319.566758:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:1.0:1788263319.575045:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263319.575336:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699201920 00000100:00100000:2.0:1788263319.575350:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699201920 00000100:00100000:2.0:1788263319.575536:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 122 00000100:00100000:2.0:1788263319.575549:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+60:11363:x1875129699201920:12345-192.168.203.26@tcp:58:lfs.0 00010000:00010000:2.0:1788263319.575869:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666fc46 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263319.575892:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666fc46 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263319.575907:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666fc46 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788263319.576396:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788263319.578389:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+60:11363:x1875129699201920:12345-192.168.203.26@tcp:58:lfs.0 Request processed in 2829us (3423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263319.578456:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 122 00000100:00100000:1.0:1788263319.582818:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263319.582922:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699202048 00000100:00100000:3.0:1788263319.582934:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699202048 00000100:00100000:3.0:1788263319.583010:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 123 00000100:00100000:3.0:1788263319.583023:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+60:11363:x1875129699202048:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788263319.583050:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263319.583076:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e000/0x4b1103cba666fc4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ff66 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.583368:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666fc46 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.583382:0:10388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e000/0x4b1103cba666fc4d lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff66 expref: 61 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.583630:0:10388:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666fc46 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.583651:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e000/0x4b1103cba666fc4d lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff66 expref: 61 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.583668:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:3.0:1788263319.583671:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788263319.583676:0:10388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e000/0x4b1103cba666fc4d lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff66 expref: 61 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263319.583685:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150e000, rc 0) 00000100:00100000:3.0:1788263319.583775:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+61:11363:x1875129699202048:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 754us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263319.583784:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 123 00000100:00100000:2.0:1788263319.599930:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263319.599960:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709765760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788263319.600059:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263319.600281:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709765760 00000100:00100000:0.0:1788263319.600293:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709765760 00000100:00100000:0.0:1788263319.600360:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788263319.600372:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709765760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788263319.600398:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263319.600461:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709765760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263319.600468:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788263319.600871:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709765760:0@lo:13:osp-pre-1-1.0 00000004:00080000:1.0:1788263320.112408:0:8610:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 329183826412ns, next at 330183822722ns, rc = 0 00000100:00100000:3.0:1788263320.112439:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709765888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788263320.112552:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709766016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788263320.112555:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263320.112708:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709765888 00000100:00100000:3.0:1788263320.112720:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709765888 00000100:00100000:0.0:1788263320.112747:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263320.112787:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709766016 00000100:00100000:3.0:1788263320.112792:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709766016 00000100:00100000:1.0:1788263320.113739:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788263320.113764:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38767b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709765888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788263320.113794:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788263320.113868:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38767b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709765888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263320.117391:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788263320.117429:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3621:x1875129709766016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788263320.117471:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788263320.118724:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:1.0:1788263320.118853:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263320.118930:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709765888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788263320.135339:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3621:x1875129709766016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 17920us (22582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263320.135373:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000001:00080000:1.0:1788263320.142385:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1788263320.142406:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1788263320.142824:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709766016:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788263320.239738:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788263320.495918:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788263320.495927:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788263320.496137:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788263320.496148:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788263320.496304:0:13769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283821c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13769:1875129709766144:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788263320.496487:0:13769:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28213f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263320.525798:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263320.526132:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699202176 00000100:00100000:3.0:1788263320.526145:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699202176 00000100:00100000:3.0:1788263320.526217:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 124 00000100:00100000:3.0:1788263320.526228:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+62:11364:x1875129699202176:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788263320.526276:0:6493:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788263320.526425:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+62:11364:x1875129699202176:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 198us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263320.526433:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 124 00000100:00100000:2.0:1788263320.526865:0:13769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283821c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13769:1875129709766144:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788263320.534313:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263320.534456:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699202304 00000100:00100000:0.0:1788263320.534473:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699202304 00000100:00100000:0.0:1788263320.534556:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 125 00000100:00100000:0.0:1788263320.534568:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+61:11364:x1875129699202304:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788263320.534702:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fc54 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.534724:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fc54 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.534739:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fc54 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.534758:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fc5b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.534766:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fc5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.534772:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fc5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.534799:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fc62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.534808:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fc62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.534815:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fc62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263320.534893:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788263320.534898:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788263320.534914:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fc62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.534926:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fc54 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.534934:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fc54 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.534953:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fc54 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.534961:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e8800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263320.534965:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fc54 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.534974:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fc54 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.534990:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ff28314fa00) 00010000:00010000:0.0:1788263320.534993:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263320.534998:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fc54 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.535004:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666fc54 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.535021:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fc5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.535037:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fc5b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.535043:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fc5b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.535049:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17e200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263320.535052:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fc5b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.535058:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fc5b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.535067:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9ff282279200) 00010000:00010000:0.0:1788263320.535070:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263320.535072:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fc5b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.535077:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fc5b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.535093:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fc62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.535099:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fc62 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.535105:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fc62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.535109:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17f800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263320.535118:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fc62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.535125:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fc62 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.535133:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:0.0:1788263320.535135:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263320.535138:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fc62 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.535144:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fc62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263320.535243:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+61:11364:x1875129699202304:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 Request processed in 676us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263320.535252:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 125 00000100:00100000:1.0:1788263320.539560:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263320.539893:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699202560 00000100:00100000:3.0:1788263320.539908:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699202560 00000100:00100000:3.0:1788263320.540253:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 126 00000100:00100000:3.0:1788263320.540278:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+61:11364:x1875129699202560:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788263320.540308:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263320.540342:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666fc69 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ff6d expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.540495:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba666fc70 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.540516:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba666fc70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.540531:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba666fc70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263320.540546:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788263320.544485:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba666fc70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.544509:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba666fc70 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.544518:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba666fc70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.544525:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150f600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263320.544530:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba666fc70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.544540:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba666fc70 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.544563:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:3.0:1788263320.544567:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788263320.544572:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba666fc70 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.544597:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba666fc70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.544689:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666fc69 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff6d expref: 63 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.544702:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ff28314fa00) 00010000:00010000:3.0:1788263320.544704:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788263320.544709:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666fc69 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff6d expref: 63 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.544746:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150ee00, rc 0) 00000100:00100000:3.0:1788263320.544847:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+62:11364:x1875129699202560:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 4572us (5300us total) trans 4294967399 rc 301/301 00000100:00100000:3.0:1788263320.544869:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 126 00000100:00100000:1.0:1788263320.560202:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263320.561072:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699202688 00000100:00100000:0.0:1788263320.561087:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699202688 00000100:00100000:0.0:1788263320.561181:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 127 00000100:00100000:0.0:1788263320.561193:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398ccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+62:11364:x1875129699202688:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788263320.561241:0:8884:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788263320.561440:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398ccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+62:11364:x1875129699202688:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 247us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263320.561449:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 127 00000100:00100000:2.0:1788263320.569481:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263320.571212:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699202944 00000100:00100000:3.0:1788263320.571232:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699202944 00000100:00100000:3.0:1788263320.571329:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 128 00000100:00100000:3.0:1788263320.571342:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+62:11364:x1875129699202944:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788263320.571369:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263320.571373:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788263320.571412:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666fc0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff51 expref: 62 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.571438:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:3.0:1788263320.571444:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263320.571460:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666fc7e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ff74 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788263320.579667:0:6492:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788263320.583011:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fc85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.583044:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fc85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.583084:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fc85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.583248:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666fc7e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff74 expref: 64 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.583289:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fc85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff74 expref: 63 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.583300:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ff282279200) 00010000:00010000:0.0:1788263320.583303:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263320.583307:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17f800, rc 0) 00000100:00100000:0.0:1788263320.583424:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+63:11364:x1875129699202944:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 12083us (13956us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788263320.583434:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 128 00000100:00100000:1.0:1788263320.594892:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263320.596453:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699203200 00000100:00100000:3.0:1788263320.596474:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699203200 00000100:00100000:2.0:1788263320.597472:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 129 00000100:00100000:2.0:1788263320.597501:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+63:11364:x1875129699203200:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788263320.599697:0:10388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263320.599739:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fc85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff74 expref: 63 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.599765:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ff282279200) 00010000:00010000:2.0:1788263320.599775:0:10388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788263320.600661:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666fc93 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.600680:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666fc93 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.600692:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666fc93 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.600748:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666fc9a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x3a7155b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.600757:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666fc9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3a7155b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.600764:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666fc9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3a7155b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.600815:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666fc93 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.600824:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666fc93 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.600848:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666fc93 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.600866:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263320.600871:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666fc93 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.600878:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666fc93 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.600889:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:2.0:1788263320.600892:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263320.600895:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666fc93 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.600902:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666fc93 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.600918:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666fc9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3a7155b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.600924:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666fc9a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3a7155b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.600930:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666fc9a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3a7155b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.600935:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1e00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263320.600937:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666fc9a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3a7155b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.600952:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666fc9a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3a7155b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.600960:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x3a7155b1 (ffff9ff28227a000) 00010000:00010000:2.0:1788263320.600962:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263320.600965:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666fc9a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x3a7155b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.600971:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba666fc9a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x3a7155b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263320.601067:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+62:11364:x1875129699203200:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 3569us (6254us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788263320.601077:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 129 00000100:00100000:1.0:1788263320.605949:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263320.608328:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699203328 00000100:00100000:2.0:1788263320.608345:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699203328 00000100:00100000:2.0:1788263320.608428:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 130 00000100:00100000:2.0:1788263320.608441:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+62:11364:x1875129699203328:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788263320.608461:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263320.608486:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fca1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ff7b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.608522:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666fca8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.608535:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666fca8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.608546:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666fca8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.608678:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fca1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff7b expref: 64 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.608697:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666fca8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff7b expref: 63 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.608706:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ff28227a100) 00010000:00010000:2.0:1788263320.608708:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788263320.608712:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d0200, rc 0) 00000100:00100000:2.0:1788263320.608796:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+63:11364:x1875129699203328:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 357us (2861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263320.608804:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 130 00000100:00100000:1.0:1788263320.624826:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263320.631703:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699203584 00000100:00100000:0.0:1788263320.631717:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699203584 00000100:00100000:0.0:1788263320.631784:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 131 00000100:00100000:0.0:1788263320.631794:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+63:11364:x1875129699203584:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788263320.631883:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fcaf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.631901:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fcaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.631914:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fcaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788263320.632080:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1788263320.632092:0:6492:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 329703512050ns, next at 330703509018ns, rc = 0 00000004:00010000:0.0:1788263320.632143:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000912039b3 reply state 000000007a9d9124 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fcaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.633042:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fcaf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.633049:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ff28227a100) 00010000:00010000:0.0:1788263320.633052:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788263320.633055:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788263320.633172:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+65:11364:x1875129699203584:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 1377us (8353us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788263320.633180:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 131 00000100:00100000:3.0:1788263320.651714:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263320.652009:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699203712 00000100:00100000:2.0:1788263320.652024:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699203712 00000100:00100000:2.0:1788263320.652094:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 132 00000100:00100000:2.0:1788263320.652105:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+65:11364:x1875129699203712:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788263320.652128:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263320.652147:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fcb6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ff82 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.652215:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fcb6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff82 expref: 66 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.652229:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fcb6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff82 expref: 66 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.652289:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ff28227a100) 00010000:00010000:2.0:1788263320.652292:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263320.652296:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d0a00, rc 0) 00000100:00100000:2.0:1788263320.652371:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+66:11364:x1875129699203712:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 267us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263320.652378:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 132 00000100:00100000:1.0:1788263320.656655:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263320.661758:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699203840 00000100:00100000:0.0:1788263320.661780:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699203840 00000100:00100000:0.0:1788263320.661891:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 45 00000100:00100000:0.0:1788263320.661904:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2386:x1875129699203840:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788263320.662870:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:2386:x1875129699203840:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 962us (6224us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788263320.662883:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 45 00000100:00080000:1.0:1788263320.663032:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788263320.672763:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263320.672961:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699204096 00000100:00100000:0.0:1788263320.672974:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699204096 00000100:00100000:0.0:1788263320.673055:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 30 00000100:00100000:0.0:1788263320.673067:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+66:11364:x1875129699204096:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788263320.673399:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+67:11364:x1875129699204096:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 333us (649us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1788263320.673427:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 30 00000100:00100000:1.0:1788263320.681865:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263320.683432:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699204352 00000100:00100000:3.0:1788263320.683448:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699204352 00000100:00100000:3.0:1788263320.683548:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 133 00000100:00100000:3.0:1788263320.683559:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+67:11364:x1875129699204352:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788263320.683766:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+67:11364:x1875129699204352:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 208us (1916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263320.683774:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 133 00000100:00100000:1.0:1788263320.693679:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263320.693883:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699204480 00000100:00100000:0.0:1788263320.693896:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699204480 00000100:00100000:0.0:1788263320.693965:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 134 00000100:00100000:0.0:1788263320.693977:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+67:11364:x1875129699204480:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788263320.694004:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263320.694031:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fcbd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ff89 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.694135:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fcc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.694152:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fcc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.694167:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fcc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263320.694224:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788263320.694248:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fcc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.694292:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fcbd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff89 expref: 69 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.694312:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fcc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff89 expref: 68 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.694322:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ff28227a100) 00010000:00010000:0.0:1788263320.694344:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788263320.694349:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17f600, rc 0) 00000100:00100000:0.0:1788263320.694444:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+68:11364:x1875129699204480:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 468us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263320.694452:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 134 00000100:00100000:1.0:1788263320.697546:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263320.697639:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699204608 00000100:00100000:2.0:1788263320.697653:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699204608 00000100:00100000:2.0:1788263320.697716:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 46 00000100:00100000:2.0:1788263320.697726:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:2387:x1875129699204608:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788263320.697743:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263320.697764:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042f9c7be/0x4b1103cba666fccb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ff90 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788263320.697801:0:8406:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96bb97, blocks: 0x0 00010000:00010000:2.0:1788263320.697821:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=329s v=(0 0) 00010000:00010000:2.0:1788263320.697825:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263320.697835:0:8406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042f9c7be/0x4b1103cba666fccb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff90 expref: 10 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.697868:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000042f9c7be/0x4b1103cba666fccb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff90 expref: 10 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.697884:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d1e00, rc 0) 00000100:00100000:2.0:1788263320.697962:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+10:2387:x1875129699204608:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 237us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263320.697971:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 46 00000100:00100000:1.0:1788263320.714933:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263320.715085:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699204864 00000100:00100000:0.0:1788263320.715109:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699204864 00000100:00100000:0.0:1788263320.715190:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 135 00000100:00100000:0.0:1788263320.715202:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+68:11364:x1875129699204864:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788263320.715351:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+68:11364:x1875129699204864:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 150us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263320.715360:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 135 00000100:00100000:1.0:1788263320.731247:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263320.731429:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699204992 00000100:00100000:2.0:1788263320.731442:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699204992 00000100:00100000:2.0:1788263320.731526:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 47 00000100:00100000:2.0:1788263320.731538:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385670e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+10:11364:x1875129699204992:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788263320.731561:0:8404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263320.731630:0:8404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031938964/0x4b1103cba666fcd2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ff97 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.731670:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000042f9c7be/0x4b1103cba666fccb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff90 expref: 11 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.731682:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263320.731687:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263320.731706:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031938964/0x4b1103cba666fcd2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff97 expref: 11 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.731776:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000042f9c7be/0x4b1103cba666fccb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff90 expref: 11 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.731793:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000042f9c7be/0x4b1103cba666fccb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff90 expref: 11 pid: 8406 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263320.731812:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1875129709766272:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788263320.731919:0:8404:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff283a5ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263320.738500:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1875129709766272:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788263320.738558:0:8404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000031938964/0x4b1103cba666fcd2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff97 expref: 11 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.738620:0:8404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d0800, rc 0) 00000100:00100000:2.0:1788263320.738993:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385670e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+11:11364:x1875129699204992:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 7454us (7758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263320.739005:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 47 00000100:00100000:1.0:1788263320.743542:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263320.743957:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699205120 00000100:00100000:2.0:1788263320.743972:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699205120 00010000:00010000:2.0:1788263320.744028:0:9493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000042f9c7be/0x4b1103cba666fccb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff90 expref: 11 pid: 8406 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263320.744080:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 71 00000100:00100000:2.0:1788263320.744092:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385671500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+11:2387:x1875129699205120:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263320.744236:0:9493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263320.744274:0:9493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000042f9c7be/0x4b1103cba666fccb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff90 expref: 11 pid: 8406 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.744291:0:9493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000042f9c7be/0x4b1103cba666fccb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff90 expref: 11 pid: 8406 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.744323:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042f9c7be/0x4b1103cba666fccb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff90 expref: 11 pid: 8406 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.744373:0:9493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263320.744378:0:9493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263320.744389:0:9493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000031938964/0x4b1103cba666fcd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff97 expref: 10 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.744412:0:9493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031938964/0x4b1103cba666fcd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff97 expref: 10 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.744462:0:9493:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000031938964/0x4b1103cba666fcd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff97 expref: 10 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263320.744487:0:9493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9493:1875129709766400:192.168.203.26@tcp:105: 00000100:00100000:2.0:1788263320.744911:0:9493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff283a5ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263320.759033:0:9493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9493:1875129709766400:192.168.203.26@tcp:105: 00010000:00010000:2.0:1788263320.759071:0:9493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263320.759175:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385671500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+10:2387:x1875129699205120:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 15083us (15646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263320.759189:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 71 00000100:00100000:3.0:1788263320.768962:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263320.771749:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699205248 00000100:00100000:2.0:1788263320.771762:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699205248 00002000:00100000:2.0:1788263320.771825:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9ff2831f2d80 x1875129699205248/t0(0) o4->ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp:531/0 lens 504/0 e 0 to 0 dl 1788263331 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788263320.771835:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ff2831f2d80 with x1875129699205248 ext(0->12) 00002000:00010000:2.0:1788263320.771841:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ff2831f2d80 00000100:00100000:2.0:1788263320.771909:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:2.0:1788263320.771919:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+10:2387:x1875129699205248:12345-192.168.203.26@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788263320.774359:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+12:2387:x1875129699205248:12345-192.168.203.26@tcp:4:lhsmtool_posix.0 Request processed in 2432us (5450us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788263320.774382:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 2 00002000:00100000:2.0:1788263320.774397:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9ff2831f2d80 x1875129699205248/t4294967309(0) o4->ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp:531/0 lens 504/448 e 0 to 0 dl 1788263331 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788263320.774407:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ff2831f2d80 with x1875129699205248 ext(0->12) 00002000:00010000:2.0:1788263320.774412:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ff2831f2d80 00000100:00100000:1.0:1788263320.799028:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263320.799245:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699205376 00000100:00100000:0.0:1788263320.799267:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699205376 00000100:00100000:0.0:1788263320.799356:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 136 00000100:00100000:0.0:1788263320.799369:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+68:11364:x1875129699205376:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788263320.808880:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1788263320.808910:0:6470:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:2.0:1788263320.808941:0:6470:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:2.0:1788263320.808980:0:6470:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1788263320.808991:0:6470:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ff39aad6780 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1788263320.808996:0:6470:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ff3853efa00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ff39aad6180 00000020:00080000:2.0:1788263320.808999:0:6470:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ff3853ef000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ff281dfce00 00000004:00080000:2.0:1788263320.809043:0:6470:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788263320.809072:0:6470:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ff3a27c99c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788263320.809076:0:6470:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ff3853efd00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ff398e9ee40 00000020:00080000:2.0:1788263320.809079:0:6470:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ff3853ef500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ff283131600 00000020:00080000:2.0:1788263320.809138:0:6523:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788263320.809230:0:6523:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788263320.809297:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709766528:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788263320.809462:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283ae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709766656:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788263320.811768:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263320.811950:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709766528 00000100:00100000:2.0:1788263320.811963:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709766528 00000100:00100000:2.0:1788263320.812026:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788263320.812037:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3618:x1875129709766528:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788263320.812078:0:9885:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:2.0:1788263320.812126:0:9885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042f9c7be/0x4b1103cba666fcd9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.812154:0:9885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b8de930/0x4b1103cba666fa8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116feef expref: 11 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.812165:0:9885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788263320.812171:0:9885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788263320.812176:0:9885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042f9c7be/0x4b1103cba666fcd9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.812216:0:9885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b8de930/0x4b1103cba666fa8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.26@tcp remote: 0xd405f293d116feef expref: 11 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.812234:0:9885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b8de930/0x4b1103cba666fa8d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.26@tcp remote: 0xd405f293d116feef expref: 11 pid: 8405 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263320.812252:0:9885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9885:1875129709766912:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788263320.812337:0:9885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff283a5ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263320.813067:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:11364:x1875129699205376:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 Request processed in 13689us (14051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263320.813084:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 136 00000100:00100000:0.0:1788263320.813129:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788263320.813147:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709766784:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788263320.813207:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263320.814022:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709766784 00000100:00100000:0.0:1788263320.814031:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709766784 00000100:00100000:0.0:1788263320.814105:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788263320.814114:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709766784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788263320.814169:0:8405:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:0.0:1788263320.814214:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a96bb95, atime: 0x6a96bb96, ctime: 0x6a96bb95, blocks: 0x8 00010000:00010000:0.0:1788263320.814224:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1801e66/0x4b1103cba666fce0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.814246:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=329s v=(0 0) 00010000:00010000:0.0:1788263320.814558:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263320.814566:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1801e66/0x4b1103cba666fce0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.814603:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1801e66/0x4b1103cba666fce0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.814614:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1801e66/0x4b1103cba666fce0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.814624:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1801e66/0x4b1103cba666fce0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.814655:0:8405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263320.814680:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263320.814705:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1801e66/0x4b1103cba666fce0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.814739:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17e400 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:2.0:1788263320.814744:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1801e66/0x4b1103cba666fce0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.814755:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1801e66/0x4b1103cba666fce0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.814779:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1801e66/0x4b1103cba666fce0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.814787:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1801e66/0x4b1103cba666fce0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.814815:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263320.814817:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263320.814820:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263320.814985:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1875129709766784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 870us (1774us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788263320.815000:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788263320.818855:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788263320.818873:0:3621:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967304 00000004:00080000:2.0:1788263320.818912:0:3621:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ff398661500, transno 4294967302 00000004:00080000:2.0:1788263320.818935:0:3621:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967304 00000100:00100000:2.0:1788263320.818959:0:3621:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9ff28178dc00 x1875129709766784/t4294967305(4294967305) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788263336 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788263320.818973:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ff28178dc00/2, rc 0, transno 4294967305 00000100:00100000:2.0:1788263320.818980:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709766784:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788263320.823611:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263320.823684:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709766656 00000100:00100000:2.0:1788263320.823711:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709766656 00000100:00100000:2.0:1788263320.823768:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788263320.823780:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3619:x1875129709766656:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788263320.823929:0:8406:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788263320.823934:0:8406:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788263320 00002000:00010000:2.0:1788263320.823936:0:8406:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788263320.823938:0:8406:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788263319 -> 1788263320 00002000:00010000:2.0:1788263320.823941:0:8406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788263320.823985:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3619:x1875129709766656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 207us (406us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788263320.823992:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:2.0:1788263320.824065:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ff283ae9180/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788263320.824072:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283ae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709766656:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788263320.831219:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f9d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831238:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f9d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831247:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f9d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831253:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eeca00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263320.831266:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f9d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831285:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f9d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831304:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9ff3986d8a00) 00010000:00010000:1.0:1788263320.831307:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263320.831312:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f9d7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831318:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba666f9d7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831390:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fa7f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831638:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fa7f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831645:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fa7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831650:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1000 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263320.831653:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fa7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831659:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fa7f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831713:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9ff388845f00) 00010000:00010000:1.0:1788263320.831715:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263320.831719:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fa7f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831725:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fa7f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831757:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fafd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831764:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fafd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831770:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fafd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831782:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263320.831785:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fafd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831790:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fafd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831799:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ff28227ab00) 00010000:00010000:1.0:1788263320.831801:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263320.831804:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fafd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831809:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fafd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831820:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666fb20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831824:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666fb20 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831829:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666fb20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831834:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17e600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263320.831837:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666fb20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831842:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666fb20 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831916:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ff28227ab00) 00010000:00010000:1.0:1788263320.831919:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263320.831921:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666fb20 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831927:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666fb20 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831942:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666fbf2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831947:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666fbf2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831952:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666fbf2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831957:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0e00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263320.831959:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666fbf2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831964:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666fbf2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831970:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:1.0:1788263320.831972:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263320.831974:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666fbf2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831979:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666fbf2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.831995:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fcaf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.832001:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fcaf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.832006:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fcaf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.832010:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17e200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263320.832013:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fcaf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.832018:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fcaf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.832024:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ff28227a100) 00010000:00010000:1.0:1788263320.832026:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788263320.832028:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fcaf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.832034:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fcaf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263320.841810:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263320.841861:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263320.841915:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699205632 00000100:00100000:0.0:1788263320.841926:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699205632 00000100:00100000:3.0:1788263320.842142:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699205504 00000100:00100000:3.0:1788263320.842147:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699205504 00010000:00010000:3.0:1788263320.842185:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b8de930/0x4b1103cba666fa8d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.26@tcp remote: 0xd405f293d116feef expref: 13 pid: 8405 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263320.842220:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 72 00000100:00100000:3.0:1788263320.842231:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0456850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+13:2387:x1875129699205504:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263320.842251:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263320.842268:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b8de930/0x4b1103cba666fa8d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.26@tcp remote: 0xd405f293d116feef expref: 13 pid: 8405 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.842285:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b8de930/0x4b1103cba666fa8d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.26@tcp remote: 0xd405f293d116feef expref: 13 pid: 8405 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.842318:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788263320.842323:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788263320.842330:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000042f9c7be/0x4b1103cba666fcd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.842340:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042f9c7be/0x4b1103cba666fcd9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.842373:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263320.842443:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0456850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+13:2387:x1875129699205504:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 213us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263320.842451:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 72 00000100:00100000:0.0:1788263320.842781:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 51 00000100:00100000:0.0:1788263320.842796:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+12:2386:x1875129699205632:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1788263320.843040:0:9885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b8de930/0x4b1103cba666fa8d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.26@tcp remote: 0xd405f293d116feef expref: 12 pid: 8405 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263320.843061:0:9885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9885:1875129709766912:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788263320.843085:0:9885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000042f9c7be/0x4b1103cba666fcd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.843111:0:9885:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000042f9c7be/0x4b1103cba666fcd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.843119:0:9885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042f9c7be/0x4b1103cba666fcd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.843145:0:9885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042f9c7be/0x4b1103cba666fcd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.843154:0:9885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042f9c7be/0x4b1103cba666fcd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.843180:0:9885:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788263320.843404:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3618:x1875129709766528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 31368us (31644us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788263320.843413:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000004:00080000:0.0:1788263320.845753:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ff283ae8e00/2, rc 0, transno 4294967311 00000100:00100000:0.0:1788263320.845772:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709766528:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788263320.845939:0:9492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263320.845950:0:9492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042f9c7be/0x4b1103cba666fcd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.845965:0:9492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1e00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263320.845971:0:9492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042f9c7be/0x4b1103cba666fcd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.845984:0:9492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042f9c7be/0x4b1103cba666fcd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.846020:0:9492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042f9c7be/0x4b1103cba666fcd9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.846029:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042f9c7be/0x4b1103cba666fcd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.846054:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263320.846056:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263320.846058:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788263320.851088:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1788263320.851228:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:0.0:1788263320.858640:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2386:x1875129699205632:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 Request processed in 15827us (16757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263320.858661:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 51 00000100:00100000:0.0:1788263320.868250:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263320.868876:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699205888 00000100:00100000:2.0:1788263320.868891:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699205888 00000100:00100000:2.0:1788263320.868969:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 137 00000100:00100000:2.0:1788263320.868981:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+16:11364:x1875129699205888:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788263320.869053:0:10388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263320.869088:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fcc4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff89 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.869130:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ff28227a100) 00010000:00010000:2.0:1788263320.869136:0:10388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788263320.869176:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba666fce7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.869192:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba666fce7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.869224:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba666fce7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788263320.869392:0:10388:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000855b08f6 reply state 00000000c40ea910 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba666fce7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.869407:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba666fce7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.869413:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ff28227a100) 00010000:00010000:2.0:1788263320.869416:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788263320.869419:0:10388:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788263320.872153:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+17:11364:x1875129699205888:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 3157us (3901us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1788263320.872170:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 137 00000100:00100000:2.0:1788263320.879672:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263320.879939:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699206016 00000100:00100000:0.0:1788263320.879953:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699206016 00000100:00100000:0.0:1788263320.880031:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:0.0:1788263320.880042:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2389:x1875129699206016:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788263320.880470:0:8404:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788263320.880474:0:8404:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788263320 -> 1788263318 00002000:00010000:0.0:1788263320.880478:0:8404:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788263318 00002000:00010000:0.0:1788263320.880480:0:8404:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788263320 -> 1788263318 00002000:00010000:0.0:1788263320.880482:0:8404:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788263320.880562:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2389:x1875129699206016:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 520us (903us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788263320.880571:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:3.0:1788263320.889711:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263320.889854:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699206272 00000100:00100000:1.0:1788263320.889866:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699206272 00000100:00100000:1.0:1788263320.889947:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 138 00000100:00100000:1.0:1788263320.889959:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+17:11364:x1875129699206272:12345-192.168.203.26@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788263320.890070:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666fcee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.890092:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666fca8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff7b expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.890103:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666fcee lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.890150:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666fca8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff7b expref: 17 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.890166:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666fca8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff7b expref: 17 pid: 6491 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263320.890183:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385671180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6493:1875129709767040:192.168.203.26@tcp:104: 00000100:00100000:1.0:1788263320.890367:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28213fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788263320.900352:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385671180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6493:1875129709767040:192.168.203.26@tcp:104: 00010000:00010000:1.0:1788263320.900385:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666fcee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263320.909830:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263320.909956:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699206400 00000100:00100000:1.0:1788263320.909976:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699206400 00010000:00010000:1.0:1788263320.910025:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666fca8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff7b expref: 18 pid: 6491 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263320.910076:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 73 00000100:00100000:1.0:1788263320.910086:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+18:2387:x1875129699206400:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263320.910117:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263320.910125:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666fca8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff7b expref: 18 pid: 6491 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.910139:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666fca8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff7b expref: 18 pid: 6491 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.910161:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666fca8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff7b expref: 18 pid: 6491 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.910179:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ff28227a100) 00010000:00010000:1.0:1788263320.910184:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666fcee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.910195:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666fcee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.910203:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666fcee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.910792:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263320.910857:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+17:2387:x1875129699206400:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 771us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263320.910866:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 73 00010000:00010000:0.0:1788263320.910990:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666fcee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.910999:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666fcee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.911037:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666fcee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.911054:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666fcee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.911060:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666fcee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.911066:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381681a00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263320.911070:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666fcee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.911077:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666fcee lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.911088:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ff28227a100) 00010000:00010000:0.0:1788263320.911090:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788263320.911094:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666fcee lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.911100:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba666fcee lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263320.911143:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+16:11364:x1875129699206272:12345-192.168.203.26@tcp:55:lhsmtool_posix.0 Request processed in 21186us (21447us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788263320.911150:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 138 00000100:00100000:2.0:1788263320.914111:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263320.914316:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699206528 00000100:00100000:3.0:1788263320.914330:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699206528 00000100:00100000:3.0:1788263320.914397:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:3.0:1788263320.914409:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2386:x1875129699206528:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788263320.914467:0:9885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004fda1e11/0x4b1103cba666fcf5 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.914494:0:9885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000031938964/0x4b1103cba666fcd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff97 expref: 7 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.914503:0:9885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263320.914518:0:9885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788263320.914524:0:9885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fda1e11/0x4b1103cba666fcf5 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.914572:0:9885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000031938964/0x4b1103cba666fcd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff97 expref: 7 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.914626:0:9885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000031938964/0x4b1103cba666fcd2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff97 expref: 7 pid: 8404 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263320.914645:0:9885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3856a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9885:1875129709767168:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788263320.914761:0:9885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28323e840 going to sleep for 11 seconds 00000100:00100000:2.0:1788263320.923910:0:9885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3856a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9885:1875129709767168:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788263320.923950:0:9885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004fda1e11/0x4b1103cba666fcf5 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263320.929004:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263320.930062:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699206656 00000100:00100000:3.0:1788263320.930076:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699206656 00010000:00010000:3.0:1788263320.930318:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000031938964/0x4b1103cba666fcd2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff97 expref: 8 pid: 8404 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263320.930441:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 74 00000100:00100000:3.0:1788263320.930454:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2387:x1875129699206656:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263320.930474:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263320.930503:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 0000000031938964/0x4b1103cba666fcd2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff97 expref: 8 pid: 8404 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.930530:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000031938964/0x4b1103cba666fcd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff97 expref: 8 pid: 8404 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.930564:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031938964/0x4b1103cba666fcd2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff97 expref: 8 pid: 8404 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.930637:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1788263320.930644:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788263320.930651:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004fda1e11/0x4b1103cba666fcf5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.930664:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fda1e11/0x4b1103cba666fcf5 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.930710:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263320.930786:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2387:x1875129699206656:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 334us (1796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263320.930795:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 74 00010000:00010000:2.0:1788263320.931048:0:9885:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004fda1e11/0x4b1103cba666fcf5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.931058:0:9885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fda1e11/0x4b1103cba666fcf5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.931094:0:9885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004fda1e11/0x4b1103cba666fcf5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.932517:0:9885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fda1e11/0x4b1103cba666fcf5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.932533:0:9885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fda1e11/0x4b1103cba666fcf5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.932542:0:9885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150f600 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:2.0:1788263320.932547:0:9885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fda1e11/0x4b1103cba666fcf5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.932558:0:9885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fda1e11/0x4b1103cba666fcf5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.932593:0:9885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fda1e11/0x4b1103cba666fcf5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263320.932602:0:9885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fda1e11/0x4b1103cba666fcf5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263320.932732:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2386:x1875129699206528:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 Request processed in 18320us (18643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263320.932744:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:2.0:1788263320.941193:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263320.941431:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699206912 00000100:00100000:3.0:1788263320.941445:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699206912 00000100:00100000:3.0:1788263320.941527:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 139 00000100:00100000:3.0:1788263320.941540:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+16:11364:x1875129699206912:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788263320.941668:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fcfc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.941704:0:8884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666fbeb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff43 expref: 16 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.941716:0:8884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fcfc lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.941760:0:8884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666fbeb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff43 expref: 16 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.941776:0:8884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666fbeb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff43 expref: 16 pid: 6493 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263320.941795:0:8884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3856a2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8884:1875129709767296:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788263320.941902:0:8884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28323e840 going to sleep for 11 seconds 00000100:00100000:2.0:1788263320.945754:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263320.946052:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699207040 00000100:00100000:1.0:1788263320.946065:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699207040 00010000:00010000:1.0:1788263320.946124:0:9493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666fbeb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff43 expref: 17 pid: 6493 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263320.946188:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 75 00000100:00100000:1.0:1788263320.946200:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387617100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+17:2386:x1875129699207040:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263320.946218:0:9493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263320.946226:0:9493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666fbeb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff43 expref: 17 pid: 6493 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.946240:0:9493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666fbeb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff43 expref: 17 pid: 6493 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.946277:0:9493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:1.0:1788263320.946284:0:9493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e000/0x4b1103cba666fc4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff66 expref: 17 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.946297:0:9493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fcfc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.946306:0:9493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fcfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.946315:0:9493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fcfc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.946338:0:9493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263320.946399:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387617100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+17:2386:x1875129699207040:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 201us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263320.946408:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 75 00010000:00010000:3.0:1788263320.946914:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba666fbeb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff43 expref: 16 pid: 6493 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263320.946937:0:8884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3856a2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8884:1875129709767296:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263320.946964:0:8884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fcfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.946990:0:8884:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fcfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.946997:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fcfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.947232:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666fd03 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.947246:0:8884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fcb6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff82 expref: 16 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.947265:0:8884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666fd03 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.947302:0:8884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fcb6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff82 expref: 16 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.947320:0:8884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fcb6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff82 expref: 16 pid: 10388 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263320.947336:0:8884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3856a2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8884:1875129709767424:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788263320.947425:0:8884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39873bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788263320.955347:0:8884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3856a2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8884:1875129709767424:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263320.955377:0:8884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666fd03 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263320.955976:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263320.956893:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699207168 00000100:00100000:3.0:1788263320.956922:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699207168 00010000:00010000:3.0:1788263320.956974:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fcb6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff82 expref: 17 pid: 10388 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263320.957088:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 76 00000100:00100000:3.0:1788263320.957390:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385671180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+17:2387:x1875129699207168:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263320.957412:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263320.957420:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fcb6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff82 expref: 17 pid: 10388 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.957436:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fcb6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff82 expref: 17 pid: 10388 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.957462:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fcb6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff82 expref: 17 pid: 10388 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.957483:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ff28227a100) 00010000:00010000:3.0:1788263320.957489:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666fd03 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.957500:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666fd03 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.957520:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666fd03 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.957558:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263320.957663:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385671180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+16:2387:x1875129699207168:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 564us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263320.957685:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 76 00010000:00010000:1.0:1788263320.957972:0:8884:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666fd03 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.957981:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666fd03 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788263320.958377:0:8884:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1788263320.958518:0:8884:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1788263320.958557:0:8884:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1788263320.958676:0:8884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385671500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8884:1875129709767552:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788263320.964720:0:8884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263320.964769:0:8884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28213fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788263320.966654:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709767552 00000100:00100000:0.0:1788263320.966670:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709767552 00000100:00100000:0.0:1788263320.966749:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788263320.966760:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8884:x1875129709767552:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788263320.966955:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8884:x1875129709767552:12345-0@lo:1000:mdt00_003.0 Request processed in 195us (2246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263320.966969:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788263320.968727:0:8884:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1788263320.968742:0:8884:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:1.0:1788263320.968769:0:8884:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ff283ae9180, transno 4294967310 00000004:00080000:1.0:1788263320.968779:0:8884:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ff283ae8e00, transno 4294967311 00000100:00100000:1.0:1788263320.968789:0:8884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385671500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8884:1875129709767552:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788263320.968990:0:8884:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1788263320.969438:0:8884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8884:1875129709767680:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788263320.969899:0:8884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263320.969934:0:8884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28213f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788263320.972716:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709767680 00000100:00100000:0.0:1788263320.972734:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709767680 00000100:00100000:0.0:1788263320.972820:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788263320.972832:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8884:x1875129709767680:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788263320.973102:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8884:x1875129709767680:12345-0@lo:1000:mdt00_003.0 Request processed in 264us (3196us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788263320.973399:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788263320.973906:0:8884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8884:1875129709767680:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788263320.973973:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666fd03 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.973986:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666fd03 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.973994:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666fd03 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.974310:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150e400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263320.974315:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666fd03 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.974324:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666fd03 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.974345:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ff28227a100) 00010000:00010000:1.0:1788263320.974349:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788263320.974354:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666fd03 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.974361:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666fd03 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.974394:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666fc46 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.974401:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666fc46 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.974408:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666fc46 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.974413:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263320.974417:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666fc46 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.974423:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666fc46 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.974444:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:1.0:1788263320.974447:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788263320.974454:0:8884:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e000/0x4b1103cba666fc4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff66 expref: 19 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.974467:0:8884:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e000/0x4b1103cba666fc4d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff66 expref: 19 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.974478:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e000/0x4b1103cba666fc4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff66 expref: 19 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263320.975992:0:8884:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e000/0x4b1103cba666fc4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff66 expref: 19 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263320.976030:0:8884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833d9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8884:1875129709767808:192.168.203.26@tcp:105: 00000100:00100000:1.0:1788263320.976169:0:8884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28213f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788263320.983150:0:8884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833d9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8884:1875129709767808:192.168.203.26@tcp:105: 00010000:00010000:3.0:1788263320.983189:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666fc46 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.983202:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666fc46 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.983242:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ea00/0x4b1103cba666fd0a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.983266:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ea00/0x4b1103cba666fd0a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.983280:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ea00/0x4b1103cba666fd0a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.983293:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ea00/0x4b1103cba666fd0a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.983300:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ea00/0x4b1103cba666fd0a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.983308:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ea00/0x4b1103cba666fd0a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.983313:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150ea00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263320.983317:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ea00/0x4b1103cba666fd0a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.983325:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ea00/0x4b1103cba666fd0a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.983354:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:3.0:1788263320.983357:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263320.983361:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ea00/0x4b1103cba666fd0a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.983368:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ea00/0x4b1103cba666fd0a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.983379:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fcfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.983384:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fcfc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.983390:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fcfc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.983396:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150f000 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263320.983399:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fcfc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.983405:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fcfc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.983411:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:3.0:1788263320.983413:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788263320.983416:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fcfc lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263320.983421:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fcfc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263320.983663:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+19:11364:x1875129699206912:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 42124us (42481us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1788263320.983674:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 139 00000020:00080000:3.0:1788263320.983682:0:8884:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788263320.984117:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788263320.984123:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788263320.984658:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788263320.984668:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788263320.988932:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263320.989252:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699207296 00000100:00100000:0.0:1788263320.989275:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699207296 00000100:00100000:0.0:1788263320.989343:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 31 00000100:00100000:0.0:1788263320.989355:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+19:11363:x1875129699207296:12345-192.168.203.26@tcp:49:lfs.0 00000100:00100000:0.0:1788263320.989525:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+19:11363:x1875129699207296:12345-192.168.203.26@tcp:49:lfs.0 Request processed in 172us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263320.989534:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 31 00000100:00100000:2.0:1788263320.997917:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263320.998556:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699207552 00000100:00100000:0.0:1788263320.998571:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699207552 00000100:00100000:0.0:1788263320.998664:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 32 00000100:00100000:0.0:1788263320.998675:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a973cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+19:11364:x1875129699207552:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788263320.998990:0:6495:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788263320.999084:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1788263320.999574:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fd11 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.999635:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fd11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.999671:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fd11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.999681:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fd11 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.999687:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fd11 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.999694:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fd11 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263320.999716:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788263320.999829:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a973cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+21:11364:x1875129699207552:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 1152us (1924us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1788263320.999839:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 32 00000020:00080000:0.0:1788263320.999845:0:6495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788263321.000004:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263321.000141:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699207808 00000100:00100000:0.0:1788263321.000148:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699207808 00000100:00100000:0.0:1788263321.000188:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 140 00000100:00100000:0.0:1788263321.000196:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+21:11363:x1875129699207808:12345-192.168.203.26@tcp:58:lfs.0 00000040:00080000:0.0:1788263321.000352:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788263321.000395:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+21:11363:x1875129699207808:12345-192.168.203.26@tcp:58:lfs.0 Request processed in 200us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263321.000403:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 140 00010000:00010000:1.0:1788263321.000700:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263321.000709:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fd11 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263321.000718:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17f800 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:1.0:1788263321.000723:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fd11 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263321.000732:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fd11 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263321.000749:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ff28227a100) 00010000:00010000:1.0:1788263321.000764:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788263321.000770:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fd11 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263321.000777:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fd11 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263321.000793:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263321.000795:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263321.000797:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263321.073710:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263321.073974:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699207936 00000100:00100000:0.0:1788263321.073987:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699207936 00000100:00100000:0.0:1788263321.074087:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 141 00000100:00100000:0.0:1788263321.074107:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+21:11366:x1875129699207936:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788263321.074160:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263321.074188:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fd18 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ff9e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.074299:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fd1f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.074317:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fd1f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.074331:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fd1f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.074348:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fd26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.074355:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fd26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.074363:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fd26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.074461:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666fd2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.074474:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666fc38 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff5f expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.074483:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666fd2d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.074523:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666fc38 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff5f expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.074547:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666fc38 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff5f expref: 22 pid: 6493 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263321.074564:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283ae9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6493:1875129709767936:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788263321.075091:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3851fd180 going to sleep for 11 seconds 00000100:00080000:1.0:1788263321.075417:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263321.081434:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263321.081561:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699208192 00000100:00100000:1.0:1788263321.081575:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699208192 00000100:00100000:1.0:1788263321.081704:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:1.0:1788263321.081716:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+23:10746:x1875129699208192:12345-192.168.203.26@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788263321.082010:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+24:10746:x1875129699208192:12345-192.168.203.26@tcp:35:ldlm_bl.0 Request processed in 295us (593us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788263321.082019:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:0.0:1788263321.082654:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283ae9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6493:1875129709767936:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788263321.082689:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666fd2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263321.085496:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263321.085626:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699208320 00000100:00100000:1.0:1788263321.085638:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699208320 00010000:00010000:1.0:1788263321.085689:0:9493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666fc38 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff5f expref: 24 pid: 6493 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263321.085745:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 77 00000100:00100000:1.0:1788263321.085756:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+24:2387:x1875129699208320:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263321.085775:0:9493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263321.085783:0:9493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666fc38 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff5f expref: 24 pid: 6493 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263321.085818:0:9493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666fc38 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff5f expref: 24 pid: 6493 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263321.085845:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666fc38 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff5f expref: 24 pid: 6493 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263321.085866:0:9493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:1.0:1788263321.085872:0:9493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666fd2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263321.085883:0:9493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666fd2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263321.085892:0:9493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666fd2d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263321.085930:0:9493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263321.086113:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+23:2387:x1875129699208320:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 357us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263321.086122:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 77 00010000:00010000:0.0:1788263321.086221:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666fd2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.086230:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666fd2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263321.086304:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788263321.086310:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788263321.086336:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666fd2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.086351:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666fd2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.086362:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fd1f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.086370:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fd1f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.086389:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fd1f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.086395:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17f600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263321.086400:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fd1f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.086409:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fd1f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.086420:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:0.0:1788263321.086424:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263321.086428:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fd1f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.086435:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fd1f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.086449:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fd26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.086456:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fd26 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.086462:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fd26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.086468:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17e200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263321.086471:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fd26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.086487:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fd26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.086496:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9ff282279300) 00010000:00010000:0.0:1788263321.086498:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263321.086501:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fd26 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.086517:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fd26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.086563:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fd18 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff9e expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.086616:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666fd2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff9e expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263321.086625:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:0.0:1788263321.086628:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263321.086631:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17e600, rc 0) 00000100:00100000:0.0:1788263321.086664:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:11366:x1875129699207936:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 12568us (12984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263321.086672:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 141 00010000:00010000:3.0:1788263321.287956:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263321.722157:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263321.722238:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263321.722301:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263321.722334:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263321.722364:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263321.722437:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699208448 00000100:00100000:1.0:1788263321.722449:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699208448 00000100:00100000:1.0:1788263321.722508:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 387 00000100:00100000:1.0:1788263321.722521:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2386:x1875129699208448:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263321.722638:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2386:x1875129699208448:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 119us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263321.722645:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 387 00000100:00100000:1.0:1788263321.722864:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699208704 00000100:00100000:1.0:1788263321.722869:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699208704 00000100:00100000:1.0:1788263321.722908:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699208832 00000100:00100000:1.0:1788263321.722911:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699208832 00000100:00100000:1.0:1788263321.722933:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 131 00000100:00100000:1.0:1788263321.722940:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699208704:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263321.722974:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699208704:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 34us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263321.722981:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 131 00000100:00100000:1.0:1788263321.722994:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 132 00000100:00100000:1.0:1788263321.723001:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2387:x1875129699208832:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263321.723026:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2387:x1875129699208832:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 26us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263321.723033:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 132 00000100:00080000:1.0:1788263321.723049:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788263321.725829:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699208576 00000100:00100000:3.0:1788263321.725842:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699208576 00000100:00100000:3.0:1788263321.725962:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699208960 00000100:00100000:3.0:1788263321.725966:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699208960 00000100:00100000:1.0:1788263321.728875:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263321.728918:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699209088 00000100:00100000:1.0:1788263321.728926:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699209088 00000100:00080000:2.0:1788263321.729020:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788263321.729026:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788263321.729045:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 306 00000100:00100000:2.0:1788263321.729058:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699208576:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263321.729132:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699208576:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 77us (6984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263321.729140:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 306 00000100:00100000:3.0:1788263321.732462:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 307 00000100:00100000:3.0:1788263321.732478:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28329bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699208960:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263321.732549:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28329bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699208960:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 75us (10184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263321.732557:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 307 00000100:00100000:1.0:1788263321.732846:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 308 00000100:00100000:1.0:1788263321.732857:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699209088:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263321.732889:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699209088:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 34us (4022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263321.732895:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 308 00000040:00080000:1.0:1788263322.038652:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788263322.038661:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788263322.039310:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788263322.039323:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788263322.039448:0:13769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13769:1875129709768064:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788263322.039539:0:13769:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28213f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263322.049940:0:13769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13769:1875129709768064:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788263322.065457:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263322.073017:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699209216 00000100:00100000:3.0:1788263322.073030:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699209216 00000100:00100000:3.0:1788263322.073098:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 142 00000100:00100000:3.0:1788263322.073108:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:11377:x1875129699209216:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788263322.073153:0:6491:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788263322.073287:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:11377:x1875129699209216:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 180us (7837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263322.073305:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 142 00000100:00100000:3.0:1788263322.082548:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263322.082620:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699209472 00000100:00100000:0.0:1788263322.082808:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699209472 00000100:00100000:0.0:1788263322.082977:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 143 00000100:00100000:0.0:1788263322.082989:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:11377:x1875129699209472:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788263322.083018:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263322.083038:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fd34 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ffa5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263322.083139:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fd3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263322.083153:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fd3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263322.083166:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fd3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263322.083176:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788263322.083288:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fd34 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffa5 expref: 25 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263322.083303:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fd3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffa5 expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263322.083311:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:0.0:1788263322.083315:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263322.083318:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17e200, rc 0) 00000100:00100000:0.0:1788263322.083385:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+24:11377:x1875129699209472:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 397us (843us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788263322.083392:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 143 00000100:00100000:3.0:1788263322.087975:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263322.089638:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699209600 00000100:00100000:0.0:1788263322.089652:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699209600 00000100:00100000:0.0:1788263322.089736:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:0.0:1788263322.089755:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398742300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+24:2387:x1875129699209600:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263322.089772:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263322.089796:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fd3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffa5 expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263322.089816:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:0.0:1788263322.089821:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263322.089883:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398742300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+23:2387:x1875129699209600:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 129us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263322.089892:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:2.0:1788263322.103367:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263322.103444:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699209856 00000100:00100000:0.0:1788263322.103452:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699209856 00000100:00100000:0.0:1788263322.103515:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 144 00000100:00100000:0.0:1788263322.103526:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+23:11377:x1875129699209856:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788263322.103630:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fd49 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263322.103647:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fd49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263322.103658:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fd49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263322.103805:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fd49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263322.103812:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fd49 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263322.103836:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fd49 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263322.103842:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17f600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263322.103847:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fd49 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263322.103866:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fd49 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263322.103879:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:0.0:1788263322.103883:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788263322.103887:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fd49 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263322.103895:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fd49 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263322.104002:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+24:11377:x1875129699209856:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 477us (643us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788263322.104012:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 144 00000040:00080000:2.0:1788263322.104191:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788263322.104196:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788263322.104785:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788263322.104796:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788263322.109789:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263322.109850:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699210112 00000100:00100000:1.0:1788263322.109860:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699210112 00000100:00100000:1.0:1788263322.109917:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:1.0:1788263322.109928:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+24:11377:x1875129699210112:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788263322.110167:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+25:11377:x1875129699210112:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 240us (385us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788263322.110175:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 34 00010000:00010000:3.0:1788263322.289321:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788263322.326245:0:14231:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788263322.326265:0:14231:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788263322.326303:0:14231:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788263322.326317:0:14231:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788263322.680706:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788263322.680726:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709768192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788263322.680802:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263322.685424:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709768192 00000100:00100000:0.0:1788263322.685438:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709768192 00000100:00100000:0.0:1788263322.685492:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788263322.685503:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28398ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709768192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788263322.685535:0:13780:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788263322.685630:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28398ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709768192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (4827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263322.685647:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788263322.685865:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709768192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788263322.687565:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709768320:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788263322.687636:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263322.687692:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709768320 00000100:00100000:2.0:1788263322.687699:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709768320 00000100:00100000:2.0:1788263322.687734:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788263322.687742:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709768320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788263322.687769:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788263322.687850:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709768320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263322.687857:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788263322.687903:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709768320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788263322.732374:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263322.732408:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699210368 00000100:00100000:3.0:1788263322.732418:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699210368 00000100:00100000:3.0:1788263322.732469:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 145 00000100:00100000:3.0:1788263322.732479:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+25:11390:x1875129699210368:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788263322.732511:0:8884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263322.732531:0:8884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fd50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ffac expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263322.732656:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ea00/0x4b1103cba666fd57 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263322.732670:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ea00/0x4b1103cba666fd57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263322.732681:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ea00/0x4b1103cba666fd57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263322.732693:0:8884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788263322.732789:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fd50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffac expref: 28 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263322.732822:0:8884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ea00/0x4b1103cba666fd57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffac expref: 27 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263322.732832:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:3.0:1788263322.732836:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788263322.732839:0:8884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150ea00, rc 0) 00000100:00100000:3.0:1788263322.732904:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+27:11390:x1875129699210368:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 426us (537us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788263322.732911:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 145 00000100:00100000:2.0:1788263322.746725:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263322.747276:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699210496 00000100:00100000:0.0:1788263322.747287:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699210496 00000100:00100000:0.0:1788263322.747338:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 146 00000100:00100000:0.0:1788263322.747349:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+27:11390:x1875129699210496:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:0.0:1788263322.747414:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fd65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263322.747432:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fd65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263322.747443:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fd65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263322.747476:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fd65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263322.747483:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fd65 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263322.747499:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fd65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263322.747506:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17f800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263322.747510:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fd65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263322.747518:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fd65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263322.747542:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:0.0:1788263322.747545:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788263322.747550:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fd65 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263322.747556:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fd65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263322.747645:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+27:11390:x1875129699210496:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 298us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263322.747653:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 146 00000100:00100000:3.0:1788263322.951285:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263322.951482:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699210624 00000100:00100000:1.0:1788263322.951500:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699210624 00000100:00100000:1.0:1788263322.951655:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:1.0:1788263322.951667:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2387:x1875129699210624:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:1.0:1788263322.951685:0:8404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263322.951706:0:8404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b35bc8e/0x4b1103cba666fd6c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ffb3 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788263322.951732:0:8404:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a96bb96, atime: 0x6a96bb96, ctime: 0x6a96bb96, blocks: 0x8 00010000:00010000:1.0:1788263322.951750:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1788263322.951755:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263322.951764:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b35bc8e/0x4b1103cba666fd6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffb3 expref: 7 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263322.951781:0:8404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002b35bc8e/0x4b1103cba666fd6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffb3 expref: 7 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263322.951810:0:8404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381681e00, rc 0) 00000100:00080000:0.0:1788263322.952001:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788263322.952036:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2387:x1875129699210624:12345-192.168.203.26@tcp:101:cat.0 Request processed in 370us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263322.952043:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:0.0:1788263322.960050:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263322.960193:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699210752 00000100:00100000:2.0:1788263322.960203:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699210752 00002000:00100000:2.0:1788263322.960258:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9ff283ae9180 x1875129699210752/t0(0) o3->ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp:533/0 lens 488/0 e 0 to 0 dl 1788263333 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788263322.960273:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ff283ae9180 with x1875129699210752 ext(0->4095) 00002000:00010000:2.0:1788263322.960279:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ff283ae9180 00000100:00100000:2.0:1788263322.960302:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:2.0:1788263322.960420:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2386:x1875129699210752:12345-192.168.203.26@tcp:3:cat.0 00000100:00100000:2.0:1788263322.960732:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2386:x1875129699210752:12345-192.168.203.26@tcp:3:cat.0 Request processed in 314us (691us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788263322.960739:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 3 00002000:00100000:2.0:1788263322.960746:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9ff283ae9180 x1875129699210752/t0(0) o3->ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp:533/0 lens 488/4536 e 0 to 0 dl 1788263333 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788263322.960766:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ff283ae9180 with x1875129699210752 ext(0->4095) 00002000:00010000:2.0:1788263322.960770:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ff283ae9180 00000040:00080000:2.0:1788263323.120339:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788263323.120348:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788263323.120369:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788263323.120380:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788263323.248822:0:13773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788263323.316708:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263324.208807:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709768448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788263324.208874:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263324.208949:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709768448 00000100:00100000:3.0:1788263324.208956:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709768448 00000100:00100000:3.0:1788263324.209002:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788263324.209011:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1875129709768448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788263324.209040:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788263324.209084:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1875129709768448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263324.209091:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1788263324.209111:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788263324.209144:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709768448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263324.209823:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875129709768704:0@lo:400:kworker.0 00000100:00100000:1.0:1788263324.209866:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263324.209891:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385418a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875129709769216:0@lo:400:kworker.0 00000100:00100000:1.0:1788263324.209914:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263324.209932:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff38541b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875129709769728:0@lo:400:kworker.0 00000100:00100000:1.0:1788263324.209968:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263324.209989:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788263324.209995:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709768576:0@lo:400:kworker.0 00000100:00100000:1.0:1788263324.210025:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263324.210044:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709769088:0@lo:400:kworker.0 00000100:00100000:1.0:1788263324.210066:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263324.210081:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385419f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709769600:0@lo:400:kworker.0 00000100:00100000:1.0:1788263324.210102:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263324.210130:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709769600 00000100:00100000:1.0:1788263324.210134:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709769600 00000100:00100000:1.0:1788263324.210173:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788263324.210181:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3621:x1875129709769600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263324.210220:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3621:x1875129709769600:12345-0@lo:400:kworker.0 Request processed in 41us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263324.210253:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788263324.210288:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385419f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709769600:0@lo:400:kworker.0 00000100:00100000:0.0:1788263324.210418:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709768576 00000100:00100000:0.0:1788263324.210423:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709768576 00000100:00100000:0.0:1788263324.210477:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788263324.210496:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3621:x1875129709768576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263324.210537:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3621:x1875129709768576:12345-0@lo:400:kworker.0 Request processed in 52us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263324.210543:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788263324.210572:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709769088 00000100:00100000:0.0:1788263324.210594:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709769088 00000100:00100000:0.0:1788263324.210621:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788263324.210628:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709769088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263324.210661:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709769088:12345-0@lo:400:kworker.0 Request processed in 33us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263324.210676:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788263324.210708:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709768576:0@lo:400:kworker.0 00000100:00100000:0.0:1788263324.210718:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709769088:0@lo:400:kworker.0 00000100:00100000:3.0:1788263324.210829:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709768704 00000100:00100000:3.0:1788263324.210834:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709768704 00000100:00100000:3.0:1788263324.210870:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709769216 00000100:00100000:3.0:1788263324.210880:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709769216 00000100:00100000:3.0:1788263324.210905:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709769728 00000100:00100000:3.0:1788263324.210908:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709769728 00000100:00100000:3.0:1788263324.210925:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788263324.210932:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875129709768704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263324.210972:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875129709768704:12345-0@lo:400:kworker.0 Request processed in 39us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263324.210979:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788263324.210991:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788263324.210997:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875129709769216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263324.211025:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875129709769216:12345-0@lo:400:kworker.0 Request processed in 28us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263324.211031:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788263324.211042:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788263324.211048:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875129709769728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263324.211073:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875129709769728:12345-0@lo:400:kworker.0 Request processed in 25us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263324.211078:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788263324.211105:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709768832:0@lo:400:kworker.0 00000100:00100000:3.0:1788263324.211130:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263324.211150:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff38541a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709769344:0@lo:400:kworker.0 00000100:00100000:3.0:1788263324.211171:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263324.211186:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff38541bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709769856:0@lo:400:kworker.0 00000100:00100000:3.0:1788263324.211208:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263324.211226:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788263324.211232:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709768960:0@lo:400:kworker.0 00000100:00100000:3.0:1788263324.211274:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263324.211291:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709769472:0@lo:400:kworker.0 00000100:00100000:3.0:1788263324.211310:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263324.211324:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff38541a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709769984:0@lo:400:kworker.0 00000100:00100000:3.0:1788263324.211343:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263324.211369:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709768832 00000100:00100000:3.0:1788263324.211373:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709768832 00000100:00100000:3.0:1788263324.211394:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788263324.211400:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28398aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709768832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263324.211435:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28398aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709768832:12345-0@lo:400:kworker.0 Request processed in 35us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263324.211441:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788263324.211458:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709769472 00000100:00100000:3.0:1788263324.211461:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709769472 00000100:00100000:3.0:1788263324.211480:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709769984 00000100:00100000:3.0:1788263324.211482:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709769984 00000100:00100000:3.0:1788263324.212049:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788263324.212057:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28398b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709769472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263324.212091:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28398b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709769472:12345-0@lo:400:kworker.0 Request processed in 36us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263324.212096:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788263324.212108:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788263324.212113:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28398bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709769984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263324.212146:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28398bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709769984:12345-0@lo:400:kworker.0 Request processed in 33us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263324.212151:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788263324.212176:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709769344 00000100:00100000:3.0:1788263324.212180:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709769344 00000100:00100000:3.0:1788263324.212201:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709769856 00000100:00100000:3.0:1788263324.212204:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709769856 00000100:00100000:3.0:1788263324.212216:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709768960 00000100:00100000:3.0:1788263324.212219:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709768960 00000100:00100000:3.0:1788263324.212230:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788263324.212250:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28398b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709769344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263324.212282:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28398b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709769344:12345-0@lo:400:kworker.0 Request processed in 33us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263324.212288:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788263324.212300:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788263324.212306:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875129709769856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263324.212335:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875129709769856:12345-0@lo:400:kworker.0 Request processed in 29us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263324.212340:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788263324.212351:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788263324.212357:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709768960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263324.212383:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283989180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709768960:12345-0@lo:400:kworker.0 Request processed in 27us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263324.212389:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00080000:3.0:1788263324.212411:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788263324.212415:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788263324.212417:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788263324.212420:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788263324.212453:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709768960:0@lo:400:kworker.0 00000100:00100000:3.0:1788263324.212464:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385419880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709769472:0@lo:400:kworker.0 00000100:00100000:3.0:1788263324.212485:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff38541a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709769984:0@lo:400:kworker.0 00000100:00100000:0.0:1788263324.212642:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875129709768704:0@lo:400:kworker.0 00000100:00100000:0.0:1788263324.212653:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385418a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875129709769216:0@lo:400:kworker.0 00000100:00100000:0.0:1788263324.212663:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff38541b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875129709769728:0@lo:400:kworker.0 00000100:00100000:0.0:1788263324.222340:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709768832:0@lo:400:kworker.0 00010000:00080000:0.0:1788263324.222362:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff38541a680 x1875129709769344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263324.222373:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff38541a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709769344:0@lo:400:kworker.0 00010000:00080000:0.0:1788263324.222384:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff38541bb80 x1875129709769856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263324.222392:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff38541bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709769856:0@lo:400:kworker.0 00010000:00010000:1.0:1788263324.340508:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263324.730054:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788263324.730089:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709770112:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788263324.730154:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263324.730456:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709770112 00000100:00100000:1.0:1788263324.730463:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709770112 00000100:00100000:1.0:1788263324.730516:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788263324.730526:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283989500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709770112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788263324.730548:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788263324.730627:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283989500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709770112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263324.730635:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788263324.730748:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709770112:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788263325.232183:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709770240:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788263325.232256:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263325.232321:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709770240 00000100:00100000:1.0:1788263325.232327:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709770240 00000100:00100000:1.0:1788263325.232369:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788263325.232379:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709770240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788263325.232406:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263325.232447:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709770240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263325.232454:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788263325.232498:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709770240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788263325.232730:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709770368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263325.232762:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263325.232794:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709770368 00000100:00100000:0.0:1788263325.232798:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709770368 00000100:00100000:0.0:1788263325.232820:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788263325.232826:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1875129709770368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788263325.232845:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263325.232875:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1875129709770368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263325.232882:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788263325.232911:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709770368:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788263325.368693:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263326.384594:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788263326.773680:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:1.0:1788263326.773702:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:0.0:1788263326.774617:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1788263326.783534:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1788263326.783576:0:6470:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ff28213fe40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788263326.783600:0:6470:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ff387d7db00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ff28213fcc0 00000020:00080000:2.0:1788263326.783604:0:6470:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ff387d7d900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ff282c3f200 00000020:00080000:2.0:1788263326.783625:0:6470:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788263326.783638:0:6523:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788263326.783697:0:6523:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1788263326.783766:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba666fce7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.783778:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba666fce7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.783786:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba666fce7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.783791:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263326.783797:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba666fce7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.783805:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba666fce7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.783822:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9ff28227a100) 00010000:00010000:1.0:1788263326.783825:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263326.783830:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba666fce7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263326.783837:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba666fce7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263326.844756:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263326.844791:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699210880 00000100:00100000:1.0:1788263326.844802:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699210880 00000100:00100000:2.0:1788263326.844807:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263326.844849:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263326.844864:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 389 00000100:00100000:0.0:1788263326.844871:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699211008 00000100:00100000:0.0:1788263326.844877:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699211008 00000100:00100000:2.0:1788263326.844885:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263326.844911:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263326.844926:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699211136 00000100:00100000:0.0:1788263326.844931:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699211136 00000100:00100000:2.0:1788263326.844938:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263326.844958:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699211520 00000100:00100000:0.0:1788263326.844962:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699211520 00000100:00100000:2.0:1788263326.844968:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263326.844983:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699211648 00000100:00100000:0.0:1788263326.844987:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699211648 00000100:00100000:2.0:1788263326.844994:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 315 00000100:00100000:1.0:1788263326.845005:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2389:x1875129699210880:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263326.845007:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+13:2388:x1875129699211008:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263326.845010:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 316 00000100:00100000:0.0:1788263326.845024:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2389:x1875129699211136:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263326.845083:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+13:2388:x1875129699211008:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 80us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263326.845089:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2389:x1875129699210880:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 212us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263326.845090:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2389:x1875129699211136:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 65us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263326.845099:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 315 00000100:00100000:0.0:1788263326.845120:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 316 00000100:00100000:1.0:1788263326.845124:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 389 00000100:00100000:2.0:1788263326.845142:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 317 00000100:00100000:0.0:1788263326.845149:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 318 00000100:00100000:2.0:1788263326.845155:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2388:x1875129699211520:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263326.845163:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8481cd9-d282-4057-bab5-8c571435635f+5:2389:x1875129699211648:12345-192.168.203.26@tcp:400:kworker.0 00000100:00080000:1.0:1788263326.845185:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788263326.845190:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263326.845192:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2388:x1875129699211520:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 41us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263326.845200:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8481cd9-d282-4057-bab5-8c571435635f+5:2389:x1875129699211648:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 40us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263326.845207:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 317 00000100:00100000:0.0:1788263326.845225:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 318 00000100:00100000:2.0:1788263326.845247:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699211264 00000100:00100000:2.0:1788263326.845253:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699211264 00000100:00100000:2.0:1788263326.845305:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699211392 00000100:00100000:2.0:1788263326.845309:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699211392 00000100:00100000:2.0:1788263326.845332:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 136 00000100:00100000:2.0:1788263326.845339:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2388:x1875129699211264:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263326.845365:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2388:x1875129699211264:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 26us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263326.845371:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 136 00000100:00100000:2.0:1788263326.845382:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 137 00000100:00100000:2.0:1788263326.845388:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2389:x1875129699211392:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263326.845411:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2389:x1875129699211392:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 23us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263326.845419:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 137 00000100:00080000:1.0:1788263326.845470:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788263326.845474:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788263327.411860:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263327.791812:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788263327.791834:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709770496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788263327.791936:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263327.792293:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788263327.792304:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709770624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788263327.792347:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263327.792566:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709770496 00000100:00100000:2.0:1788263327.792574:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709770496 00000100:00100000:2.0:1788263327.793566:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709770624 00000100:00100000:2.0:1788263327.793574:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709770624 00000100:00100000:2.0:1788263327.793607:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788263327.793616:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709770496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788263327.793649:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788263327.793726:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709770496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (1789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263327.793733:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788263327.793750:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788263327.793756:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709770624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788263327.793772:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788263327.793826:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709770624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263327.793832:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788263327.793880:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709770496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788263327.793988:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709770624:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788263328.433091:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263329.229873:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263329.229941:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699211776 00000100:00100000:1.0:1788263329.229951:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699211776 00000100:00100000:1.0:1788263329.230037:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 147 00000100:00100000:1.0:1788263329.230048:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+13:11051:x1875129699211776:12345-192.168.203.26@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788263329.230165:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+13:11051:x1875129699211776:12345-192.168.203.26@tcp:60:lhsmtool_posix.0 Request processed in 117us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263329.230172:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 147 00000100:00080000:3.0:1788263329.230240:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263329.236466:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263329.236781:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699211904 00000100:00100000:3.0:1788263329.236790:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699211904 00000100:00100000:3.0:1788263329.236865:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 148 00000100:00080000:1.0:1788263329.236869:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788263329.236875:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:11051:x1875129699211904:12345-192.168.203.26@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788263329.236984:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:11051:x1875129699211904:12345-192.168.203.26@tcp:60:lhsmtool_posix.0 Request processed in 110us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263329.236992:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 148 00000100:00100000:2.0:1788263329.242050:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263329.242188:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699212160 00000100:00100000:3.0:1788263329.242212:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699212160 00000100:00100000:3.0:1788263329.242268:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00100000:3.0:1788263329.242278:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+13:11051:x1875129699212160:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788263329.242507:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+14:11051:x1875129699212160:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 228us (463us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788263329.242515:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00100000:0.0:1788263329.328441:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709770752:0@lo:400:kworker.0 00000100:00100000:0.0:1788263329.328515:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263329.328608:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709771264:0@lo:400:kworker.0 00000100:00100000:0.0:1788263329.328635:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263329.328656:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709771776:0@lo:400:kworker.0 00000100:00100000:0.0:1788263329.328679:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263329.328697:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf78b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709772288:0@lo:400:kworker.0 00000100:00100000:0.0:1788263329.328719:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263329.328745:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788263329.328750:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875129709771136:0@lo:400:kworker.0 00000100:00100000:0.0:1788263329.328786:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263329.328807:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709771648:0@lo:400:kworker.0 00000100:00100000:0.0:1788263329.328828:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263329.328861:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf789180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709772160:0@lo:400:kworker.0 00000100:00100000:0.0:1788263329.328883:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263329.328908:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709771008:0@lo:400:kworker.0 00000100:00100000:0.0:1788263329.328931:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263329.328948:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875129709771520:0@lo:400:kworker.0 00000100:00100000:0.0:1788263329.328969:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263329.328983:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf788e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709772032:0@lo:400:kworker.0 00000100:00100000:0.0:1788263329.329000:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263329.329028:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788263329.329033:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709770880:0@lo:400:kworker.0 00000100:00100000:0.0:1788263329.329056:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263329.329073:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875129709771392:0@lo:400:kworker.0 00000100:00100000:0.0:1788263329.329093:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263329.329107:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf78b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875129709771904:0@lo:400:kworker.0 00000100:00100000:0.0:1788263329.329128:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263329.329151:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709771264 00000100:00100000:0.0:1788263329.329159:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709771264 00000100:00100000:0.0:1788263329.329193:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709771008 00000100:00100000:0.0:1788263329.329196:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709771008 00000100:00100000:0.0:1788263329.329223:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788263329.329232:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709771264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263329.329283:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709771264:12345-0@lo:400:kworker.0 Request processed in 52us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263329.329290:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788263329.329306:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788263329.329312:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709771008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263329.329343:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709771008:12345-0@lo:400:kworker.0 Request processed in 31us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263329.329349:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788263329.329367:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709771776 00000100:00100000:0.0:1788263329.329371:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709771776 00000100:00100000:0.0:1788263329.329395:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709772288 00000100:00100000:0.0:1788263329.329398:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709772288 00000100:00100000:0.0:1788263329.329408:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709771648 00000100:00100000:0.0:1788263329.329411:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709771648 00000100:00100000:0.0:1788263329.329422:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709772160 00000100:00100000:0.0:1788263329.329431:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709772160 00000100:00100000:0.0:1788263329.329451:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788263329.329458:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709771776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263329.329490:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709771776:12345-0@lo:400:kworker.0 Request processed in 32us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263329.329495:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788263329.329507:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788263329.329513:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709772288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263329.329541:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709772288:12345-0@lo:400:kworker.0 Request processed in 29us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263329.329547:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788263329.329560:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788263329.329567:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709771648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263329.329621:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709771648:12345-0@lo:400:kworker.0 Request processed in 54us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263329.329627:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788263329.329641:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788263329.329648:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709772160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263329.329659:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709772416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263329.329678:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709772160:12345-0@lo:400:kworker.0 Request processed in 31us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263329.329685:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788263329.329700:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263329.329711:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709771136 00000100:00100000:0.0:1788263329.329715:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709771136 00000100:00100000:3.0:1788263329.329741:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709771520 00000100:00100000:0.0:1788263329.329742:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709772032 00000100:00100000:0.0:1788263329.329747:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709772032 00000100:00100000:3.0:1788263329.329748:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709771520 00000100:00100000:0.0:1788263329.329764:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709770880 00000100:00100000:0.0:1788263329.329768:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709770880 00000100:00100000:3.0:1788263329.329781:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709771392 00000100:00100000:3.0:1788263329.329794:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709771392 00000100:00100000:0.0:1788263329.329795:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709771904 00000100:00100000:0.0:1788263329.329801:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709771904 00000100:00100000:3.0:1788263329.329825:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788263329.329834:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875129709771136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263329.329871:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875129709771136:12345-0@lo:400:kworker.0 Request processed in 39us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263329.329882:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709772416 00000100:00100000:2.0:1788263329.329923:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709770752 00000100:00100000:2.0:1788263329.329927:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709770752 00000100:00100000:2.0:1788263329.329959:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1788263329.329968:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3621:x1875129709770752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263329.330004:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3621:x1875129709770752:12345-0@lo:400:kworker.0 Request processed in 37us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263329.330010:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788263329.330085:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709772416 00000100:00100000:1.0:1788263329.330112:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788263329.330120:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709772416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788263329.330141:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788263329.330181:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709772416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263329.330187:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788263329.330235:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1788263329.330247:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1788263329.330276:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709772416:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788263329.330294:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788263329.330298:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788263329.330300:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788263329.330302:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788263329.332132:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788263329.332153:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875129709772032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263329.332239:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875129709772032:12345-0@lo:400:kworker.0 Request processed in 96us (3237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263329.332246:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788263329.332273:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788263329.332281:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875129709771520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263329.332312:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875129709771520:12345-0@lo:400:kworker.0 Request processed in 33us (3342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263329.332318:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788263329.332332:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788263329.332339:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709770880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263329.332368:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709770880:12345-0@lo:400:kworker.0 Request processed in 30us (3311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263329.332374:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788263329.332385:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788263329.332668:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875129709771392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263329.332705:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875129709771392:12345-0@lo:400:kworker.0 Request processed in 314us (3610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263329.332711:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788263329.332724:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788263329.332730:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875129709771904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263329.332756:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875129709771904:12345-0@lo:400:kworker.0 Request processed in 27us (3627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263329.335276:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1788263329.335362:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875129709771136:0@lo:400:kworker.0 00000100:00100000:3.0:1788263329.335364:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709770880:0@lo:400:kworker.0 00000100:00100000:3.0:1788263329.335383:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875129709771392:0@lo:400:kworker.0 00000100:00100000:2.0:1788263329.335393:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709771648:0@lo:400:kworker.0 00000100:00100000:3.0:1788263329.335406:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf78b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875129709771904:0@lo:400:kworker.0 00000100:00100000:2.0:1788263329.335412:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf789180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709772160:0@lo:400:kworker.0 00000100:00100000:3.0:1788263329.335425:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709771008:0@lo:400:kworker.0 00010000:00080000:3.0:1788263329.335440:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283b88000 x1875129709771520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263329.335449:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875129709771520:0@lo:400:kworker.0 00000100:00100000:2.0:1788263329.335672:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709770752:0@lo:400:kworker.0 00000100:00100000:2.0:1788263329.335686:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709771264:0@lo:400:kworker.0 00000100:00100000:2.0:1788263329.335714:0:3621:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1788263329.335718:0:3621:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ff28178dc00, transno 4294967305 00000100:00100000:2.0:1788263329.335733:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf788380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709771776:0@lo:400:kworker.0 00000100:00100000:2.0:1788263329.335744:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf78b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709772288:0@lo:400:kworker.0 00000100:00100000:0.0:1788263329.336622:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00010000:00080000:3.0:1788263329.339259:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf788e00 x1875129709772032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263329.339273:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf788e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709772032:0@lo:400:kworker.0 00010000:00010000:1.0:1788263329.455804:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263329.558554:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263329.558739:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699212288 00000100:00100000:2.0:1788263329.558749:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699212288 00000100:00100000:2.0:1788263329.558826:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 149 00000100:00100000:2.0:1788263329.558836:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8481cd9-d282-4057-bab5-8c571435635f+5:11851:x1875129699212288:12345-192.168.203.26@tcp:101:lsof.0 00010000:00010000:2.0:1788263329.558855:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263329.558876:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666fd73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ffba expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.558940:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fd7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.558953:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fd7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.558963:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fd7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263329.559010:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788263329.559014:0:10388:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788263329.559062:0:10388:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fd7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.559087:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba666fd73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffba expref: 7 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.559123:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fd7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffba expref: 6 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263329.559131:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff282126d00) 00010000:00010000:2.0:1788263329.559134:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788263329.559137:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d1400, rc 0) 00000100:00100000:2.0:1788263329.559207:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8481cd9-d282-4057-bab5-8c571435635f+6:11851:x1875129699212288:12345-192.168.203.26@tcp:101:lsof.0 Request processed in 364us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263329.559214:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 149 00000100:00080000:1.0:1788263329.559727:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263329.840488:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263329.840509:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709772544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788263329.840622:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263329.840763:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709772544 00000100:00100000:0.0:1788263329.840772:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709772544 00000100:00100000:0.0:1788263329.840817:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788263329.840826:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bd507450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709772544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788263329.840848:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788263329.840903:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bd507450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709772544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263329.840910:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788263329.841224:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709772544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788263330.352397:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788263330.352420:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709772672:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788263330.352502:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263330.353823:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709772672 00000100:00100000:1.0:1788263330.353833:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709772672 00000100:00100000:1.0:1788263330.353973:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788263330.353984:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28398b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709772672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788263330.354015:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263330.354073:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28398b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709772672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (1572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263330.354079:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788263330.356154:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788263330.356182:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf78b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709772800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263330.356265:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263330.357200:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709772672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788263330.357841:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709772800 00000100:00100000:1.0:1788263330.357921:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709772800 00000100:00100000:1.0:1788263330.357985:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788263330.357995:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28329b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709772800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788263330.358017:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263330.358094:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28329b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709772800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (1829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263330.358101:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788263330.358206:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf78b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709772800:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788263330.480611:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263331.503922:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263331.957821:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263331.957864:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263331.957898:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263331.957934:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263331.957950:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263331.957980:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263331.958001:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263331.958032:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699212544 00000100:00100000:0.0:1788263331.958037:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699212800 00000100:00100000:2.0:1788263331.958041:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699212544 00000100:00100000:0.0:1788263331.958044:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699212800 00000100:00100000:2.0:1788263331.958094:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699212672 00000100:00100000:2.0:1788263331.958099:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699212672 00000100:00100000:1.0:1788263331.958274:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699212416 00000100:00100000:1.0:1788263331.958284:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699212416 00000100:00100000:1.0:1788263331.958317:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 391 00000100:00100000:1.0:1788263331.958326:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2388:x1875129699212416:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263331.958345:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699212928 00000100:00100000:3.0:1788263331.958351:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699212928 00000100:00100000:1.0:1788263331.958401:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2388:x1875129699212416:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 76us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263331.958408:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 391 00000100:00100000:1.0:1788263331.958439:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699213056 00000100:00100000:1.0:1788263331.958443:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699213056 00000100:00080000:2.0:1788263331.968479:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788263331.968489:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788263331.968492:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788263331.968495:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263331.968542:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699213184 00000100:00100000:2.0:1788263331.968552:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699213184 00000100:00080000:2.0:1788263331.968593:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788263331.968617:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 325 00000100:00100000:2.0:1788263331.968627:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf78b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+14:2389:x1875129699212544:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263331.968721:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf78b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+14:2389:x1875129699212544:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 96us (10855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263331.968728:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 325 00000100:00100000:2.0:1788263331.968744:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 326 00000100:00100000:2.0:1788263331.968751:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2388:x1875129699212672:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263331.968776:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2388:x1875129699212672:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 26us (10841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263331.968781:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 326 00000100:00100000:2.0:1788263331.968792:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 327 00000100:00100000:2.0:1788263331.968798:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf78a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8481cd9-d282-4057-bab5-8c571435635f+5:2388:x1875129699213184:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263331.968821:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf78a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8481cd9-d282-4057-bab5-8c571435635f+5:2388:x1875129699213184:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 23us (10820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263331.968828:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 327 00000100:00100000:0.0:1788263331.970977:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 142 00000100:00100000:0.0:1788263331.971069:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2389:x1875129699212800:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263331.971149:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2389:x1875129699212800:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 161us (13249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263331.971166:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 142 00000100:00100000:3.0:1788263331.976764:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 143 00000100:00100000:3.0:1788263331.976796:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2388:x1875129699212928:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263331.977139:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2388:x1875129699212928:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 348us (19157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263331.977148:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 143 00000100:00100000:1.0:1788263331.978194:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 328 00000100:00100000:1.0:1788263331.978206:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf78bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8481cd9-d282-4057-bab5-8c571435635f+6:2389:x1875129699213056:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263331.978267:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf78bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8481cd9-d282-4057-bab5-8c571435635f+6:2389:x1875129699213056:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 63us (20314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263331.978274:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 328 00010000:00010000:1.0:1788263332.535231:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263332.912153:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709772928:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788263332.912240:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263332.912329:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709772928 00000100:00100000:2.0:1788263332.912337:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709772928 00000100:00100000:3.0:1788263332.918915:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709773056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788263332.918995:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:0.0:1788263332.924694:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:0.0:1788263332.924707:0:6470:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788263332.926209:0:6523:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788263332.926224:0:6523:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788263332.929256:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709773056 00000100:00100000:2.0:1788263332.929274:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709773056 00000100:00100000:2.0:1788263332.929357:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788263332.929369:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709772928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788263332.929409:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788263332.929534:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf789f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709772928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 167us (17293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263332.929542:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788263332.929611:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709772928:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788263332.929641:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788263332.929649:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709773056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788263332.929666:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788263332.929703:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709773056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (10708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263332.929709:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788263332.929754:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709773056:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788263333.362019:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788263333.362033:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788263333.362138:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1788263333.362146:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:2.0:1788263333.483134:0:14429:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 07:48:51 (1788263331) 00000040:00080000:3.0:1788263333.488324:0:13773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788263333.553459:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263334.447803:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709773312:0@lo:400:kworker.0 00000100:00100000:2.0:1788263334.447841:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709773184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788263334.447887:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263334.447904:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263334.447938:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709773696:0@lo:400:kworker.0 00000100:00100000:3.0:1788263334.447947:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709773824:0@lo:400:kworker.0 00000100:00100000:3.0:1788263334.447979:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263334.447999:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263334.448002:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709774336:0@lo:400:kworker.0 00000100:00100000:2.0:1788263334.448033:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709774208:0@lo:400:kworker.0 00000100:00100000:3.0:1788263334.448034:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263334.448073:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709773440:0@lo:400:kworker.0 00000100:00100000:3.0:1788263334.448086:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709774848:0@lo:400:kworker.0 00000100:00100000:2.0:1788263334.448126:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263334.448149:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709773952:0@lo:400:kworker.0 00000100:00100000:3.0:1788263334.448150:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263334.448195:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263334.448228:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709773824 00000100:00100000:2.0:1788263334.448228:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875129709774464:0@lo:400:kworker.0 00000100:00100000:3.0:1788263334.448238:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709773824 00000100:00100000:2.0:1788263334.448255:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263334.448279:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788263334.448288:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709773568:0@lo:400:kworker.0 00000100:00100000:3.0:1788263334.448294:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788263334.448306:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709773824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263334.448319:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263334.448338:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709774080:0@lo:400:kworker.0 00000100:00100000:3.0:1788263334.448368:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709773824:12345-0@lo:400:kworker.0 Request processed in 64us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263334.448371:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263334.448391:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788263334.448411:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709773568 00000100:00100000:2.0:1788263334.448415:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709774592:0@lo:400:kworker.0 00000100:00100000:3.0:1788263334.448417:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709773568 00000100:00100000:3.0:1788263334.448442:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788263334.448453:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf78ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709773568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263334.448454:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263334.448488:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709773696 00000100:00100000:2.0:1788263334.448493:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709773696 00000100:00100000:3.0:1788263334.448506:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf78ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709773568:12345-0@lo:400:kworker.0 Request processed in 56us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263334.448514:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788263334.448518:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709773440 00000100:00100000:2.0:1788263334.448522:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709773440 00000100:00100000:3.0:1788263334.448539:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709773184 00000100:00100000:2.0:1788263334.448540:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709773952 00000100:00100000:3.0:1788263334.448545:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709773184 00000100:00100000:2.0:1788263334.448545:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709773952 00000100:00100000:2.0:1788263334.448573:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709774464 00000100:00100000:2.0:1788263334.448576:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709774464 00000100:00100000:0.0:1788263334.449650:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709774336 00000100:00100000:0.0:1788263334.449659:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709774336 00000100:00100000:1.0:1788263334.450198:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709774080 00000100:00100000:1.0:1788263334.450205:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709774080 00000100:00100000:3.0:1788263334.452157:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788263334.452183:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709773184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788263334.452218:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788263334.452519:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf788700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709773184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 341us (4615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263334.452526:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788263334.452560:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709773312 00000100:00100000:3.0:1788263334.452567:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709773312 00000100:00100000:3.0:1788263334.452617:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1788263334.452624:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3621:x1875129709773312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263334.452661:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3621:x1875129709773312:12345-0@lo:400:kworker.0 Request processed in 38us (4777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263334.452667:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1788263334.452744:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709773568:0@lo:400:kworker.0 00000100:00100000:3.0:1788263334.452784:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709773824:0@lo:400:kworker.0 00000100:00100000:1.0:1788263334.452870:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709774592 00000100:00100000:1.0:1788263334.452876:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709774592 00000100:00100000:1.0:1788263334.452895:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788263334.452903:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709773696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263334.452941:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709773696:12345-0@lo:400:kworker.0 Request processed in 39us (4943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263334.452948:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788263334.452961:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788263334.452968:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf78b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709773440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263334.453001:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf78b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709773440:12345-0@lo:400:kworker.0 Request processed in 34us (4876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263334.453016:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788263334.453030:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788263334.453037:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf78a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709773952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263334.453068:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf78a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709773952:12345-0@lo:400:kworker.0 Request processed in 32us (4875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263334.453073:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788263334.453085:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788263334.453091:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709774080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263334.453121:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709774080:12345-0@lo:400:kworker.0 Request processed in 31us (4752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263334.453126:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788263334.453138:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788263334.453144:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875129709774592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263334.453179:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709773312:0@lo:400:kworker.0 00000100:00100000:1.0:1788263334.453186:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875129709774592:12345-0@lo:400:kworker.0 Request processed in 39us (4732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263334.453193:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00010000:00080000:3.0:1788263334.453224:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283957b80 x1875129709774080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263334.453314:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709774848 00000100:00100000:1.0:1788263334.453319:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709774848 00000100:00100000:1.0:1788263334.453348:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788263334.453354:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709774848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263334.454604:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709774080:0@lo:400:kworker.0 00010000:00080000:3.0:1788263334.454633:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283956d80 x1875129709774592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263334.454641:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709774592:0@lo:400:kworker.0 00000100:00100000:3.0:1788263334.454654:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709773440:0@lo:400:kworker.0 00000100:00100000:3.0:1788263334.454666:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709773952:0@lo:400:kworker.0 00000100:00100000:2.0:1788263334.455032:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788263334.455042:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875129709774464:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788263334.455096:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788263334.455103:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788263334.455107:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788263334.455111:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf788a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875129709774464:12345-0@lo:400:kworker.0 Request processed in 70us (6854us total) trans 0 rc 0/0 00000100:00080000:3.0:1788263334.455112:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263334.455122:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788263334.455158:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875129709774464:0@lo:400:kworker.0 00000100:00100000:2.0:1788263334.455181:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263334.455215:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709774208 00000100:00100000:2.0:1788263334.455219:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709774720:0@lo:400:kworker.0 00000100:00100000:3.0:1788263334.455221:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709774208 00000100:00100000:2.0:1788263334.455264:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263334.455295:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709773184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263334.455306:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709773696:0@lo:400:kworker.0 00000100:00100000:2.0:1788263334.455330:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709774720 00000100:00100000:2.0:1788263334.455334:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709774720 00000100:00100000:2.0:1788263334.455359:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788263334.455365:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709774720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263334.455485:0:8406:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788263334.455493:0:8406:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788263334.455615:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788263334.455623:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf78aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709774208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263334.455668:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf78aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709774208:12345-0@lo:400:kworker.0 Request processed in 46us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263334.455675:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788263334.455802:0:8406:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788263334.455813:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788263334.455820:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283989500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709774336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263334.455862:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283989500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709774336:12345-0@lo:400:kworker.0 Request processed in 43us (7829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263334.455868:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788263334.455898:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709774336:0@lo:400:kworker.0 00000100:00080000:0.0:1788263334.455937:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788263334.455941:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788263334.456030:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf788e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709774720:12345-0@lo:400:kworker.0 Request processed in 665us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263334.456037:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788263334.456063:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709774208:0@lo:400:kworker.0 00000100:00100000:2.0:1788263334.456073:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709774720:0@lo:400:kworker.0 00000100:00100000:1.0:1788263334.456694:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709774848:12345-0@lo:400:kworker.0 Request processed in 3327us (8543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263334.456703:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788263334.464141:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709774848:0@lo:400:kworker.0 00010000:00010000:1.0:1788263334.579011:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263334.948276:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263334.948380:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699213440 00000100:00100000:3.0:1788263334.948423:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699213440 00000100:00100000:3.0:1788263334.948523:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 150 00000100:00100000:3.0:1788263334.948536:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28329b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+13:12118:x1875129699213440:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788263334.948564:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1788263334.948721:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788263334.948790:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666fd81 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ffc1 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.948881:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e200/0x4b1103cba666fd88 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.948896:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e200/0x4b1103cba666fd88 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.948909:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e200/0x4b1103cba666fd88 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.948951:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fd8f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.948959:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fd8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.948966:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fd8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.949062:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666fd96 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.949074:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666fd96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.949081:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666fd96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263334.949105:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788263334.949212:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e200/0x4b1103cba666fd88 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.949221:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e200/0x4b1103cba666fd88 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.949227:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e200/0x4b1103cba666fd88 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.949233:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150e200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263334.949237:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e200/0x4b1103cba666fd88 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.949244:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e200/0x4b1103cba666fd88 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.949256:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ff282128a00) 00010000:00010000:3.0:1788263334.949259:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263334.949264:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e200/0x4b1103cba666fd88 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.949269:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e200/0x4b1103cba666fd88 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.949284:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fd8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.949291:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fd8f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.949304:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fd8f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.949307:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150f000 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263334.949317:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fd8f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.949325:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fd8f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.949333:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ff282126b00) 00010000:00010000:3.0:1788263334.949335:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263334.949338:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fd8f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.949344:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fd8f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.949565:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666fd81 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffc1 expref: 16 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.949576:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666fd96 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffc1 expref: 15 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263334.949616:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ff28314fa00) 00010000:00010000:3.0:1788263334.949617:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263334.949624:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150e800, rc 0) 00000100:00100000:3.0:1788263334.949686:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28329b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+15:12118:x1875129699213440:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 1152us (1425us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1788263334.949701:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 150 00000100:00100000:3.0:1788263334.952330:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263334.953678:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699213568 00000100:00100000:2.0:1788263334.953691:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699213568 00000100:00100000:2.0:1788263334.953757:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 151 00000100:00100000:2.0:1788263334.953768:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+15:12118:x1875129699213568:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788263334.953878:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+15:12118:x1875129699213568:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 Request processed in 110us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263334.953886:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 151 00000100:00100000:2.0:1788263334.959828:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788263334.959857:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709774976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788263334.959929:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263334.960515:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709774976 00000100:00100000:1.0:1788263334.960547:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709774976 00000100:00100000:1.0:1788263334.960655:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788263334.960666:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf78b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709774976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788263334.960696:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788263334.960785:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf78b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709774976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263334.960793:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788263334.962379:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709774976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788263334.962679:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263334.962798:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263334.962871:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699213824 00000100:00100000:2.0:1788263334.962894:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699213824 00000100:00100000:2.0:1788263334.962973:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:2.0:1788263334.962983:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0457850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+15:2386:x1875129699213824:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263334.962998:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263334.963021:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666fd96 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffc1 expref: 15 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263334.963041:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ff28314fa00) 00010000:00010000:2.0:1788263334.963046:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263334.963112:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0457850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+14:2386:x1875129699213824:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 130us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263334.963119:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:3.0:1788263334.969354:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699213696 00000100:00100000:3.0:1788263334.969439:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699213696 00000100:00100000:3.0:1788263334.969644:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 152 00000100:00100000:3.0:1788263334.969657:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:12118:x1875129699213696:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788263334.969820:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:12118:x1875129699213696:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 Request processed in 164us (7147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263334.969829:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 152 00000100:00080000:0.0:1788263334.970515:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1788263335.410064:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788263335.410070:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788263335.410642:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1788263335.410652:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788263335.471801:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709775104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788263335.471872:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263335.472150:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709775232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788263335.472217:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263335.472248:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709775104 00000100:00100000:3.0:1788263335.472256:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709775104 00000100:00100000:3.0:1788263335.472298:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709775232 00000100:00100000:3.0:1788263335.472301:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709775232 00000100:00100000:3.0:1788263335.472317:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788263335.472325:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709775104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788263335.472354:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263335.472392:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709775104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263335.472399:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788263335.472415:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788263335.472421:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28398a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709775232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788263335.472431:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263335.472458:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28398a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709775232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263335.472474:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788263335.472655:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709775104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788263335.475141:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709775232:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1788263335.537608:0:13773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788263335.605187:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263336.626126:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263336.753735:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263336.753803:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699213952 00000100:00100000:1.0:1788263336.753812:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699213952 00000100:00100000:1.0:1788263336.753880:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 153 00000100:00100000:1.0:1788263336.753890:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+14:12160:x1875129699213952:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1788263336.753909:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263336.753987:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666fda4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ffc8 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.754048:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666fdab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.754062:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666fdab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.754074:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666fdab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.754086:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba666fdb2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.754093:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba666fdb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.754110:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba666fdb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.754158:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666fdab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.754165:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666fdab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.754173:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666fdab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.754180:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381680c00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263336.754184:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666fdab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.754191:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666fdab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.754202:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff282126d00) 00010000:00010000:1.0:1788263336.754205:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263336.754209:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666fdab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.754215:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba666fdab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.754239:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba666fdb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.754245:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba666fdb2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.754258:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba666fdb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.754263:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381681600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263336.754267:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba666fdb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.754274:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba666fdb2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.754282:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ff383b6e600) 00010000:00010000:1.0:1788263336.754290:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263336.754293:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba666fdb2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.754300:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba666fdb2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.754334:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666fda4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffc8 expref: 15 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.754343:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff282126d00) 00010000:00010000:1.0:1788263336.754345:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263336.754348:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666fda4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffc8 expref: 15 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.754358:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381681800, rc 0) 00000100:00100000:1.0:1788263336.754413:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+14:12160:x1875129699213952:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 524us (685us total) trans 0 rc 301/301 00000100:00100000:1.0:1788263336.754428:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 153 00000100:00080000:0.0:1788263336.755095:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263336.760409:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263336.760645:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699214208 00000100:00100000:0.0:1788263336.760654:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699214208 00000100:00100000:0.0:1788263336.760703:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 154 00000100:00100000:0.0:1788263336.760713:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+14:12160:x1875129699214208:12345-192.168.203.26@tcp:36:lfs.0 00010000:00010000:0.0:1788263336.760766:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263336.760791:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba666f6f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdec expref: 14 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263336.760813:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff282126d00) 00010000:00010000:0.0:1788263336.760818:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788263336.760877:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fdb9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263336.760890:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fd7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffba expref: 5 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263336.760899:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fdb9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263336.760930:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fd7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffba expref: 5 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263336.760957:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fd7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffba expref: 5 pid: 10388 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263336.760972:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6493:1875129709775360:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788263336.761131:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff283a5ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788263336.764161:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6493:1875129709775360:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788263336.764189:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fdb9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263336.779557:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263336.779665:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699214336 00000100:00100000:1.0:1788263336.779675:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699214336 00010000:00010000:1.0:1788263336.779735:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fd7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffba expref: 6 pid: 10388 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263336.779770:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 78 00000100:00100000:1.0:1788263336.779780:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385671180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8481cd9-d282-4057-bab5-8c571435635f+6:2387:x1875129699214336:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263336.779794:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263336.779801:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fd7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffba expref: 6 pid: 10388 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.779814:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fd7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffba expref: 6 pid: 10388 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.779834:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba666fd7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffba expref: 6 pid: 10388 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.779847:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff282126d00) 00010000:00010000:1.0:1788263336.779852:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fdb9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.779861:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fdb9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.779868:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fdb9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.779902:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263336.779952:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385671180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699214336:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 172us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263336.779960:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 78 00000100:00080000:2.0:1788263336.781000:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788263336.781020:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fdb9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.781030:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fdb9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.781061:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba666fdc0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.781072:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba666fdc0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.781081:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba666fdc0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.781634:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba666fdc7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.781645:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba666fdc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.781652:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba666fdc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788263336.781667:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086bede12 reply state 0000000042138867 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba666fdc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.781690:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba666fdc7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.781698:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:2.0:1788263336.781701:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788263336.781705:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788263336.781710:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788263336.781717:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fdb9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.781724:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fdb9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.781736:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fdb9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.781742:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17f800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263336.781745:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fdb9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.781752:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fdb9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.781762:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff282126d00) 00010000:00010000:2.0:1788263336.781765:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263336.781768:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fdb9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.781775:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666fdb9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788263336.781790:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086bede12 reply state 0000000042138867 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba666fdc0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.781798:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba666fdc0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.781804:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ff3b3a5e600) 00010000:00010000:2.0:1788263336.781806:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788263336.781808:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788263336.781887:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+15:12160:x1875129699214208:12345-192.168.203.26@tcp:36:lfs.0 Request processed in 21173us (21484us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788263336.781896:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 154 00000100:00100000:3.0:1788263336.847064:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263336.847198:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699214464 00000100:00100000:0.0:1788263336.847221:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699214464 00000100:00100000:0.0:1788263336.847280:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 155 00000100:00100000:0.0:1788263336.847290:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28398a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+15:12168:x1875129699214464:12345-192.168.203.26@tcp:101:lctl.0 00010000:00010000:0.0:1788263336.847314:0:8884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263336.847336:0:8884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fdce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ffcf expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263336.847426:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fdd5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263336.847438:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fdd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263336.847448:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fdd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263336.847493:0:8884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788263336.847497:0:8884:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788263336.847523:0:8884:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fdd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263336.847546:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fdce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffcf expref: 17 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263336.847564:0:8884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fdd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffcf expref: 16 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263336.847572:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff282279000) 00010000:00010000:0.0:1788263336.847575:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788263336.847609:0:8884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17f600, rc 0) 00000100:00100000:0.0:1788263336.847664:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28398a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+16:12168:x1875129699214464:12345-192.168.203.26@tcp:101:lctl.0 Request processed in 375us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263336.847672:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 155 00000100:00100000:2.0:1788263336.920659:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263336.920722:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699214592 00000100:00100000:1.0:1788263336.920731:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699214592 00000100:00100000:1.0:1788263336.920780:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 156 00000100:00100000:1.0:1788263336.920789:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+16:12174:x1875129699214592:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1788263336.920854:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263336.920877:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666fddc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ffd6 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.920941:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666fde3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.920956:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666fde3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.920967:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666fde3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.920978:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fdea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.920998:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fdea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.921006:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fdea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.921079:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e200/0x4b1103cba666fdf1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.921088:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e200/0x4b1103cba666fdf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.921108:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e200/0x4b1103cba666fdf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263336.921164:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788263336.921168:0:10388:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788263336.921187:0:10388:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e200/0x4b1103cba666fdf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.921198:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666fde3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.921215:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666fde3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.921222:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666fde3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.921228:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150fa00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263336.921232:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666fde3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.921239:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666fde3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.921251:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff282279000) 00010000:00010000:3.0:1788263336.921254:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263336.921259:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666fde3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.921265:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666fde3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.921295:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fdea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.921301:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fdea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.921306:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fdea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.921310:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150f000 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263336.921313:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fdea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.921319:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fdea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.921326:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ff3b3a5e600) 00010000:00010000:3.0:1788263336.921329:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263336.921332:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fdea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.921338:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fdea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.921363:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666fddc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffd6 expref: 18 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.921378:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e200/0x4b1103cba666fdf1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffd6 expref: 17 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.921396:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:3.0:1788263336.921411:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788263336.921413:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150e200, rc 0) 00000100:00100000:3.0:1788263336.921476:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+17:12174:x1875129699214592:12345-192.168.203.26@tcp:101:bash.0 Request processed in 687us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263336.921484:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 156 00000100:00100000:0.0:1788263336.926567:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263336.926885:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699214848 00000100:00100000:2.0:1788263336.926896:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699214848 00000100:00100000:2.0:1788263336.926953:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 157 00000100:00100000:2.0:1788263336.926963:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+17:12174:x1875129699214848:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:2.0:1788263336.926992:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263336.927013:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba666fdf8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ffdd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.927110:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fdff lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.927125:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fdff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.927137:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fdff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.927186:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fe06 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.927193:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fe06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.927200:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fe06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788263336.927813:0:6493:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788263336.927941:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666fe0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.927951:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666fe0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.927972:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666fe0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.928173:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fdff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.928181:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fdff lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.928187:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fdff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.928193:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1000 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263336.928197:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fdff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.928262:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fdff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.928277:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:2.0:1788263336.928280:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263336.928285:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fdff lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.928290:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fdff lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788263336.928304:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ea86277 reply state 0000000071b0c85a transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fe06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.928314:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fe06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.928326:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ff3b3a5e400) 00010000:00010000:2.0:1788263336.928329:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788263336.928332:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788263336.928364:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba666fdf8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffdd expref: 20 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.928379:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666fe0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffdd expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.928386:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e900) 00010000:00010000:2.0:1788263336.928389:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788263336.928391:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d0e00, rc 0) 00000100:00100000:2.0:1788263336.928677:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+20:12174:x1875129699214848:12345-192.168.203.26@tcp:101:bash.0 Request processed in 1714us (2117us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1788263336.928686:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 157 00000100:00100000:0.0:1788263336.933084:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263336.933547:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699214976 00000100:00100000:3.0:1788263336.933557:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699214976 00000100:00100000:3.0:1788263336.933647:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:3.0:1788263336.933657:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699214976:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1788263336.933674:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263336.933694:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7428ee1/0x4b1103cba666fe1b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ffe4 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788263336.933720:0:8406:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788263336.933741:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=346s v=(0 0) 00010000:00010000:3.0:1788263336.933746:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263336.933755:0:8406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7428ee1/0x4b1103cba666fe1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffe4 expref: 6 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.933773:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a7428ee1/0x4b1103cba666fe1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffe4 expref: 6 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263336.933786:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150e400, rc 0) 00000100:00100000:3.0:1788263336.933841:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2386:x1875129699214976:12345-192.168.203.26@tcp:101:bash.0 Request processed in 186us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263336.933855:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00080000:2.0:1788263336.934712:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263336.937750:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263336.937823:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699215104 00000100:00100000:2.0:1788263336.937834:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699215104 00000100:00100000:2.0:1788263336.937886:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:2.0:1788263336.937896:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:12174:x1875129699215104:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:2.0:1788263336.937911:0:9885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263336.937929:0:9885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004777656d/0x4b1103cba666fe22 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116ffeb expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.937960:0:9885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7428ee1/0x4b1103cba666fe1b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffe4 expref: 7 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.938002:0:9885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263336.938006:0:9885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263336.938013:0:9885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004777656d/0x4b1103cba666fe22 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffeb expref: 7 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.938046:0:9885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a7428ee1/0x4b1103cba666fe1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffe4 expref: 7 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.938060:0:9885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a7428ee1/0x4b1103cba666fe1b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffe4 expref: 7 pid: 8406 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263336.938075:0:9885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28178dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9885:1875129709775488:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788263336.938171:0:9885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28396a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263336.941697:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263336.941784:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699215232 00000100:00100000:1.0:1788263336.941794:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699215232 00010000:00010000:1.0:1788263336.941830:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a7428ee1/0x4b1103cba666fe1b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffe4 expref: 8 pid: 8406 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263336.941862:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 79 00000100:00100000:1.0:1788263336.941871:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282338000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2387:x1875129699215232:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263336.941885:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263336.941908:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a7428ee1/0x4b1103cba666fe1b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffe4 expref: 8 pid: 8406 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.941923:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a7428ee1/0x4b1103cba666fe1b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffe4 expref: 8 pid: 8406 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.941949:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263336.941953:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263336.941975:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004777656d/0x4b1103cba666fe22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffeb expref: 8 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.941997:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004777656d/0x4b1103cba666fe22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffeb expref: 8 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263336.942035:0:6478:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004777656d/0x4b1103cba666fe22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffeb expref: 8 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263336.942050:0:6478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283955500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6478:1875129709775616:192.168.203.26@tcp:105: 00000100:00100000:1.0:1788263336.942126:0:6478:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2831289c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788263336.942554:0:9885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7428ee1/0x4b1103cba666fe1b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffe4 expref: 8 pid: 8406 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263336.942571:0:9885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28178dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9885:1875129709775488:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788263336.942615:0:9885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004777656d/0x4b1103cba666fe22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffeb expref: 7 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263336.942628:0:9885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d1800, rc 0) 00000100:00100000:2.0:1788263336.942670:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:12174:x1875129699215104:12345-192.168.203.26@tcp:101:bash.0 Request processed in 4775us (4929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263336.942688:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:1.0:1788263336.945529:0:6478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283955500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6478:1875129709775616:192.168.203.26@tcp:105: 00010000:00010000:1.0:1788263336.945555:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263336.945637:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282338000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2387:x1875129699215232:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 3766us (3948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263336.945647:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 79 00000100:00100000:3.0:1788263336.948755:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263336.949689:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699215488 00000100:00100000:0.0:1788263336.949700:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699215488 00000100:00100000:0.0:1788263336.949794:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 36 00000100:00100000:0.0:1788263336.949805:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+20:12174:x1875129699215488:12345-192.168.203.26@tcp:35:bash.0 00000100:00100000:0.0:1788263336.950156:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+21:12174:x1875129699215488:12345-192.168.203.26@tcp:35:bash.0 Request processed in 343us (1401us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1788263336.950165:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 36 00000100:00100000:3.0:1788263337.040678:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263337.040781:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699215744 00000100:00100000:2.0:1788263337.040791:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699215744 00000100:00100000:2.0:1788263337.040847:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 158 00000100:00100000:2.0:1788263337.040857:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+21:12184:x1875129699215744:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788263337.040879:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263337.040899:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba666fe29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fff2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263337.041002:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788263337.041097:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba666fe29 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fff2 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.041112:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff282279000) 00010000:00010000:2.0:1788263337.041115:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788263337.041120:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba666fe29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fff2 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.041135:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d1200, rc 0) 00000100:00100000:2.0:1788263337.041202:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:12184:x1875129699215744:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 346us (534us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1788263337.041210:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 158 00000100:00100000:3.0:1788263337.045549:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263337.045667:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699216000 00000100:00100000:1.0:1788263337.045675:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699216000 00000100:00100000:1.0:1788263337.045728:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 37 00000100:00100000:1.0:1788263337.045738:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:12184:x1875129699216000:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1788263337.045935:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+23:12184:x1875129699216000:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 198us (395us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788263337.045943:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 37 00000100:00100000:0.0:1788263337.077357:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263337.077395:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263337.077420:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263337.077458:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263337.077485:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699216128 00000100:00100000:0.0:1788263337.077493:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699216128 00000100:00100000:0.0:1788263337.077549:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 393 00000100:00100000:0.0:1788263337.077558:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2386:x1875129699216128:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263337.077647:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2386:x1875129699216128:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 90us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263337.077655:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 393 00000100:00100000:1.0:1788263337.077671:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699216512 00000100:00100000:1.0:1788263337.077675:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699216512 00000100:00100000:1.0:1788263337.077712:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 148 00000100:00100000:1.0:1788263337.077732:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2386:x1875129699216512:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263337.077761:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2386:x1875129699216512:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 31us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263337.077767:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 148 00000100:00080000:2.0:1788263337.077888:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788263337.077900:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699216256 00000100:00100000:2.0:1788263337.077904:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699216256 00000100:00100000:2.0:1788263337.077947:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699216768 00000100:00100000:2.0:1788263337.077951:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699216768 00000100:00100000:2.0:1788263337.077983:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 335 00000100:00100000:2.0:1788263337.077991:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699216256:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263337.078028:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699216256:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 38us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263337.078035:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 335 00000100:00100000:2.0:1788263337.078047:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 336 00000100:00100000:2.0:1788263337.078053:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699216768:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263337.078076:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699216768:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 23us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263337.078082:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 336 00000100:00080000:0.0:1788263337.078166:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788263337.082116:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263337.082185:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263337.082196:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699216384 00000100:00100000:2.0:1788263337.082310:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699216384 00000100:00100000:2.0:1788263337.082370:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 149 00000100:00100000:2.0:1788263337.082380:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2386:x1875129699216384:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263337.082504:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2386:x1875129699216384:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 126us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263337.082513:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 149 00000100:00100000:3.0:1788263337.083093:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699216640 00000100:00100000:3.0:1788263337.083100:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699216640 00000100:00100000:3.0:1788263337.083140:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 337 00000100:00100000:3.0:1788263337.083157:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699216640:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263337.083195:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699216640:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 49us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263337.083202:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 337 00000100:00100000:2.0:1788263337.126502:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263337.126648:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699216896 00000100:00100000:0.0:1788263337.126658:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699216896 00000100:00100000:0.0:1788263337.126719:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 159 00000100:00100000:0.0:1788263337.126729:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28178dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+23:12190:x1875129699216896:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788263337.126753:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263337.126787:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fe37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d116fff9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.126853:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fe3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.126868:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fe3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.126881:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fe3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263337.126923:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788263337.126927:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788263337.126945:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fe3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.126971:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fe37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fff9 expref: 25 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.127109:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fe3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fff9 expref: 24 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.127119:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:0.0:1788263337.127121:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788263337.127125:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bd17e200, rc 0) 00000100:00100000:0.0:1788263337.127200:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28178dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+24:12190:x1875129699216896:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 472us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263337.127207:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 159 00000100:00100000:1.0:1788263337.131645:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263337.131774:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699217152 00000100:00100000:3.0:1788263337.131784:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699217152 00000100:00100000:3.0:1788263337.131844:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 160 00000100:00100000:3.0:1788263337.131854:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+24:12190:x1875129699217152:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788263337.131874:0:8884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263337.131892:0:8884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666fe45 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170000 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.132090:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fe4c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.132103:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fe4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.132114:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fe4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263337.132139:0:8884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788263337.132358:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666fe45 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170000 expref: 27 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.132378:0:8884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fe4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170000 expref: 26 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.132387:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e900) 00010000:00010000:3.0:1788263337.132390:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263337.132394:0:8884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150f000, rc 0) 00000100:00100000:3.0:1788263337.132520:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+26:12190:x1875129699217152:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 666us (883us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1788263337.132529:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 160 00000100:00100000:0.0:1788263337.139173:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263337.139646:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263337.139718:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699217408 00000100:00100000:2.0:1788263337.139728:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699217408 00000100:00100000:2.0:1788263337.139779:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 161 00000100:00100000:2.0:1788263337.139788:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+26:12190:x1875129699217408:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788263337.139809:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263337.139829:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fe5a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170007 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.139933:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666fe61 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.139948:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666fe61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.139960:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666fe61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263337.139972:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788263337.140077:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba666fe5a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170007 expref: 29 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.140094:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666fe61 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170007 expref: 28 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.140102:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e900) 00010000:00010000:2.0:1788263337.140105:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788263337.140109:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d1600, rc 0) 00000100:00100000:2.0:1788263337.140177:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+28:12190:x1875129699217408:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 390us (1015us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1788263337.140184:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 161 00000100:00100000:1.0:1788263337.141625:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699217536 00000100:00100000:1.0:1788263337.141635:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699217536 00000100:00100000:2.0:1788263337.141820:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:2.0:1788263337.141830:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+28:2388:x1875129699217536:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263337.141842:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263337.141862:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666fe4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170000 expref: 28 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.141897:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e900) 00010000:00010000:2.0:1788263337.141901:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263337.141950:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+27:2388:x1875129699217536:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 122us (2306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263337.141958:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:2.0:1788263337.148867:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263337.148949:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699217664 00000100:00100000:3.0:1788263337.148959:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699217664 00000100:00100000:3.0:1788263337.149020:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:3.0:1788263337.149030:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2387:x1875129699217664:12345-192.168.203.26@tcp:1:lfs.0 00010000:00010000:3.0:1788263337.149073:0:9885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fda1e11/0x4b1103cba666fe6f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.149092:0:9885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004777656d/0x4b1103cba666fe22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffeb expref: 6 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.149100:0:9885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263337.149104:0:9885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788263337.149109:0:9885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fda1e11/0x4b1103cba666fe6f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.149166:0:9885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004777656d/0x4b1103cba666fe22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffeb expref: 6 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.149181:0:9885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004777656d/0x4b1103cba666fe22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffeb expref: 6 pid: 9885 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263337.149196:0:9885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9885:1875129709775744:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788263337.149318:0:9885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff398e9e780 going to sleep for 11 seconds 00000100:00100000:3.0:1788263337.152774:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263337.152885:0:9885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9885:1875129709775744:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788263337.152912:0:9885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004fda1e11/0x4b1103cba666fe6f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263337.153099:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699217792 00000100:00100000:0.0:1788263337.153106:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699217792 00002000:00100000:0.0:1788263337.153159:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9ff2831f1880 x1875129699217792/t0(0) o4->ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp:548/0 lens 504/0 e 0 to 0 dl 1788263348 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788263337.153169:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ff2831f1880 with x1875129699217792 ext(0->12) 00010000:00010000:0.0:1788263337.153176:0:8410:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004777656d/0x4b1103cba666fe22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffeb expref: 7 pid: 9885 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.153190:0:8410:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004777656d/0x4b1103cba666fe22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffeb expref: 7 pid: 9885 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788263337.153197:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ff2831f1880 00000100:00100000:0.0:1788263337.153253:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:0.0:1788263337.153262:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2389:x1875129699217792:12345-192.168.203.26@tcp:4:lfs.0 00000100:00100000:0.0:1788263337.154133:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:2389:x1875129699217792:12345-192.168.203.26@tcp:4:lfs.0 Request processed in 869us (1365us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788263337.154152:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 2 00002000:00100000:0.0:1788263337.154160:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9ff2831f1880 x1875129699217792/t4294967306(0) o4->ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp:548/0 lens 504/448 e 0 to 0 dl 1788263348 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788263337.154169:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ff2831f1880 with x1875129699217792 ext(0->12) 00010000:00010000:0.0:1788263337.154175:0:8410:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004777656d/0x4b1103cba666fe22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffeb expref: 9 pid: 9885 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.154187:0:8410:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004777656d/0x4b1103cba666fe22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffeb expref: 9 pid: 9885 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788263337.154201:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ff2831f1880 00000100:00100000:0.0:1788263337.159617:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263337.159735:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699217920 00000100:00100000:3.0:1788263337.159745:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699217920 00010000:00010000:3.0:1788263337.159782:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004777656d/0x4b1103cba666fe22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffeb expref: 9 pid: 9885 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263337.159823:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 80 00000100:00100000:3.0:1788263337.159833:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:2389:x1875129699217920:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263337.159847:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788263337.159864:0:6476:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788263337.159867:0:6476:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788263336 00002000:00010000:3.0:1788263337.159869:0:6476:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788263336 00002000:00010000:3.0:1788263337.159871:0:6476:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788263336 00002000:00010000:3.0:1788263337.159874:0:6476:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788263337.159880:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004777656d/0x4b1103cba666fe22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffeb expref: 9 pid: 9885 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.159914:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004777656d/0x4b1103cba666fe22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffeb expref: 9 pid: 9885 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.159937:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004777656d/0x4b1103cba666fe22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffeb expref: 9 pid: 9885 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.159952:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788263337.159957:0:6476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788263337.159963:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004fda1e11/0x4b1103cba666fe6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.159973:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fda1e11/0x4b1103cba666fe6f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.160016:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263337.160073:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2389:x1875129699217920:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 241us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263337.160082:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 80 00010000:00010000:2.0:1788263337.160197:0:9885:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004fda1e11/0x4b1103cba666fe6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.160217:0:9885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fda1e11/0x4b1103cba666fe6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.160238:0:9885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fda1e11/0x4b1103cba666fe6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.160247:0:9885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fda1e11/0x4b1103cba666fe6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.160255:0:9885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fda1e11/0x4b1103cba666fe6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.160273:0:9885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150f600 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:2.0:1788263337.160278:0:9885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fda1e11/0x4b1103cba666fe6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.160287:0:9885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fda1e11/0x4b1103cba666fe6f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.160299:0:9885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fda1e11/0x4b1103cba666fe6f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.160307:0:9885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fda1e11/0x4b1103cba666fe6f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263337.160357:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2387:x1875129699217664:12345-192.168.203.26@tcp:1:lfs.0 Request processed in 11328us (11497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263337.160365:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:2.0:1788263337.163439:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263337.163572:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699218176 00000100:00100000:1.0:1788263337.163621:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699218176 00000100:00100000:1.0:1788263337.163673:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 38 00000100:00100000:1.0:1788263337.163683:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a973f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+27:12190:x1875129699218176:12345-192.168.203.26@tcp:35:lfs.0 00000004:00010000:1.0:1788263337.163743:0:6495:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666fe61 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170007 expref: 27 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788263337.163916:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1788263337.163952:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788263337.164262:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1788263337.164296:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666fe76 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.164309:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666fe0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffdd expref: 31 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.164319:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666fe76 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.164348:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666fe0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffdd expref: 31 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.164380:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666fe0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffdd expref: 31 pid: 6493 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263337.164394:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283955c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6495:1875129709775872:192.168.203.26@tcp:104: 00000100:00100000:1.0:1788263337.164603:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff283128d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788263337.167237:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283955c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6495:1875129709775872:192.168.203.26@tcp:104: 00010000:00010000:1.0:1788263337.167265:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666fe76 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263337.168861:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263337.169176:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699218304 00000100:00100000:0.0:1788263337.169186:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699218304 00010000:00010000:0.0:1788263337.169242:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666fe0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffdd expref: 32 pid: 6493 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263337.169282:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 81 00000100:00100000:0.0:1788263337.169293:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+32:2386:x1875129699218304:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263337.169308:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263337.169315:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666fe0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffdd expref: 32 pid: 6493 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.169327:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666fe0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffdd expref: 32 pid: 6493 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.169351:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba666fe0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffdd expref: 32 pid: 6493 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.169366:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e900) 00010000:00010000:0.0:1788263337.169371:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666fe76 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.169380:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666fe76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.169386:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666fe76 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.169437:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263337.169774:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+31:2386:x1875129699218304:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 481us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263337.169782:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 81 00010000:00010000:2.0:1788263337.169845:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666fe76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.169854:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666fe76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788263337.169959:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:2.0:1788263337.170089:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1788263337.170194:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b8ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6495:1875129709776000:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788263337.170258:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263337.170293:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28396a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788263337.170410:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709776000 00000100:00100000:0.0:1788263337.170416:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709776000 00000100:00100000:0.0:1788263337.170463:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788263337.170471:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6495:x1875129709776000:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788263337.170540:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6495:x1875129709776000:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 70us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263337.170547:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:2.0:1788263337.170810:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263337.170838:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b8ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6495:1875129709776000:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788263337.170934:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1788263337.170971:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b8ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6495:1875129709776128:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788263337.171009:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263337.171030:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28396a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788263337.171076:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709776128 00000100:00100000:0.0:1788263337.171080:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709776128 00000100:00100000:0.0:1788263337.171103:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788263337.171110:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6495:x1875129709776128:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788263337.171273:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6495:x1875129709776128:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 162us (262us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788263337.171279:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788263337.171612:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b8ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6495:1875129709776128:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788263337.171647:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1788263337.171676:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666fe76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.171684:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666fe76 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.171691:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666fe76 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.171696:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381680200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263337.171701:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666fe76 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.171708:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666fe76 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.171721:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e900) 00010000:00010000:2.0:1788263337.171724:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788263337.171739:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666fe76 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.171744:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba666fe76 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788263337.171830:0:6495:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788263337.171891:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1788263337.171902:0:6495:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 346243322123ns, next at 347243320447ns, rc = 0 00000001:00080000:2.0:1788263337.171907:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1788263337.171927:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e900) 00010000:00010000:2.0:1788263337.171931:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788263337.171937:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666fe61 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170007 expref: 35 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263337.172026:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a973f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+34:12190:x1875129699218176:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 8344us (8594us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1788263337.172033:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 38 00000020:00080000:2.0:1788263337.172037:0:6495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788263337.176044:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263337.176229:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699218432 00000100:00100000:2.0:1788263337.176239:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699218432 00000100:00100000:2.0:1788263337.176296:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 162 00000100:00100000:2.0:1788263337.176306:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+34:12190:x1875129699218432:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788263337.176328:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263337.176351:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fe7d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d117000e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.176414:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fe7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117000e expref: 35 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.176447:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fe7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117000e expref: 35 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.176467:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:2.0:1788263337.176470:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263337.176474:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d0a00, rc 0) 00000100:00100000:2.0:1788263337.176531:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+35:12190:x1875129699218432:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 226us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263337.176538:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 162 00000100:00100000:3.0:1788263337.180665:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263337.180758:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699218688 00000100:00100000:0.0:1788263337.180768:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699218688 00000100:00100000:0.0:1788263337.180815:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 39 00000100:00100000:0.0:1788263337.180825:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+35:12190:x1875129699218688:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:0.0:1788263337.181048:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+36:12190:x1875129699218688:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 223us (391us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788263337.181072:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 39 00000100:00100000:2.0:1788263337.274554:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263337.274747:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699218944 00000100:00100000:3.0:1788263337.274759:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699218944 00000100:00100000:3.0:1788263337.274817:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 163 00000100:00100000:3.0:1788263337.274828:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+36:12200:x1875129699218944:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788263337.274852:0:8884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263337.274872:0:8884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666fe84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170015 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263337.274995:0:8884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788263337.275094:0:8884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666fe84 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170015 expref: 38 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.275109:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff282279000) 00010000:00010000:3.0:1788263337.275112:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788263337.275117:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666fe84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170015 expref: 38 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.275132:0:8884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150fa00, rc 0) 00000100:00100000:3.0:1788263337.275201:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+37:12200:x1875129699218944:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 374us (656us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1788263337.275789:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 163 00000100:00100000:3.0:1788263337.282636:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263337.282731:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699219072 00000100:00100000:1.0:1788263337.282740:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699219072 00000100:00100000:1.0:1788263337.282799:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 164 00000100:00100000:1.0:1788263337.282809:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+37:12200:x1875129699219072:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:1.0:1788263337.282882:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba666fe92 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.282899:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba666fe92 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.282910:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba666fe92 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.282921:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666fe99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.282929:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666fe99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.282954:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666fe99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.283041:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666fea0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.283050:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666fea0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.283057:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666fea0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788263337.283102:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666fea0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.283116:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba666fe92 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.283123:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba666fe92 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.283130:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba666fe92 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.283135:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381681600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263337.283139:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba666fe92 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.283156:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba666fe92 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.283168:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:1.0:1788263337.283176:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263337.283181:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba666fe92 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.283187:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba666fe92 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.283201:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666fe99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.283220:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666fe99 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.283227:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666fe99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.283232:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381681800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263337.283236:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666fe99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.283242:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666fe99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.283251:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ff3b3a5e400) 00010000:00010000:1.0:1788263337.283253:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263337.283256:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666fe99 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.283262:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba666fe99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.283271:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666fea0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.283295:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666fea0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.283301:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666fea0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.283307:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381680a00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263337.283310:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666fea0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.283316:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666fea0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.283325:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:1.0:1788263337.283328:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263337.283331:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666fea0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.283337:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba666fea0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263337.283417:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+37:12200:x1875129699219072:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 608us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263337.283426:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 164 00000100:00100000:0.0:1788263337.286679:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263337.286788:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699219328 00000100:00100000:3.0:1788263337.286798:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699219328 00000100:00100000:3.0:1788263337.286850:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 40 00000100:00100000:3.0:1788263337.286860:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+37:12200:x1875129699219328:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1788263337.287068:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+38:12200:x1875129699219328:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 209us (397us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788263337.287076:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 40 00000100:00100000:3.0:1788263337.335925:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263337.336074:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699219584 00000100:00100000:0.0:1788263337.336084:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699219584 00000100:00100000:0.0:1788263337.336173:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 165 00000100:00100000:0.0:1788263337.336183:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+38:12203:x1875129699219584:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788263337.336214:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263337.336234:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fea7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d117001c expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.336306:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666feae lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.336320:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666feae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.336330:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666feae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.336339:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666feb5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.336346:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666feb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.336353:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666feb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.336455:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666febc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.336474:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666febc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.336481:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666febc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263337.336491:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788263337.336555:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666feae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.336562:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666feae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.336569:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666feae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.336575:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17f800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263337.336607:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666feae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.336615:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666feae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.336625:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:0.0:1788263337.336628:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263337.336633:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666feae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.336639:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f800/0x4b1103cba666feae lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.336650:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666feb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.336662:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666feb5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.336668:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666feb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.336673:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263337.336677:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666feb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.336683:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666feb5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.336691:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ff3b3a5e400) 00010000:00010000:0.0:1788263337.336694:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263337.336696:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666feb5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.336702:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba666feb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.336734:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e400/0x4b1103cba666fea7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117001c expref: 41 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.336745:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666febc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117001c expref: 40 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263337.336752:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:0.0:1788263337.336754:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263337.336761:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3829e8800, rc 0) 00000100:00100000:0.0:1788263337.336967:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+40:12203:x1875129699219584:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 784us (1050us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788263337.336976:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 165 00000100:00100000:0.0:1788263337.342561:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263337.342726:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699219712 00000100:00100000:2.0:1788263337.342736:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699219712 00000100:00100000:2.0:1788263337.342830:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 166 00000100:00100000:2.0:1788263337.342840:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+40:12203:x1875129699219712:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:2.0:1788263337.342905:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666feca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.342921:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666feca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.342932:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666feca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.342966:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666feca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.342973:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666feca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.343007:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666feca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.343013:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263337.343018:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666feca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.343026:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666feca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.343038:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:2.0:1788263337.343041:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788263337.343045:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666feca lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.343052:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666feca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263337.343126:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+40:12203:x1875129699219712:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 287us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263337.343134:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 166 00000100:00100000:3.0:1788263337.345421:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263337.345509:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699219968 00000100:00100000:0.0:1788263337.345518:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699219968 00000100:00100000:0.0:1788263337.345576:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:0.0:1788263337.345613:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+40:12203:x1875129699219968:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:0.0:1788263337.345826:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+41:12203:x1875129699219968:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 214us (411us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788263337.345834:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:3.0:1788263337.641441:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263337.641773:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699220224 00000100:00100000:2.0:1788263337.641783:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699220224 00000100:00100000:2.0:1788263337.641995:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 167 00000100:00100000:2.0:1788263337.642007:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+41:12234:x1875129699220224:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:2.0:1788263337.642031:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263337.642051:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666fed1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170023 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.642184:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666fed8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.642199:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666fed8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.642220:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666fed8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263337.642231:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788263337.642342:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666fed1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170023 expref: 44 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.642360:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666fed8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170023 expref: 43 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.642369:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:2.0:1788263337.642372:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788263337.642375:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d0800, rc 0) 00000100:00100000:2.0:1788263337.642456:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+43:12234:x1875129699220224:12345-192.168.203.26@tcp:101:cat.0 Request processed in 451us (1024us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788263337.642463:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 167 00000100:00100000:0.0:1788263337.645933:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263337.647216:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699220352 00000100:00100000:3.0:1788263337.647238:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699220352 00000100:00100000:3.0:1788263337.647314:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:3.0:1788263337.647325:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+43:2388:x1875129699220352:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263337.647341:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263337.647362:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba666fed8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170023 expref: 43 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.647381:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:3.0:1788263337.647386:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263337.647459:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+42:2388:x1875129699220352:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 135us (1533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263337.647467:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:0.0:1788263337.647804:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263337.648329:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699220608 00000100:00100000:3.0:1788263337.648336:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699220608 00000100:00100000:3.0:1788263337.648381:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:3.0:1788263337.648390:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+42:12234:x1875129699220608:12345-192.168.203.26@tcp:35:cat.0 00000100:00100000:3.0:1788263337.648621:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+43:12234:x1875129699220608:12345-192.168.203.26@tcp:35:cat.0 Request processed in 231us (816us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1788263337.648628:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 42 00010000:00010000:1.0:1788263337.649283:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263337.727273:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263337.727481:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699220864 00000100:00100000:3.0:1788263337.727492:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699220864 00000100:00100000:3.0:1788263337.727553:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 168 00000100:00100000:3.0:1788263337.727565:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+43:12240:x1875129699220864:12345-192.168.203.26@tcp:101:dd.0 00010000:00010000:3.0:1788263337.727619:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263337.727623:0:10388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788263337.727647:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e200/0x4b1103cba666fe3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fff9 expref: 43 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.727681:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:3.0:1788263337.727685:0:10388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263337.727698:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666fee6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d117002a expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.727797:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666feed lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.727811:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666febc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117001c expref: 43 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.727820:0:10388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666feed lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.727850:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666febc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117001c expref: 43 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.727864:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666febc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117001c expref: 43 pid: 10388 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263337.727877:0:10388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10388:1875129709776256:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788263337.727967:0:10388:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff398e9e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788263337.732535:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263337.732652:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699220992 00000100:00100000:1.0:1788263337.732661:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699220992 00010000:00010000:1.0:1788263337.732701:0:9493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666febc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117001c expref: 44 pid: 10388 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263337.732752:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 82 00000100:00100000:1.0:1788263337.732761:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0456c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+44:2387:x1875129699220992:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263337.732775:0:9493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263337.732782:0:9493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666febc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117001c expref: 44 pid: 10388 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.732807:0:9493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666febc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117001c expref: 44 pid: 10388 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.732828:0:9493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:1.0:1788263337.732833:0:9493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666feed lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.732843:0:9493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666feed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.732850:0:9493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666feed lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263337.732866:0:9493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263337.732911:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0456c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+44:2387:x1875129699220992:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 151us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263337.732918:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 82 00010000:00010000:3.0:1788263337.733502:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba666febc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117001c expref: 43 pid: 10388 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263337.733519:0:10388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10388:1875129709776256:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263337.733549:0:10388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666feed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.733558:0:10388:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666feed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.733563:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666feed lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263337.733595:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788263337.733714:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666fee6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117002a expref: 44 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.733730:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666feed lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117002a expref: 43 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.733737:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:3.0:1788263337.733739:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788263337.733742:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150ee00, rc 0) 00000100:00100000:3.0:1788263337.733792:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+43:12240:x1875129699220864:12345-192.168.203.26@tcp:101:dd.0 Request processed in 6223us (6521us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1788263337.733799:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 168 00000100:00100000:2.0:1788263337.738281:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263337.738426:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699221120 00000100:00100000:3.0:1788263337.738436:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699221120 00000100:00100000:3.0:1788263337.738493:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 169 00000100:00100000:3.0:1788263337.738504:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+43:12240:x1875129699221120:12345-192.168.203.26@tcp:101:dd.0 00010000:00010000:3.0:1788263337.738526:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263337.738545:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666fefb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170031 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.738630:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba666ff02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.738644:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba666ff02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.738656:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba666ff02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.738766:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666fefb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170031 expref: 45 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.738797:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba666ff02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170031 expref: 44 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263337.738807:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:3.0:1788263337.738810:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788263337.738814:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150f600, rc 0) 00000100:00100000:3.0:1788263337.738865:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+44:12240:x1875129699221120:12345-192.168.203.26@tcp:101:dd.0 Request processed in 363us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263337.738873:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 169 00000100:00100000:0.0:1788263337.741984:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263337.742109:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699221376 00000100:00100000:2.0:1788263337.742118:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699221376 00000100:00100000:2.0:1788263337.742182:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 170 00000100:00100000:2.0:1788263337.742194:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+44:12240:x1875129699221376:12345-192.168.203.26@tcp:36:dd.0 00010000:00010000:2.0:1788263337.742449:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666ff09 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.742466:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666ff09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.742477:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666ff09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788263337.742516:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1788263337.742537:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005015e917 reply state 00000000de09d8ea transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666ff09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.742549:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666ff09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263337.742557:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:2.0:1788263337.742560:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788263337.742563:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788263337.742660:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+47:12240:x1875129699221376:12345-192.168.203.26@tcp:36:dd.0 Request processed in 468us (689us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1788263337.742670:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 170 00000020:00080000:2.0:1788263337.742675:0:6492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788263338.014246:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263338.015167:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699221504 00000100:00100000:3.0:1788263338.015180:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699221504 00000100:00100000:3.0:1788263338.015291:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 171 00000100:00100000:3.0:1788263338.015306:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+47:12254:x1875129699221504:12345-192.168.203.26@tcp:101:stat.0 00010000:00010000:3.0:1788263338.015339:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263338.015368:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666ff10 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170038 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.015484:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666ff17 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.015502:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666ff17 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.015518:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666ff17 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.015529:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ff1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.015537:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ff1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.015543:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ff1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.015669:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.015680:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666feed lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117002a expref: 48 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.015689:0:10388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff25 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.015730:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666feed lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117002a expref: 48 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.015758:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666feed lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117002a expref: 48 pid: 10388 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263338.015775:0:10388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10388:1875129709776384:192.168.203.26@tcp:104: 00000100:00080000:2.0:1788263338.016235:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263338.017386:0:10388:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff398e9e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788263338.030418:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263338.030658:0:10388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10388:1875129709776384:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263338.030695:0:10388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263338.031013:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699221760 00000100:00100000:1.0:1788263338.031022:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699221760 00000100:00100000:1.0:1788263338.031104:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 43 00000100:00100000:1.0:1788263338.031136:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+49:10746:x1875129699221760:12345-192.168.203.26@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788263338.031905:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+50:10746:x1875129699221760:12345-192.168.203.26@tcp:35:ldlm_bl.0 Request processed in 766us (1495us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1788263338.031916:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 43 00000100:00100000:3.0:1788263338.033269:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788263338.033300:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709776512:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788263338.033379:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263338.034880:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788263338.034909:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709776640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788263338.034982:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263338.035040:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709776512 00000100:00100000:2.0:1788263338.035047:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709776512 00000100:00100000:2.0:1788263338.035101:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709776640 00000100:00100000:2.0:1788263338.035105:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709776640 00000100:00100000:2.0:1788263338.035305:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788263338.035316:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709776512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788263338.035351:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788263338.035400:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709776512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263338.035407:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788263338.035425:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788263338.035432:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709776640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788263338.035447:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788263338.035479:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709776640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263338.035485:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788263338.035523:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709776640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788263338.035556:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709776512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788263338.040216:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263338.040509:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699221888 00000100:00100000:3.0:1788263338.040522:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699221888 00010000:00010000:3.0:1788263338.040610:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666feed lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117002a expref: 50 pid: 10388 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263338.040662:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 83 00000100:00100000:3.0:1788263338.040673:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5473800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+50:2386:x1875129699221888:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263338.040692:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263338.040700:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666feed lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117002a expref: 50 pid: 10388 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.040716:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666feed lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117002a expref: 50 pid: 10388 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.040766:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666feed lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117002a expref: 50 pid: 10388 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.040786:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:3.0:1788263338.040792:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.040803:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.040811:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff25 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.040850:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263338.040931:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5473800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+49:2386:x1875129699221888:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 259us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263338.040939:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 83 00010000:00010000:0.0:1788263338.041528:0:10388:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.041541:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263338.041637:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788263338.041642:0:10388:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788263338.041668:0:10388:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.041701:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.041711:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666ff17 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.041719:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666ff17 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.041725:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666ff17 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.041732:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150fa00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263338.041736:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666ff17 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.041744:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666ff17 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.041757:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:0.0:1788263338.041760:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263338.041765:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666ff17 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.041771:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666ff17 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.041787:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ff1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.041793:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ff1e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.041804:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ff1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.041810:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150f000 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263338.041813:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ff1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.041819:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ff1e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.041827:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ff3b3a5e400) 00010000:00010000:0.0:1788263338.041829:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263338.041832:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ff1e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.041838:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ff1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.041879:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666ff10 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170038 expref: 49 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.041895:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170038 expref: 48 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.041903:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:0.0:1788263338.041905:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263338.041908:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150e400, rc 0) 00000100:00100000:0.0:1788263338.041960:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+48:12254:x1875129699221504:12345-192.168.203.26@tcp:101:stat.0 Request processed in 26660us (27730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263338.041976:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 171 00000100:00100000:0.0:1788263338.146796:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263338.147087:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699222144 00000100:00100000:3.0:1788263338.147097:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699222144 00000100:00100000:3.0:1788263338.147168:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 172 00000100:00100000:3.0:1788263338.147179:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+48:12260:x1875129699222144:12345-192.168.203.26@tcp:36:truncate.0 00010000:00010000:3.0:1788263338.147236:0:8884:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263338.147262:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170038 expref: 48 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.147283:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:3.0:1788263338.147288:0:8884:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263338.148789:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666ff2c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.148809:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666ff2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.148819:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666ff2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788263338.148867:0:8884:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1788263338.148905:0:8884:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042eab811 reply state 0000000082b56d5e transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666ff2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.148918:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666ff2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.148926:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:3.0:1788263338.148929:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788263338.148932:0:8884:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788263338.149114:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+50:12260:x1875129699222144:12345-192.168.203.26@tcp:36:truncate.0 Request processed in 1933us (2323us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788263338.149124:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 172 00000020:00080000:3.0:1788263338.149129:0:8884:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788263338.384650:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263338.384738:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699222272 00000100:00100000:3.0:1788263338.384749:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699222272 00000100:00100000:3.0:1788263338.384799:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 173 00000100:00100000:3.0:1788263338.384810:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+50:12274:x1875129699222272:12345-192.168.203.26@tcp:101:stat.0 00010000:00010000:3.0:1788263338.384835:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263338.384856:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff33 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d117003f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.384937:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666ff3a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.384952:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666ff3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.384962:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666ff3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.384975:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666ff41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.384983:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666ff41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.384991:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666ff41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.385072:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ff48 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.385081:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ff48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.385088:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ff48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263338.385129:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788263338.385134:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788263338.385167:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ff48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.385189:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ff48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.385198:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666ff3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.385205:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666ff3a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.385211:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666ff3a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.385218:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150e800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263338.385221:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666ff3a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.385229:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666ff3a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.385241:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:3.0:1788263338.385243:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263338.385248:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666ff3a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.385253:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666ff3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.385265:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666ff41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.385271:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666ff41 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.385282:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666ff41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.385286:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150e600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263338.385288:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666ff41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.385293:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666ff41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.385300:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ff3b3a5e400) 00010000:00010000:3.0:1788263338.385302:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263338.385305:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666ff41 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.385309:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666ff41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.385335:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff33 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117003f expref: 52 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.385346:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ff48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117003f expref: 51 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.385353:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:3.0:1788263338.385354:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263338.385357:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150f000, rc 0) 00000100:00100000:3.0:1788263338.385798:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+51:12274:x1875129699222272:12345-192.168.203.26@tcp:101:stat.0 Request processed in 987us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263338.385816:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 173 00000100:00100000:0.0:1788263338.518417:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263338.519223:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699222528 00000100:00100000:3.0:1788263338.519235:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699222528 00000100:00100000:3.0:1788263338.519406:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 174 00000100:00100000:3.0:1788263338.519415:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+51:12284:x1875129699222528:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788263338.519432:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263338.519447:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170046 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263338.519551:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788263338.519666:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff4f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170046 expref: 53 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.519681:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff282279000) 00010000:00010000:3.0:1788263338.519684:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788263338.519690:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170046 expref: 53 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.519704:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150e400, rc 0) 00000100:00100000:3.0:1788263338.519858:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+52:12284:x1875129699222528:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 443us (1448us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1788263338.519866:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 174 00000001:00080000:0.0:1788263338.523031:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967447 is committed 00000004:00080000:0.0:1788263338.523071:0:6470:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788263338.523092:0:6470:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ff28396a780 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1788263338.523097:0:6470:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ff2833f6e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ff28396acc0 00000020:00080000:0.0:1788263338.523100:0:6470:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ff2833f6600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ff283231a00 00000020:00080000:1.0:1788263338.523171:0:6523:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1788263338.523242:0:6523:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1788263338.523252:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba666fdc0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.523263:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba666fdc0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.523271:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba666fdc0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.523276:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0000 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263338.523280:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba666fdc0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.523304:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba666fdc0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.523321:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ff3b3a5e600) 00010000:00010000:2.0:1788263338.523324:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263338.523328:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba666fdc0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.523335:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba666fdc0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.523353:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba666fdc7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.523360:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba666fdc7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.523365:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba666fdc7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.523370:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263338.523373:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba666fdc7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.523379:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba666fdc7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.523387:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:2.0:1788263338.523389:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263338.523392:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba666fdc7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.523408:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba666fdc7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.523423:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fe06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.523429:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fe06 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.523435:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fe06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.523441:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263338.523444:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fe06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.523449:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fe06 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.523457:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ff3b3a5e400) 00010000:00010000:2.0:1788263338.523459:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788263338.523684:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3a0f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709776768:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788263338.523752:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788263338.523926:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fe06 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.523934:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0400/0x4b1103cba666fe06 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263338.523950:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709776768 00010000:00010000:2.0:1788263338.523953:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666ff09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.523958:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666ff09 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263338.523958:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709776768 00010000:00010000:2.0:1788263338.523970:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666ff09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263338.523998:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788263338.524008:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3619:x1875129709776768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788263338.524031:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00010000:00010000:2.0:1788263338.524041:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263338.524045:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666ff09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.524051:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666ff09 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.524060:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00002000:00010000:1.0:1788263338.524061:0:8406:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a96bba8, atime: 0x6a96bba8, ctime: 0x6a96bba8, blocks: 0x8 00010000:00010000:2.0:1788263338.524063:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263338.524066:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666ff09 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263338.524068:0:8406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f1bf78/0x4b1103cba666ff5d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.524072:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1600/0x4b1103cba666ff09 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263338.524081:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=347s v=(0 0) 00010000:00010000:2.0:1788263338.524084:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666ff2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263338.524085:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263338.524090:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666ff2c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263338.524092:0:8406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f1bf78/0x4b1103cba666ff5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.524096:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666ff2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.524101:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150ee00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263338.524103:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666ff2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263338.524107:0:8406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2f1bf78/0x4b1103cba666ff5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263338.524116:0:8406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f1bf78/0x4b1103cba666ff5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.524118:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666ff2c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.524128:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:2.0:1788263338.524130:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263338.524145:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666ff2c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263338.524145:0:8406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f1bf78/0x4b1103cba666ff5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263338.524152:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666ff2c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263338.524172:0:8406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788263338.524322:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3619:x1875129709776768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 315us (570us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788263338.524330:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000004:00080000:0.0:1788263338.524500:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ff3a0f6f480/2, rc 0, transno 4294967308 00000100:00100000:0.0:1788263338.524507:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3a0f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709776768:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788263338.524863:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263338.524870:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2f1bf78/0x4b1103cba666ff5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.524893:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381681a00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263338.524897:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f1bf78/0x4b1103cba666ff5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.524905:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f1bf78/0x4b1103cba666ff5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.524919:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2f1bf78/0x4b1103cba666ff5d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.524927:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2f1bf78/0x4b1103cba666ff5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.524944:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263338.524945:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263338.524947:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263338.525704:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263338.525757:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699222784 00000100:00100000:3.0:1788263338.525762:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699222784 00000100:00100000:3.0:1788263338.525828:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:3.0:1788263338.525835:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a973fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+17:12284:x1875129699222784:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1788263338.525993:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a973fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+18:12284:x1875129699222784:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 158us (291us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1788263338.526000:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:2.0:1788263338.582090:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263338.582308:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699223040 00000100:00100000:3.0:1788263338.582317:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699223040 00000100:00100000:0.0:1788263338.583289:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 175 00000100:00100000:0.0:1788263338.583303:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+18:12290:x1875129699223040:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1788263338.583328:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263338.583362:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba666ff64 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d117004d expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.583770:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba666ff6b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.583787:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ff48 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117003f expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.583796:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba666ff6b lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.583839:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ff48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117003f expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.583853:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ff48 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117003f expref: 19 pid: 6493 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263338.583867:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5472a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6491:1875129709776896:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788263338.583966:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff283a5ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788263338.592627:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5472a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6491:1875129709776896:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263338.592657:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba666ff6b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263338.593082:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263338.594006:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699223168 00000100:00100000:1.0:1788263338.594017:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699223168 00010000:00010000:1.0:1788263338.594061:0:9493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ff48 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117003f expref: 20 pid: 6493 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263338.594101:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 84 00000100:00100000:1.0:1788263338.594115:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+20:2387:x1875129699223168:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263338.594129:0:9493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263338.594145:0:9493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ff48 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117003f expref: 20 pid: 6493 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263338.594157:0:9493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ff48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117003f expref: 20 pid: 6493 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263338.594179:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ff48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117003f expref: 20 pid: 6493 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263338.594196:0:9493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:1.0:1788263338.594213:0:9493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba666ff6b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263338.594224:0:9493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba666ff6b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263338.594231:0:9493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba666ff6b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263338.594262:0:9493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263338.594311:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+19:2387:x1875129699223168:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 198us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263338.594321:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 84 00010000:00010000:3.0:1788263338.594425:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba666ff6b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.594434:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba666ff6b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263338.594452:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1788263338.594707:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba666ff64 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117004d expref: 20 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.594719:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba666ff6b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117004d expref: 19 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.594723:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:3.0:1788263338.594726:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788263338.594727:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b68400, rc 0) 00000100:00100000:3.0:1788263338.594781:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+19:12290:x1875129699223040:12345-192.168.203.26@tcp:101:bash.0 Request processed in 11484us (12701us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788263338.594786:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 175 00000100:00100000:2.0:1788263338.597423:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263338.597667:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699223424 00000100:00100000:3.0:1788263338.597676:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699223424 00000100:00100000:3.0:1788263338.597766:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 176 00000100:00100000:3.0:1788263338.597775:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+19:12290:x1875129699223424:12345-192.168.203.26@tcp:36:bash.0 00010000:00010000:3.0:1788263338.597991:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff79 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.598032:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.598044:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788263338.598086:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:3.0:1788263338.598105:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006fa449c reply state 000000006303573e transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.598116:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.598123:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:3.0:1788263338.598125:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788263338.598128:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788263338.598212:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:12290:x1875129699223424:12345-192.168.203.26@tcp:36:bash.0 Request processed in 437us (796us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1788263338.598219:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 176 00000020:00080000:3.0:1788263338.598223:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788263338.604644:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263338.605208:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699223552 00000100:00100000:3.0:1788263338.605218:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699223552 00000100:00100000:3.0:1788263338.605278:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 177 00000100:00100000:3.0:1788263338.605290:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:12290:x1875129699223552:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1788263338.605311:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263338.605331:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666ff80 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170054 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.605446:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666ff87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.605466:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba666ff6b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117004d expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.605475:0:10388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666ff87 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.605507:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba666ff6b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117004d expref: 23 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.605737:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba666ff6b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117004d expref: 23 pid: 6491 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263338.605754:0:10388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283822300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10388:1875129709777024:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788263338.605873:0:10388:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff398e9e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263338.610433:0:10388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283822300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10388:1875129709777024:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263338.610473:0:10388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666ff87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263338.612264:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263338.612699:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699223680 00000100:00100000:3.0:1788263338.612706:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699223680 00010000:00010000:3.0:1788263338.612737:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba666ff6b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117004d expref: 24 pid: 6491 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263338.612794:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 85 00000100:00100000:3.0:1788263338.612801:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283954000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+24:2386:x1875129699223680:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263338.612812:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263338.612828:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba666ff6b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117004d expref: 24 pid: 6491 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.612838:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba666ff6b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117004d expref: 24 pid: 6491 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.612854:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba666ff6b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117004d expref: 24 pid: 6491 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.612864:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:3.0:1788263338.612868:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666ff87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.612874:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666ff87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.612879:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666ff87 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.612897:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788263338.612929:0:10388:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666ff87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.612937:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666ff87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263338.612949:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283954000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+23:2386:x1875129699223680:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 148us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263338.612955:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 85 00000004:00200000:0.0:1788263338.612985:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788263338.612993:0:10388:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788263338.613128:0:10388:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666ff87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.613173:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666ff80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170054 expref: 23 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.613189:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666ff87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170054 expref: 22 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.613196:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:0.0:1788263338.613199:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263338.613208:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150e800, rc 0) 00000100:00100000:0.0:1788263338.613245:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:12290:x1875129699223552:12345-192.168.203.26@tcp:101:bash.0 Request processed in 7958us (8609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263338.613252:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 177 00000100:00100000:1.0:1788263338.615717:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263338.615793:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699223936 00000100:00100000:0.0:1788263338.615800:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699223936 00000100:00100000:0.0:1788263338.615855:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 45 00000100:00100000:0.0:1788263338.615862:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:12290:x1875129699223936:12345-192.168.203.26@tcp:35:bash.0 00000100:00100000:0.0:1788263338.616033:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+23:12290:x1875129699223936:12345-192.168.203.26@tcp:35:bash.0 Request processed in 171us (323us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788263338.616040:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 45 00010000:00010000:0.0:1788263338.671799:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263338.697813:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263338.697907:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699224192 00000100:00100000:3.0:1788263338.697917:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699224192 00000100:00100000:3.0:1788263338.697983:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 178 00000100:00100000:3.0:1788263338.697993:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+23:12300:x1875129699224192:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788263338.698015:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263338.698034:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666ff8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d117005b expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263338.698147:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788263338.698353:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666ff8e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117005b expref: 25 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.698368:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff282279000) 00010000:00010000:3.0:1788263338.698371:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788263338.698374:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba666ff8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117005b expref: 25 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.698452:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150fa00, rc 0) 00000100:00100000:3.0:1788263338.698646:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+24:12300:x1875129699224192:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 653us (841us total) trans 4294967453 rc 301/301 00000100:00100000:3.0:1788263338.698653:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 178 00000100:00100000:2.0:1788263338.702898:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263338.703012:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699224320 00000100:00100000:3.0:1788263338.703021:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699224320 00000100:00100000:3.0:1788263338.703486:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 179 00000100:00100000:3.0:1788263338.703498:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+24:12300:x1875129699224320:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:3.0:1788263338.703571:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666ff9c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.703656:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666ff9c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.703667:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666ff9c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.703682:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ffa3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.703701:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ffa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.703707:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ffa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.703775:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666ffaa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.703784:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666ffaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.703790:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666ffaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788263338.703834:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666ffaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.703846:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666ff9c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.703852:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666ff9c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.703858:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666ff9c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.703863:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150e600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263338.703867:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666ff9c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.703874:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666ff9c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.703892:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:3.0:1788263338.703895:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263338.703900:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666ff9c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.703905:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666ff9c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.703919:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ffa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.703925:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ffa3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.703930:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ffa3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.703935:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150f000 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263338.703937:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ffa3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.703944:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ffa3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.703951:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ff282126200) 00010000:00010000:3.0:1788263338.703953:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263338.703956:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ffa3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.703961:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ffa3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.703987:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666ffaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.703994:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666ffaa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.704000:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666ffaa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.704005:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150ee00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263338.704008:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666ffaa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.704013:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666ffaa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.704020:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:3.0:1788263338.704022:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263338.704025:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666ffaa lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263338.704030:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666ffaa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263338.704550:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+24:12300:x1875129699224320:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 1052us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263338.704559:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 179 00000100:00100000:2.0:1788263338.709306:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263338.709383:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699224576 00000100:00100000:3.0:1788263338.709393:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699224576 00000100:00100000:3.0:1788263338.709455:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 46 00000100:00100000:3.0:1788263338.709482:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+24:12300:x1875129699224576:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1788263338.709724:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+25:12300:x1875129699224576:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 244us (425us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788263338.709731:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 46 00000100:00100000:1.0:1788263338.814849:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263338.814945:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699224832 00000100:00100000:0.0:1788263338.814955:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699224832 00000100:00100000:0.0:1788263338.815018:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 180 00000100:00100000:0.0:1788263338.815029:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+25:12303:x1875129699224832:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788263338.815052:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263338.815088:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba666ffb1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170062 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.815193:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69a00/0x4b1103cba666ffb8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.815207:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69a00/0x4b1103cba666ffb8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.815219:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69a00/0x4b1103cba666ffb8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.815247:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba666ffbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.815255:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba666ffbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.815262:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba666ffbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.815366:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba666ffc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.815375:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba666ffc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.815382:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba666ffc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263338.815391:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788263338.815463:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69a00/0x4b1103cba666ffb8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.815470:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69a00/0x4b1103cba666ffb8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.815478:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69a00/0x4b1103cba666ffb8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.815483:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b69a00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263338.815487:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69a00/0x4b1103cba666ffb8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.815505:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69a00/0x4b1103cba666ffb8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.815517:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:0.0:1788263338.815520:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263338.815525:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69a00/0x4b1103cba666ffb8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.815531:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69a00/0x4b1103cba666ffb8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.815543:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba666ffbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.815549:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba666ffbf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.815554:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba666ffbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.815560:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b69c00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263338.815562:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba666ffbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.815568:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba666ffbf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.815575:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ff28314ff00) 00010000:00010000:0.0:1788263338.815637:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263338.815641:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba666ffbf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.815657:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba666ffbf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.815699:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba666ffb1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170062 expref: 28 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.815714:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba666ffc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170062 expref: 27 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.815722:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:0.0:1788263338.815724:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263338.815726:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b68800, rc 0) 00000100:00100000:0.0:1788263338.815790:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+27:12303:x1875129699224832:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 762us (949us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788263338.815798:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 180 00000100:00100000:2.0:1788263338.821407:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263338.821448:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263338.822141:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699224960 00000100:00100000:0.0:1788263338.822153:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699224960 00000100:00100000:0.0:1788263338.822231:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 181 00000100:00100000:0.0:1788263338.822242:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+27:12303:x1875129699224960:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:0.0:1788263338.822312:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68e00/0x4b1103cba666ffd4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.822328:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68e00/0x4b1103cba666ffd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.822339:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68e00/0x4b1103cba666ffd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.822390:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68e00/0x4b1103cba666ffd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.822397:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68e00/0x4b1103cba666ffd4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.822404:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68e00/0x4b1103cba666ffd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.822410:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b68e00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263338.822413:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68e00/0x4b1103cba666ffd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.822421:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68e00/0x4b1103cba666ffd4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.822432:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:0.0:1788263338.822435:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788263338.822439:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68e00/0x4b1103cba666ffd4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263338.822446:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68e00/0x4b1103cba666ffd4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263338.822529:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+27:12303:x1875129699224960:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 288us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263338.822537:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 181 00000100:00100000:1.0:1788263338.822964:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699225088 00000100:00100000:1.0:1788263338.822970:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699225088 00000100:00100000:1.0:1788263338.823004:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00100000:1.0:1788263338.823012:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+27:2389:x1875129699225088:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263338.823022:0:9493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263338.823038:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba666ffc6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170062 expref: 27 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263338.823050:0:9493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:1.0:1788263338.823053:0:9493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263338.823083:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+26:2389:x1875129699225088:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 72us (1635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263338.823090:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00100000:2.0:1788263338.828891:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263338.830163:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699225344 00000100:00100000:3.0:1788263338.830176:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699225344 00000100:00100000:3.0:1788263338.830235:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 47 00000100:00100000:3.0:1788263338.830253:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+26:12303:x1875129699225344:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1788263338.830470:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+27:12303:x1875129699225344:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 226us (1589us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788263338.830478:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 47 00000100:00100000:1.0:1788263339.071444:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263339.071533:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699225600 00000100:00100000:3.0:1788263339.071542:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699225600 00000100:00100000:3.0:1788263339.071638:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 182 00000100:00100000:3.0:1788263339.071648:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+27:12321:x1875129699225600:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:3.0:1788263339.071672:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263339.071695:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666ffdb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170069 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.071799:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ffe2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.071813:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ffe2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.071825:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ffe2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263339.071853:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788263339.071956:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666ffdb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170069 expref: 30 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.071988:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ffe2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170069 expref: 29 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.071996:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:3.0:1788263339.071999:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788263339.072003:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150f000, rc 0) 00000100:00100000:3.0:1788263339.072288:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:12321:x1875129699225600:12345-192.168.203.26@tcp:101:cat.0 Request processed in 639us (851us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1788263339.072295:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 182 00000100:00100000:2.0:1788263339.114793:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263339.114882:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699225728 00000100:00100000:3.0:1788263339.114891:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699225728 00000100:00100000:3.0:1788263339.114949:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 183 00000100:00100000:3.0:1788263339.114959:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:12322:x1875129699225728:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788263339.114982:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263339.115003:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666fff0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170070 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.115080:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666fff7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.115093:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666fff7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.115120:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666fff7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263339.115169:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788263339.115173:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788263339.115191:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666fff7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.115218:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666fff0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170070 expref: 31 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.115237:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666fff7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170070 expref: 30 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.115245:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:3.0:1788263339.115248:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788263339.115252:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150e600, rc 0) 00000100:00100000:3.0:1788263339.115562:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+30:12322:x1875129699225728:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 602us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263339.115570:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 183 00000100:00100000:2.0:1788263339.126147:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263339.126298:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699226112 00000100:00100000:1.0:1788263339.126307:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699226112 00000100:00100000:1.0:1788263339.126360:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 48 00000100:00100000:1.0:1788263339.126369:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+30:12322:x1875129699226112:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1788263339.126862:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+31:12322:x1875129699226112:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 493us (733us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1788263339.126872:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 48 00000100:00100000:1.0:1788263339.129185:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263339.129323:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699226240 00000100:00100000:2.0:1788263339.129332:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699226240 00000100:00100000:2.0:1788263339.129389:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:2.0:1788263339.129399:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283957b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+31:12322:x1875129699226240:12345-192.168.203.26@tcp:103:lfs.0 00010000:00010000:2.0:1788263339.129413:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788263339.129447:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba666ff87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170054 expref: 31 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.129619:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba666ffe2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170069 expref: 30 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.129639:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba666fe7d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117000e expref: 29 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.129650:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:2.0:1788263339.129654:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263339.129710:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283957b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+28:12322:x1875129699226240:12345-192.168.203.26@tcp:103:lfs.0 Request processed in 312us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263339.129718:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:2.0:1788263339.132422:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263339.133419:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699226368 00000100:00100000:3.0:1788263339.133430:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699226368 00000100:00100000:3.0:1788263339.133483:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 184 00000100:00100000:3.0:1788263339.133493:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+28:12322:x1875129699226368:12345-192.168.203.26@tcp:58:lfs.0 00010000:00010000:3.0:1788263339.133605:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666fffe lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.133621:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666fffe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.133807:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666fffe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788263339.133917:0:8884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788263339.134349:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+28:12322:x1875129699226368:12345-192.168.203.26@tcp:58:lfs.0 Request processed in 855us (1935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263339.134358:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 184 00000100:00100000:3.0:1788263339.171348:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263339.171536:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699226496 00000100:00100000:1.0:1788263339.171545:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699226496 00000100:00100000:1.0:1788263339.171625:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 185 00000100:00100000:1.0:1788263339.171635:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+28:12325:x1875129699226496:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1788263339.171653:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263339.171674:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba6670005 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170077 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.171744:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba667000c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.171756:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba667000c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.171767:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba667000c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.171780:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba6670013 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.171803:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba6670013 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.171810:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba6670013 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.171880:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba667001a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.171890:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba667001a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.171897:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba667001a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263339.171937:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788263339.171941:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788263339.171961:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba667001a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.171984:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba667001a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.171992:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba667000c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.171999:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba667000c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.172006:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba667000c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.172021:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381680200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263339.172025:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba667000c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.172032:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba667000c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.172043:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:1.0:1788263339.172046:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263339.172050:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba667000c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.172055:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba667000c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.172068:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba6670013 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.172074:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba6670013 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.172080:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba6670013 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.172084:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381680a00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263339.172087:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba6670013 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.172092:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba6670013 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.172107:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ff383b6e200) 00010000:00010000:1.0:1788263339.172110:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263339.172112:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba6670013 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.172118:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba6670013 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.172158:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba6670005 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170077 expref: 30 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.172170:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba667001a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170077 expref: 29 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.172177:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:1.0:1788263339.172179:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788263339.172182:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381681800, rc 0) 00000100:00100000:1.0:1788263339.172239:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:12325:x1875129699226496:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 605us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263339.172247:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 185 00000040:00080000:0.0:1788263339.503992:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788263339.504001:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788263339.504038:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788263339.504052:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788263339.504190:0:13769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28387ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13769:1875129709777152:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788263339.504403:0:13769:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff283a5e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263339.516954:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263339.517100:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699226624 00000100:00100000:0.0:1788263339.517104:0:13769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28387ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13769:1875129709777152:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788263339.517107:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699226624 00000100:00100000:1.0:1788263339.517171:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 186 00000100:00100000:1.0:1788263339.517180:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:12336:x1875129699226624:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788263339.517208:0:6491:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788263339.517316:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:12336:x1875129699226624:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 136us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263339.517340:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 186 00000100:00100000:2.0:1788263339.522772:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263339.522854:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699226752 00000100:00100000:3.0:1788263339.522863:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699226752 00000100:00100000:3.0:1788263339.522918:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 187 00000100:00100000:3.0:1788263339.522929:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:12336:x1875129699226752:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788263339.523007:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670021 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523024:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670021 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523034:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670021 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523194:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba6670028 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523203:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba6670028 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523273:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba6670028 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523312:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba667002f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523321:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba667002f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523328:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba667002f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263339.523370:0:8884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788263339.523374:0:8884:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788263339.523385:0:8884:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba667002f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523396:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670021 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523402:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670021 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523408:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670021 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523412:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150fa00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263339.523415:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670021 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523420:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670021 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523428:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ff28314fa00) 00010000:00010000:3.0:1788263339.523434:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263339.523438:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670021 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523442:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670021 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523453:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba6670028 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523457:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba6670028 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523460:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba6670028 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523463:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150f000 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263339.523465:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba6670028 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523468:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba6670028 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523472:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9ff282126200) 00010000:00010000:3.0:1788263339.523473:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263339.523474:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba6670028 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523477:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba6670028 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523488:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba667002f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523495:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba667002f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523499:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba667002f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523502:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150e800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263339.523504:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba667002f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523507:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba667002f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523511:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:3.0:1788263339.523513:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263339.523514:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba667002f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.523517:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba667002f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263339.523809:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:12336:x1875129699226752:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 Request processed in 879us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263339.523817:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 187 00000100:00100000:2.0:1788263339.525914:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263339.525980:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699227008 00000100:00100000:0.0:1788263339.525988:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699227008 00000100:00100000:0.0:1788263339.526030:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 188 00000100:00100000:0.0:1788263339.526040:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:12336:x1875129699227008:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788263339.526057:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263339.526074:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670036 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d117007e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.526185:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667003d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.526199:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667003d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.526208:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667003d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263339.526217:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788263339.526280:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667003d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.526285:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667003d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.526290:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667003d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.526303:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b69c00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263339.526306:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667003d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.526311:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667003d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.526320:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:0.0:1788263339.526322:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788263339.526325:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667003d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.526329:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667003d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.526358:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670036 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117007e expref: 31 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.526365:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ff28314fa00) 00010000:00010000:0.0:1788263339.526367:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788263339.526369:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670036 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117007e expref: 31 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.526375:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b68400, rc 0) 00000100:00100000:0.0:1788263339.526776:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+30:12336:x1875129699227008:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 736us (867us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1788263339.526784:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 188 00000100:00100000:1.0:1788263339.532277:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263339.532959:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699227136 00000100:00100000:3.0:1788263339.532969:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699227136 00000100:00100000:3.0:1788263339.533024:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 189 00000100:00100000:3.0:1788263339.533034:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+30:12336:x1875129699227136:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788263339.533069:0:10388:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788263339.533210:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+30:12336:x1875129699227136:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 177us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263339.533218:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 189 00000100:00100000:1.0:1788263339.537775:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263339.537942:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699227392 00000100:00100000:3.0:1788263339.537952:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699227392 00000100:00100000:3.0:1788263339.538010:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 190 00000100:00100000:3.0:1788263339.538021:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+30:12336:x1875129699227392:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788263339.538040:0:8884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263339.538043:0:8884:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788263339.538066:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba666fff7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170070 expref: 30 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.538085:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:3.0:1788263339.538089:0:8884:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263339.538101:0:8884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031a00/0x4b1103cba667004b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170085 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788263339.538616:0:8884:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788263339.538801:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380030800/0x4b1103cba6670052 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.538814:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380030800/0x4b1103cba6670052 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.538823:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380030800/0x4b1103cba6670052 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.538870:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031a00/0x4b1103cba667004b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170085 expref: 32 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.538908:0:8884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380030800/0x4b1103cba6670052 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170085 expref: 31 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.538916:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ff282126200) 00010000:00010000:3.0:1788263339.538919:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263339.538922:0:8884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff380030800, rc 0) 00000100:00100000:3.0:1788263339.538983:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+31:12336:x1875129699227392:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 964us (1218us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788263339.538991:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 190 00000100:00100000:0.0:1788263339.545331:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263339.545633:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699227648 00000100:00100000:3.0:1788263339.545642:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699227648 00000100:00100000:3.0:1788263339.545690:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 191 00000100:00100000:3.0:1788263339.545700:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28387ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+31:12336:x1875129699227648:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788263339.545763:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263339.545788:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380030800/0x4b1103cba6670052 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170085 expref: 31 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.545806:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ff282126200) 00010000:00010000:3.0:1788263339.545816:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263339.545835:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031e00/0x4b1103cba6670060 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.545848:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031e00/0x4b1103cba6670060 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.545857:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031e00/0x4b1103cba6670060 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.545879:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031200/0x4b1103cba6670067 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xcf820efa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.545888:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031200/0x4b1103cba6670067 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xcf820efa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.545895:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031200/0x4b1103cba6670067 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xcf820efa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.545940:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031e00/0x4b1103cba6670060 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.545948:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031e00/0x4b1103cba6670060 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.545955:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031e00/0x4b1103cba6670060 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.545961:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff380031e00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263339.545964:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031e00/0x4b1103cba6670060 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.545973:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031e00/0x4b1103cba6670060 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.545981:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:3.0:1788263339.545984:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263339.545987:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031e00/0x4b1103cba6670060 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.545993:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031e00/0x4b1103cba6670060 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.546011:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031200/0x4b1103cba6670067 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xcf820efa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.546017:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031200/0x4b1103cba6670067 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xcf820efa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.546023:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031200/0x4b1103cba6670067 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xcf820efa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.546028:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff380031200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263339.546031:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031200/0x4b1103cba6670067 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xcf820efa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.546036:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031200/0x4b1103cba6670067 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xcf820efa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.546043:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xcf820efa (ffff9ff282126f00) 00010000:00010000:3.0:1788263339.546045:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263339.546048:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031200/0x4b1103cba6670067 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xcf820efa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.546053:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff380031200/0x4b1103cba6670067 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xcf820efa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263339.546119:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28387ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+30:12336:x1875129699227648:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 420us (797us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788263339.546139:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 191 00000100:00100000:1.0:1788263339.550008:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263339.550394:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699227776 00000100:00100000:3.0:1788263339.550404:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699227776 00000100:00100000:3.0:1788263339.550563:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 192 00000100:00100000:3.0:1788263339.550712:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+30:12336:x1875129699227776:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788263339.550800:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263339.550825:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba667006e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d117008c expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.550861:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba6670075 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.550875:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba6670075 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.550886:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba6670075 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.550989:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba667006e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117008c expref: 32 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.551006:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba6670075 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117008c expref: 31 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.551015:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ff282126e00) 00010000:00010000:3.0:1788263339.551018:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788263339.551021:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150e800, rc 0) 00000100:00100000:3.0:1788263339.551085:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+31:12336:x1875129699227776:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 378us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263339.551093:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 192 00000100:00100000:1.0:1788263339.557844:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263339.558418:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699228032 00000100:00100000:3.0:1788263339.558428:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699228032 00000100:00100000:3.0:1788263339.558496:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 193 00000100:00100000:3.0:1788263339.558518:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+31:12336:x1875129699228032:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788263339.558622:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba667007c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.558638:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba667007c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.558650:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba667007c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788263339.560393:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1788263339.560409:0:6491:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 348631829033ns, next at 349631825786ns, rc = 0 00000004:00010000:3.0:1788263339.560468:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033bffa56 reply state 00000000bcf8686c transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba667007c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.560484:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba667007c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.560494:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ff282126e00) 00010000:00010000:3.0:1788263339.560497:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788263339.560501:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788263339.560626:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+33:12336:x1875129699228032:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 2107us (2788us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788263339.560635:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 193 00000100:00100000:2.0:1788263339.574237:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709777280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263339.574317:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263339.574881:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709777280 00000100:00100000:3.0:1788263339.574891:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709777280 00000100:00100000:3.0:1788263339.574946:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788263339.574956:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff39870f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709777280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788263339.575830:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788263339.575904:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff39870f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709777280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 949us (1586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263339.575912:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:3.0:1788263339.575939:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788263339.576453:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709777280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263339.576913:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263339.577362:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699228160 00000100:00100000:3.0:1788263339.577371:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699228160 00000100:00100000:3.0:1788263339.579781:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 194 00000100:00100000:3.0:1788263339.579800:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+33:12336:x1875129699228160:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788263339.579822:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263339.579844:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670083 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170093 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.579897:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670083 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170093 expref: 34 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.579912:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670083 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170093 expref: 34 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.579931:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ff282126e00) 00010000:00010000:3.0:1788263339.579934:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788263339.579938:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150fa00, rc 0) 00000100:00100000:3.0:1788263339.580016:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+34:12336:x1875129699228160:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 223us (3104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263339.580023:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 194 00000100:00100000:0.0:1788263339.580387:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709777408:0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.580439:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263339.580477:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709777920:0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.580502:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263339.580520:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709778432:0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.580540:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263339.580562:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788263339.580567:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875129709777792:0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.580617:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263339.590512:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709777408 00000100:00100000:2.0:1788263339.590527:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709777408 00000100:00100000:2.0:1788263339.590607:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1788263339.590618:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3621:x1875129709777408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263339.590696:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3621:x1875129709777408:12345-0@lo:400:kworker.0 Request processed in 81us (10256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263339.590703:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1788263339.590743:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709777664:0@lo:400:kworker.0 00000100:00100000:2.0:1788263339.590789:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263339.590814:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875129709778176:0@lo:400:kworker.0 00000100:00100000:2.0:1788263339.590844:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709777536:0@lo:400:kworker.0 00000100:00100000:2.0:1788263339.590879:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709777920 00000100:00100000:2.0:1788263339.590883:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709777920 00000100:00100000:2.0:1788263339.590910:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709777664 00000100:00100000:2.0:1788263339.590912:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709777664 00000100:00100000:2.0:1788263339.590927:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788263339.590932:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709777920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263339.591457:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709777920:12345-0@lo:400:kworker.0 Request processed in 522us (10952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263339.591465:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788263339.591480:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788263339.591488:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38767b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709777664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263339.591528:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38767b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709777664:12345-0@lo:400:kworker.0 Request processed in 42us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263339.591534:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788263339.591984:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709778304:0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.592019:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263339.592039:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709778816:0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.592061:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263339.592092:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709777408:0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.592105:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709777920:0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.592150:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709778432 00000100:00100000:0.0:1788263339.592155:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709778432 00000100:00100000:0.0:1788263339.592196:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709778304 00000100:00100000:0.0:1788263339.592199:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709778304 00000100:00100000:0.0:1788263339.592218:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709778816 00000100:00100000:0.0:1788263339.592221:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709778816 00000100:00100000:0.0:1788263339.592239:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788263339.592245:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3621:x1875129709778432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.592296:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3621:x1875129709778432:12345-0@lo:400:kworker.0 Request processed in 50us (11754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263339.592317:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788263339.592330:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788263339.592335:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709778304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.592364:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709778304:12345-0@lo:400:kworker.0 Request processed in 29us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263339.592369:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788263339.592390:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788263339.592396:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709778816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.592424:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709778816:12345-0@lo:400:kworker.0 Request processed in 28us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263339.592430:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788263339.592450:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263339.594608:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709777792 00000100:00100000:1.0:1788263339.594620:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709777792 00000100:00100000:1.0:1788263339.594755:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788263339.594764:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875129709777792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263339.594840:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875129709777792:12345-0@lo:400:kworker.0 Request processed in 77us (14222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263339.594847:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00080000:1.0:1788263339.597449:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788263339.597459:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263339.603796:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263339.604438:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709778688:0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.604485:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263339.604537:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709777664:0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.604565:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699228288 00000100:00100000:0.0:1788263339.604570:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699228288 00000100:00100000:0.0:1788263339.604643:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:0.0:1788263339.604652:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+6:2387:x1875129699228288:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788263339.604860:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2387:x1875129699228288:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 208us (1071us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788263339.604867:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:0.0:1788263339.604898:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263339.604923:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709778048:0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.604961:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263339.604998:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875129709778560:0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.605020:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263339.605042:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709778176 00000100:00100000:0.0:1788263339.605047:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709778176 00000100:00100000:0.0:1788263339.605068:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709778688 00000100:00100000:0.0:1788263339.605071:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709778688 00000100:00100000:0.0:1788263339.605084:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709777536 00000100:00100000:0.0:1788263339.605086:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709777536 00000100:00100000:0.0:1788263339.605097:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709778048 00000100:00100000:0.0:1788263339.605099:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709778048 00000100:00100000:0.0:1788263339.605111:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709778560 00000100:00100000:0.0:1788263339.605113:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709778560 00000100:00100000:0.0:1788263339.605137:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1788263339.605144:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875129709778176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.605183:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875129709778176:12345-0@lo:400:kworker.0 Request processed in 40us (12732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263339.605190:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1788263339.605203:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788263339.605209:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875129709778688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.605236:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875129709778688:12345-0@lo:400:kworker.0 Request processed in 27us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263339.605242:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788263339.605253:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1788263339.605259:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709777536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.605303:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709777536:12345-0@lo:400:kworker.0 Request processed in 44us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263339.605319:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1788263339.605332:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788263339.605338:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709778048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.605366:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709778048:12345-0@lo:400:kworker.0 Request processed in 29us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263339.605372:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788263339.605384:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1788263339.605390:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875129709778560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.605416:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875129709778560:12345-0@lo:400:kworker.0 Request processed in 27us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263339.605421:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00080000:0.0:1788263339.605436:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788263339.605440:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788263339.605442:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788263339.605466:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28381e300 x1875129709778176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263339.605477:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875129709778176:0@lo:400:kworker.0 00010000:00080000:0.0:1788263339.605487:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28381d880 x1875129709778688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263339.605495:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709778688:0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.605521:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709777536:0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.605529:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709778048:0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.605538:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3618:1875129709778560:0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.605690:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875129709777792:0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.605701:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709778304:0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.605710:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709778816:0@lo:400:kworker.0 00000100:00100000:0.0:1788263339.605721:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709778432:0@lo:400:kworker.0 00000100:00100000:2.0:1788263339.610859:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263339.611074:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699228544 00000100:00100000:3.0:1788263339.611083:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699228544 00000100:00100000:3.0:1788263339.611155:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00100000:3.0:1788263339.611165:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+34:12336:x1875129699228544:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788263339.611500:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+35:12336:x1875129699228544:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 335us (648us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1788263339.611507:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00100000:1.0:1788263339.630329:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263339.631134:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699228800 00000100:00100000:3.0:1788263339.631146:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699228800 00000100:00100000:3.0:1788263339.631208:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 195 00000100:00100000:3.0:1788263339.631217:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+35:12336:x1875129699228800:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788263339.631331:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+35:12336:x1875129699228800:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 114us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263339.631338:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 195 00000100:00100000:3.0:1788263339.634911:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263339.635045:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699228928 00000100:00100000:0.0:1788263339.635054:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699228928 00000100:00100000:0.0:1788263339.635109:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 196 00000100:00100000:0.0:1788263339.635120:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+35:12336:x1875129699228928:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788263339.635148:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263339.635169:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68a00/0x4b1103cba667008a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d117009a expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.635234:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68600/0x4b1103cba6670091 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.635248:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68600/0x4b1103cba6670091 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.635259:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68600/0x4b1103cba6670091 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263339.635314:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788263339.635332:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68600/0x4b1103cba6670091 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.635358:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68a00/0x4b1103cba667008a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117009a expref: 37 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.635389:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68600/0x4b1103cba6670091 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117009a expref: 36 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.635398:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ff282126e00) 00010000:00010000:0.0:1788263339.635401:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788263339.635405:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b68600, rc 0) 00000100:00100000:0.0:1788263339.635459:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+36:12336:x1875129699228928:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 341us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263339.635466:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 196 00000100:00100000:3.0:1788263339.640896:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263339.645371:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699229056 00000100:00100000:1.0:1788263339.645386:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699229056 00000100:00100000:1.0:1788263339.645517:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:1.0:1788263339.645528:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2387:x1875129699229056:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788263339.645546:0:8404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263339.645565:0:8404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2f1bf78/0x4b1103cba6670098 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11700a1 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788263339.645615:0:8404:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96bbaa, blocks: 0x0 00010000:00010000:1.0:1788263339.645654:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=348s v=(0 0) 00010000:00010000:1.0:1788263339.645658:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263339.645668:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2f1bf78/0x4b1103cba6670098 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700a1 expref: 8 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.645688:0:8404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f2f1bf78/0x4b1103cba6670098 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700a1 expref: 8 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.645703:0:8404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381681a00, rc 0) 00000100:00100000:1.0:1788263339.645776:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2387:x1875129699229056:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 250us (4887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263339.645783:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:2.0:1788263339.654749:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263339.654786:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699229312 00000100:00100000:2.0:1788263339.654795:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699229312 00000100:00100000:2.0:1788263339.654850:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 197 00000100:00100000:2.0:1788263339.654859:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+36:12336:x1875129699229312:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788263339.654962:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+36:12336:x1875129699229312:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 103us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263339.654978:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 197 00000100:00100000:2.0:1788263339.659081:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263339.660192:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699229440 00000100:00100000:0.0:1788263339.660205:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699229440 00000100:00100000:0.0:1788263339.660263:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:0.0:1788263339.660275:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:12336:x1875129699229440:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788263339.660291:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263339.660310:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000185a97a8/0x4b1103cba667009f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11700a8 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.660345:0:8406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2f1bf78/0x4b1103cba6670098 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700a1 expref: 9 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.660354:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263339.660358:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263339.660363:0:8406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000185a97a8/0x4b1103cba667009f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700a8 expref: 9 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.660413:0:8406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f2f1bf78/0x4b1103cba6670098 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700a1 expref: 9 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.660427:0:8406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f2f1bf78/0x4b1103cba6670098 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700a1 expref: 9 pid: 8404 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263339.660443:0:8406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387685500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8406:1875129709778944:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788263339.660536:0:8406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff283a5ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263339.664914:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263339.666081:0:8406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387685500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8406:1875129709778944:192.168.203.26@tcp:104: 00010000:00010000:1.0:1788263339.666113:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000185a97a8/0x4b1103cba667009f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700a8 expref: 9 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.666142:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b68a00, rc 0) 00000100:00100000:1.0:1788263339.666203:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:12336:x1875129699229440:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 5929us (7131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263339.666213:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:0.0:1788263339.674916:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699229568 00000100:00100000:0.0:1788263339.674930:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699229568 00010000:00010000:0.0:1788263339.674972:0:9493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f2f1bf78/0x4b1103cba6670098 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700a1 expref: 9 pid: 8404 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263339.675016:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 86 00000100:00100000:0.0:1788263339.675026:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:2387:x1875129699229568:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263339.675041:0:9493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263339.675061:0:9493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f2f1bf78/0x4b1103cba6670098 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700a1 expref: 9 pid: 8404 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.675076:0:9493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f2f1bf78/0x4b1103cba6670098 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700a1 expref: 9 pid: 8404 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.675098:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2f1bf78/0x4b1103cba6670098 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700a1 expref: 9 pid: 8404 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.675123:0:9493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263339.675136:0:9493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263339.675145:0:9493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000185a97a8/0x4b1103cba667009f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700a8 expref: 8 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.675155:0:9493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000185a97a8/0x4b1103cba667009f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700a8 expref: 8 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.675192:0:9493:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000185a97a8/0x4b1103cba667009f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700a8 expref: 8 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263339.675206:0:9493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387685500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9493:1875129709779072:192.168.203.26@tcp:105: 00000100:00100000:0.0:1788263339.675294:0:9493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff283a5ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263339.686164:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263339.686194:0:9493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387685500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9493:1875129709779072:192.168.203.26@tcp:105: 00010000:00010000:1.0:1788263339.686217:0:9493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263339.686242:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699229696 00000100:00100000:3.0:1788263339.686249:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699229696 00000100:00100000:1.0:1788263339.686297:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:2387:x1875129699229568:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 11271us (21390us total) trans 0 rc 0/0 00002000:00100000:3.0:1788263339.686307:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9ff283a4d180 x1875129699229696/t0(0) o4->ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp:550/0 lens 504/0 e 0 to 0 dl 1788263350 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788263339.686313:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 86 00002000:00100000:3.0:1788263339.686321:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ff283a4d180 with x1875129699229696 ext(0->8) 00002000:00010000:3.0:1788263339.686328:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ff283a4d180 00000100:00100000:3.0:1788263339.686356:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:3.0:1788263339.686366:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2386:x1875129699229696:12345-192.168.203.26@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788263339.687741:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+10:2386:x1875129699229696:12345-192.168.203.26@tcp:4:lhsmtool_posix.0 Request processed in 1371us (1581us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788263339.687752:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 4 00002000:00100000:2.0:1788263339.687760:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9ff283a4d180 x1875129699229696/t4294967315(0) o4->ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp:550/0 lens 504/448 e 0 to 0 dl 1788263350 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788263339.687770:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ff283a4d180 with x1875129699229696 ext(0->8) 00002000:00010000:2.0:1788263339.687774:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ff283a4d180 00000100:00100000:2.0:1788263339.695550:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263339.695651:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699229824 00010000:00010000:2.0:1788263339.695658:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263339.695662:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699229824 00000100:00100000:0.0:1788263339.695725:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 198 00000100:00100000:0.0:1788263339.695736:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+36:12336:x1875129699229824:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788263339.697362:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1788263339.697375:0:6470:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00010000:00010000:0.0:1788263339.697412:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788263339.697419:0:6470:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:0.0:1788263339.697428:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff79 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.697436:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.697455:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150e400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263339.697461:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.697468:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff79 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.697483:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:0.0:1788263339.697487:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263339.697491:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff79 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.697497:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba666ff79 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.697518:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba667007c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788263339.697522:0:6523:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:0.0:1788263339.697526:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba667007c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788263339.697534:0:6523:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:0.0:1788263339.697534:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba667007c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.697543:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150f000 already unused, calling callback (ffffffffc18e04f0) 00000100:00100000:2.0:1788263339.697545:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1788263339.697547:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba667007c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.697554:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba667007c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263339.697563:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709779200:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1788263339.697992:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ff282126e00) 00010000:00010000:0.0:1788263339.697996:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788263339.697999:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba667007c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.698005:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba667007c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263339.698098:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263339.698794:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709779200 00000100:00100000:0.0:1788263339.698803:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709779200 00000100:00100000:0.0:1788263339.698848:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788263339.698857:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709779200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788263339.699039:0:9885:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788263339.699042:0:9885:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788263339 00002000:00010000:0.0:1788263339.699045:0:9885:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788263339.699047:0:9885:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788263338 -> 1788263339 00002000:00010000:0.0:1788263339.699048:0:9885:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788263339.699097:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3620:x1875129709779200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 241us (1000us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788263339.699105:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788263339.699312:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+19:12336:x1875129699229824:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 Request processed in 3574us (3765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263339.699322:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 198 00000004:00080000:2.0:1788263339.699375:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ff283b70700/2, rc 0, transno 4294967316 00000100:00100000:2.0:1788263339.701165:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709779200:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788263339.702640:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263339.702672:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699229952 00000100:00100000:2.0:1788263339.702680:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699229952 00000100:00100000:2.0:1788263339.702726:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 63 00000100:00100000:2.0:1788263339.702735:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+10:2386:x1875129699229952:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788263339.709008:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:1.0:1788263339.709023:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1788263339.710015:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2386:x1875129699229952:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 Request processed in 7273us (7371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263339.710027:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 63 00000100:00100000:0.0:1788263339.716495:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263339.716654:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699230208 00000100:00100000:3.0:1788263339.716664:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699230208 00000100:00100000:3.0:1788263339.716745:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 199 00000100:00100000:3.0:1788263339.716756:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+19:12336:x1875129699230208:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788263339.716831:0:10388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263339.716860:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68600/0x4b1103cba6670091 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117009a expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.716878:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ff282126e00) 00010000:00010000:3.0:1788263339.716883:0:10388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263339.716910:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba66700a6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.716923:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba66700a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.716932:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba66700a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788263339.717048:0:10388:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c4b1b29 reply state 000000007066b75b transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba66700a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.717061:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba66700a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.717067:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ff282126e00) 00010000:00010000:3.0:1788263339.717069:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788263339.717072:0:10388:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788263339.717177:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+20:12336:x1875129699230208:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 422us (689us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1788263339.717196:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 199 00000100:00100000:1.0:1788263339.720358:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263339.720679:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699230336 00000100:00100000:0.0:1788263339.720688:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699230336 00000100:00100000:0.0:1788263339.720744:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:0.0:1788263339.720754:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b55bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2386:x1875129699230336:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788263339.720899:0:8406:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788263339.720903:0:8406:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788263339 -> 1788263337 00002000:00010000:0.0:1788263339.720912:0:8406:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788263336 00002000:00010000:0.0:1788263339.720914:0:8406:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788263339 -> 1788263337 00002000:00010000:0.0:1788263339.720916:0:8406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788263339.720979:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b55bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2386:x1875129699230336:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 225us (629us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788263339.720987:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:1.0:1788263339.723261:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263339.723356:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699230592 00000100:00100000:3.0:1788263339.723364:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699230592 00000100:00100000:3.0:1788263339.723422:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 200 00000100:00100000:3.0:1788263339.723433:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+20:12336:x1875129699230592:12345-192.168.203.26@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788263339.723494:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66700ad lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.723511:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba6670075 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117008c expref: 20 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.723520:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66700ad lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.723551:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba6670075 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117008c expref: 20 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.723564:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba6670075 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117008c expref: 20 pid: 6493 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263339.723622:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398742300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6493:1875129709779328:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788263339.723695:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff398e9e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788263339.725720:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398742300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6493:1875129709779328:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263339.725748:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66700ad lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263339.727415:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263339.727613:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699230720 00000100:00100000:3.0:1788263339.727629:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699230720 00010000:00010000:3.0:1788263339.727666:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba6670075 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117008c expref: 21 pid: 6493 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263339.727701:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 87 00000100:00100000:3.0:1788263339.727711:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0454050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+21:2387:x1875129699230720:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263339.727724:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263339.727731:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba6670075 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117008c expref: 21 pid: 6493 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.727744:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba6670075 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117008c expref: 21 pid: 6493 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.727765:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba6670075 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117008c expref: 21 pid: 6493 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.727781:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ff282126e00) 00010000:00010000:3.0:1788263339.727785:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66700ad lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.727793:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66700ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.727801:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66700ad lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.727840:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263339.727888:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0454050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+20:2387:x1875129699230720:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 178us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263339.727904:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 87 00010000:00010000:0.0:1788263339.728528:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66700ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.728537:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66700ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.728600:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66700ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.728608:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66700ad lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.728615:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66700ad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.728620:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150f000 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263339.728625:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66700ad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.728631:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66700ad lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.728650:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ff282126e00) 00010000:00010000:0.0:1788263339.728653:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788263339.728657:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66700ad lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.728670:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66700ad lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263339.728727:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+19:12336:x1875129699230592:12345-192.168.203.26@tcp:55:lhsmtool_posix.0 Request processed in 5296us (5484us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788263339.728735:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 200 00000100:00100000:1.0:1788263339.735767:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263339.735841:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699230848 00000100:00100000:0.0:1788263339.735850:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699230848 00000100:00100000:0.0:1788263339.735903:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:0.0:1788263339.735913:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff281e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2389:x1875129699230848:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788263339.735954:0:14442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fba29a29/0x4b1103cba66700b4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.735974:0:14442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000185a97a8/0x4b1103cba667009f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700a8 expref: 8 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.735983:0:14442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263339.735987:0:14442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788263339.735992:0:14442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fba29a29/0x4b1103cba66700b4 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.736025:0:14442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000185a97a8/0x4b1103cba667009f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700a8 expref: 8 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.736040:0:14442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000185a97a8/0x4b1103cba667009f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700a8 expref: 8 pid: 8406 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263339.736066:0:14442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283ae8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14442:1875129709779456:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788263339.736150:0:14442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff283a5e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263339.744548:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263339.744603:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699230976 00000100:00100000:0.0:1788263339.744611:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699230976 00010000:00010000:0.0:1788263339.744660:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000185a97a8/0x4b1103cba667009f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700a8 expref: 9 pid: 8406 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263339.744697:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 88 00000100:00100000:0.0:1788263339.744708:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:2386:x1875129699230976:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263339.744723:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263339.744743:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000185a97a8/0x4b1103cba667009f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700a8 expref: 9 pid: 8406 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.744757:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000185a97a8/0x4b1103cba667009f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700a8 expref: 9 pid: 8406 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.744780:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788263339.744785:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788263339.744791:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fba29a29/0x4b1103cba66700b4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.744801:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fba29a29/0x4b1103cba66700b4 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.744832:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263339.744878:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:2386:x1875129699230976:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 173us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263339.744887:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 88 00010000:00010000:1.0:1788263339.745220:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000185a97a8/0x4b1103cba667009f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700a8 expref: 8 pid: 8406 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263339.745233:0:14442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283ae8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14442:1875129709779456:192.168.203.26@tcp:104: 00010000:00010000:1.0:1788263339.745263:0:14442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fba29a29/0x4b1103cba66700b4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.745274:0:14442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fba29a29/0x4b1103cba66700b4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.745282:0:14442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fba29a29/0x4b1103cba66700b4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.745300:0:14442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fba29a29/0x4b1103cba66700b4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.745309:0:14442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fba29a29/0x4b1103cba66700b4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.745316:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fba29a29/0x4b1103cba66700b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.745345:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b68c00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:1.0:1788263339.745349:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fba29a29/0x4b1103cba66700b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.745357:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fba29a29/0x4b1103cba66700b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.745369:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fba29a29/0x4b1103cba66700b4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.745376:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fba29a29/0x4b1103cba66700b4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263339.745434:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff281e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2389:x1875129699230848:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 Request processed in 9522us (9675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263339.745440:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:1.0:1788263339.748349:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263339.748466:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699231232 00000100:00100000:2.0:1788263339.748475:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699231232 00000100:00100000:2.0:1788263339.748528:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 201 00000100:00100000:2.0:1788263339.748537:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+19:12336:x1875129699231232:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788263339.748647:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba66700bb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.748664:0:8884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba666ff02 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170031 expref: 19 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.748673:0:8884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba66700bb lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.748707:0:8884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba666ff02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170031 expref: 19 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.748721:0:8884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba666ff02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170031 expref: 19 pid: 6491 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263339.748733:0:8884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b72300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8884:1875129709779584:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788263339.748801:0:8884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28396a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788263339.754260:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263339.754372:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699231360 00000100:00100000:1.0:1788263339.754381:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699231360 00010000:00010000:1.0:1788263339.754418:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba666ff02 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170031 expref: 20 pid: 6491 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263339.754458:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 89 00000100:00100000:1.0:1788263339.754469:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+20:2387:x1875129699231360:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263339.754482:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263339.754499:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba666ff02 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170031 expref: 20 pid: 6491 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.754512:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba666ff02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170031 expref: 20 pid: 6491 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.754534:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:1.0:1788263339.754539:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba66700bb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.754548:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba66700bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.754556:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba66700bb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263339.754600:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263339.754780:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+20:2387:x1875129699231360:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 311us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263339.754788:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 89 00010000:00010000:2.0:1788263339.760736:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba666ff02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170031 expref: 19 pid: 6491 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263339.760762:0:8884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b72300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8884:1875129709779584:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788263339.760784:0:8884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba66700bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.760794:0:8884:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba66700bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.760800:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba66700bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.760960:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba66700c2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.760974:0:8884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670083 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170093 expref: 19 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.760982:0:8884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba66700c2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.761013:0:8884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670083 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170093 expref: 19 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.761031:0:8884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670083 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170093 expref: 19 pid: 10388 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263339.761044:0:8884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b72300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8884:1875129709779712:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788263339.761121:0:8884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28396ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263339.772817:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263339.772859:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699231488 00000100:00100000:0.0:1788263339.772867:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699231488 00010000:00010000:0.0:1788263339.772903:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670083 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170093 expref: 20 pid: 10388 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263339.772935:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 90 00000100:00100000:0.0:1788263339.772945:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+20:2387:x1875129699231488:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263339.772959:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263339.772965:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670083 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170093 expref: 20 pid: 10388 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.772979:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670083 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170093 expref: 20 pid: 10388 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.772999:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ff282126e00) 00010000:00010000:0.0:1788263339.773005:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba66700c2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.773015:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba66700c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.773038:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba66700c2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.773055:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263339.773102:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+20:2387:x1875129699231488:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 158us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263339.773110:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 90 00010000:00010000:3.0:1788263339.774273:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670083 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170093 expref: 19 pid: 10388 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263339.774293:0:8884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b72300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8884:1875129709779712:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263339.774313:0:8884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba66700c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.774323:0:8884:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba66700c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.774330:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba66700c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788263339.774431:0:8884:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1788263339.774534:0:8884:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1788263339.774567:0:8884:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1788263339.774740:0:8884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398742300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8884:1875129709779840:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788263339.774798:0:8884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263339.774921:0:8884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff282244000 going to sleep for 11 seconds 00000100:00100000:2.0:1788263339.774960:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709779840 00000100:00100000:2.0:1788263339.774966:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709779840 00000100:00100000:2.0:1788263339.775047:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788263339.775057:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8884:x1875129709779840:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788263339.775154:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8884:x1875129709779840:12345-0@lo:1000:mdt00_003.0 Request processed in 99us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263339.775161:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788263339.775213:0:8884:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1788263339.775219:0:8884:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ff283b70700, transno 4294967316 00000100:00100000:3.0:1788263339.775232:0:8884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398742300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8884:1875129709779840:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788263339.775327:0:8884:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1788263339.775364:0:8884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398742300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8884:1875129709779968:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788263339.775389:0:8884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263339.775493:0:8884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff282244cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263339.775526:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709779968 00000100:00100000:0.0:1788263339.775531:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709779968 00000100:00100000:0.0:1788263339.775552:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788263339.775558:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8884:x1875129709779968:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788263339.775780:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8884:x1875129709779968:12345-0@lo:1000:mdt00_003.0 Request processed in 221us (389us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788263339.775787:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788263339.775818:0:8884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398742300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8884:1875129709779968:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788263339.775952:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba66700c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.775960:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba66700c2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.775967:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba66700c2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.775974:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263339.775978:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba66700c2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.775996:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba66700c2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.776011:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ff282126e00) 00010000:00010000:0.0:1788263339.776014:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788263339.776019:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba66700c2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.776025:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba66700c2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.776045:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666fffe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.776051:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666fffe lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.776057:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666fffe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.776062:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150ee00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263339.776064:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666fffe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.776070:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666fffe lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.776077:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:0.0:1788263339.776079:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788263339.776083:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666fffe lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.776099:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba666fffe lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.776122:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69800/0x4b1103cba66700c9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.776338:0:8884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba667001a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170077 expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.776347:0:8884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69800/0x4b1103cba66700c9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.776372:0:8884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba667001a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170077 expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.776386:0:8884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba667001a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170077 expref: 22 pid: 6493 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263339.776398:0:8884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8884:1875129709780096:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788263339.776495:0:8884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff283a5e180 going to sleep for 11 seconds 00000100:00100000:3.0:1788263339.787904:0:8884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8884:1875129709780096:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263339.787934:0:8884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69800/0x4b1103cba66700c9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263339.788163:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263339.790226:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699231616 00000100:00100000:2.0:1788263339.790236:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699231616 00010000:00010000:2.0:1788263339.790277:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba667001a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170077 expref: 23 pid: 6493 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263339.790317:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 91 00000100:00100000:2.0:1788263339.790326:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398742a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+23:2386:x1875129699231616:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263339.790339:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263339.790346:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba667001a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170077 expref: 23 pid: 6493 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.790360:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba667001a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170077 expref: 23 pid: 6493 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.790389:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba667001a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170077 expref: 23 pid: 6493 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.790406:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:2.0:1788263339.790411:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69800/0x4b1103cba66700c9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.790431:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69800/0x4b1103cba66700c9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.790438:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69800/0x4b1103cba66700c9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.790462:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263339.790515:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398742a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:2386:x1875129699231616:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 190us (2353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263339.790523:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 91 00010000:00010000:2.0:1788263339.791028:0:8884:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69800/0x4b1103cba66700c9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.791038:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69800/0x4b1103cba66700c9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.791050:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69800/0x4b1103cba66700c9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.791057:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69800/0x4b1103cba66700c9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.791064:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69800/0x4b1103cba66700c9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.791070:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b69800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263339.791075:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69800/0x4b1103cba66700c9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.791082:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69800/0x4b1103cba66700c9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.791102:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:2.0:1788263339.791105:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263339.791109:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69800/0x4b1103cba66700c9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.791115:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69800/0x4b1103cba66700c9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.791137:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba66700bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.791144:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba66700bb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.791150:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba66700bb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.791156:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1a00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263339.791159:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba66700bb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.791165:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba66700bb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.791173:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff3b3a5e700) 00010000:00010000:2.0:1788263339.791176:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788263339.791178:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba66700bb lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263339.791185:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba66700bb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263339.791338:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+21:12336:x1875129699231232:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 42801us (43003us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1788263339.791347:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 201 00000020:00080000:2.0:1788263339.791350:0:8884:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788263339.791876:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788263339.791881:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788263339.792771:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788263339.792783:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788263339.797259:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263339.797707:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699231872 00000100:00100000:0.0:1788263339.797717:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699231872 00000100:00100000:0.0:1788263339.797771:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 50 00000100:00100000:0.0:1788263339.797782:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a973c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+21:12336:x1875129699231872:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788263339.798026:0:6495:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788263339.798139:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:0.0:1788263339.798175:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba66700d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.798200:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba66700d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.798213:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba66700d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.798222:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba66700d0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.798227:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba66700d0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.798233:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba66700d0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263339.798319:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263339.798450:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263339.798457:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba66700d0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.798464:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b69000 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263339.798469:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba66700d0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.798475:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba66700d0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.798487:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ff282126e00) 00010000:00010000:3.0:1788263339.798490:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788263339.798495:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba66700d0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.798502:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba66700d0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263339.798513:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263339.798515:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263339.798516:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263339.798533:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a973c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+23:12336:x1875129699231872:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 751us (1283us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788263339.798541:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 50 00000020:00080000:0.0:1788263339.798550:0:6495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1788263339.961985:0:14578:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788263339.961993:0:14578:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788263339.962026:0:14578:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788263339.962033:0:14578:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788263340.079913:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788263340.079936:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709780224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788263340.079998:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263340.080058:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709780224 00000100:00100000:1.0:1788263340.080066:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709780224 00000100:00100000:1.0:1788263340.080111:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788263340.080121:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709780224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788263340.080153:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1788263340.080208:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709780224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263340.080215:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788263340.080257:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709780224:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788263340.085138:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263340.085924:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699232128 00000100:00100000:1.0:1788263340.085934:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699232128 00000100:00100000:1.0:1788263340.086007:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 202 00000100:00100000:1.0:1788263340.086017:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+23:12346:x1875129699232128:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1788263340.086040:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263340.086062:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba66700d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11700af expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.086173:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba66700de lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.086187:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba66700de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.086200:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba66700de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263340.086211:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788263340.086304:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba66700d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700af expref: 26 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.086320:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba66700de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700af expref: 25 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.086329:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:1.0:1788263340.086340:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788263340.086345:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381681800, rc 0) 00000100:00100000:1.0:1788263340.086404:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+25:12346:x1875129699232128:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 388us (1285us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788263340.086411:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 202 00000100:00080000:3.0:1788263340.086561:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263340.093080:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263340.093175:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699232256 00000100:00100000:3.0:1788263340.093186:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699232256 00000100:00100000:3.0:1788263340.093252:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 203 00000100:00100000:3.0:1788263340.093264:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+25:12346:x1875129699232256:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:3.0:1788263340.093333:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba66700ec lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093348:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba66700ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093359:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba66700ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093375:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba66700f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093383:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba66700f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093390:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba66700f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093463:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66700fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093471:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66700fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093479:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66700fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788263340.093524:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66700fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093536:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba66700ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093548:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba66700ec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093555:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba66700ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093562:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150fa00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263340.093566:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba66700ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093572:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba66700ec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093613:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:3.0:1788263340.093616:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263340.093621:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba66700ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093627:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba66700ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093650:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba66700f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093656:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba66700f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093661:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba66700f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093666:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150e800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263340.093824:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba66700f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093831:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba66700f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093838:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ff282126f00) 00010000:00010000:3.0:1788263340.093840:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263340.093843:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba66700f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093848:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba66700f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093862:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66700fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093868:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66700fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093873:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66700fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093878:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150e400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263340.093881:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66700fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093887:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66700fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093893:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff282126200) 00010000:00010000:3.0:1788263340.093895:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263340.093904:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66700fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.093910:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66700fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263340.093983:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+25:12346:x1875129699232256:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 719us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263340.093991:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 203 00000100:00100000:1.0:1788263340.163570:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263340.163957:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699232512 00000100:00100000:2.0:1788263340.163968:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699232512 00000100:00100000:2.0:1788263340.164046:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 204 00000100:00100000:2.0:1788263340.164058:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+25:12349:x1875129699232512:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788263340.164079:0:8884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263340.164110:0:8884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba6670101 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11700b6 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.164188:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670108 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.164202:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670108 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.164214:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670108 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.164228:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba667010f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.164265:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba667010f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.164273:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba667010f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.164401:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba6670116 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.164410:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba6670116 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.164417:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba6670116 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263340.164427:0:8884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788263340.164695:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670108 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.164703:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670108 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.164709:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670108 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.164714:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1000 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263340.164718:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670108 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.164725:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670108 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.164748:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:2.0:1788263340.164751:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263340.164756:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670108 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.164763:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670108 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.164775:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba667010f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.164781:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba667010f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.164787:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba667010f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.164798:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1e00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263340.164801:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba667010f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.164808:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba667010f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.164815:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ff28227a100) 00010000:00010000:2.0:1788263340.164817:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263340.164820:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba667010f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.164826:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba667010f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.164880:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba6670101 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700b6 expref: 28 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.164894:0:8884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba6670116 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700b6 expref: 27 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.164901:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff28227a000) 00010000:00010000:2.0:1788263340.164903:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788263340.164906:0:8884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d1200, rc 0) 00000100:00100000:2.0:1788263340.164970:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+27:12349:x1875129699232512:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 915us (1409us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1788263340.164978:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 204 00000100:00100000:0.0:1788263340.171566:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263340.171949:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699232640 00000100:00100000:1.0:1788263340.171960:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699232640 00000100:00100000:1.0:1788263340.172018:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 205 00000100:00100000:1.0:1788263340.172030:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+27:12349:x1875129699232640:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:1.0:1788263340.172097:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba6670124 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.172115:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba6670124 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.172141:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba6670124 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.172176:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba6670124 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.172184:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba6670124 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.172191:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba6670124 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.172197:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381681600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263340.172202:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba6670124 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.172223:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba6670124 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.172246:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff28227a000) 00010000:00010000:1.0:1788263340.172250:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788263340.172254:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba6670124 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.172261:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba6670124 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263340.172337:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+27:12349:x1875129699232640:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 308us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263340.172346:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 205 00000100:00100000:0.0:1788263340.174873:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263340.174955:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699232896 00000100:00100000:3.0:1788263340.174964:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699232896 00000100:00100000:3.0:1788263340.175023:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 51 00000100:00100000:3.0:1788263340.175033:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+27:12349:x1875129699232896:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1788263340.175286:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+28:12349:x1875129699232896:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 254us (428us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1788263340.175295:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 51 00000100:00100000:2.0:1788263340.234688:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263340.234829:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699233152 00000100:00100000:3.0:1788263340.234839:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699233152 00000100:00100000:3.0:1788263340.234901:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 206 00000100:00100000:3.0:1788263340.234912:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+28:11881:x1875129699233152:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1788263340.234934:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263340.234953:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba667012b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11700bd expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.235073:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba6670132 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.235087:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba6670116 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700b6 expref: 29 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.235112:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba6670132 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.235156:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba6670116 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700b6 expref: 29 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.235169:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba6670116 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700b6 expref: 29 pid: 8884 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263340.235183:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6491:1875129709780352:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788263340.235299:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff282244780 going to sleep for 11 seconds 00000100:00100000:3.0:1788263340.237860:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6491:1875129709780352:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263340.237888:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba6670132 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263340.241865:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263340.242736:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699233280 00000100:00100000:0.0:1788263340.242747:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699233280 00010000:00010000:0.0:1788263340.242788:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba6670116 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700b6 expref: 30 pid: 8884 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263340.242851:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 92 00000100:00100000:0.0:1788263340.242861:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+30:2386:x1875129699233280:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263340.242875:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263340.242882:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba6670116 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700b6 expref: 30 pid: 8884 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263340.242894:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba6670116 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700b6 expref: 30 pid: 8884 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263340.242913:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba6670116 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700b6 expref: 30 pid: 8884 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263340.242929:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff28227a000) 00010000:00010000:0.0:1788263340.242934:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba6670132 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263340.242942:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba6670132 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263340.242949:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba6670132 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263340.243022:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263340.243086:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:2386:x1875129699233280:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 226us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263340.243096:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 92 00010000:00010000:3.0:1788263340.246141:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba6670132 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.246158:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba6670132 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263340.246182:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788263340.246565:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba667012b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700bd expref: 30 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.246723:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba6670132 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700bd expref: 29 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.246752:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff28227a000) 00010000:00010000:3.0:1788263340.246756:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788263340.246759:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150e400, rc 0) 00000100:00100000:3.0:1788263340.246873:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:11881:x1875129699233152:12345-192.168.203.26@tcp:101:bash.0 Request processed in 11962us (12193us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1788263340.246882:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 206 00000100:00100000:2.0:1788263340.251363:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263340.251771:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699233408 00000100:00100000:1.0:1788263340.251781:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699233408 00000100:00100000:1.0:1788263340.251840:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 207 00000100:00100000:1.0:1788263340.251851:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:11881:x1875129699233408:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1788263340.251873:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263340.251893:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba6670140 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11700c4 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.251928:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba6670147 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.251941:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba6670147 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.251952:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba6670147 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.252138:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba6670140 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700c4 expref: 31 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.252156:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba6670147 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700c4 expref: 30 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.252165:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff28227a000) 00010000:00010000:1.0:1788263340.252168:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788263340.252171:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381680a00, rc 0) 00000100:00100000:1.0:1788263340.252230:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+30:11881:x1875129699233408:12345-192.168.203.26@tcp:101:bash.0 Request processed in 381us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263340.252237:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 207 00000100:00100000:2.0:1788263340.262356:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263340.262547:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699233664 00000100:00100000:1.0:1788263340.262556:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699233664 00000100:00100000:1.0:1788263340.262657:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 208 00000100:00100000:1.0:1788263340.262666:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+30:11881:x1875129699233664:12345-192.168.203.26@tcp:36:bash.0 00010000:00010000:1.0:1788263340.262866:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba667014e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.262882:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba667014e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.262893:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba667014e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788263340.262931:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:1.0:1788263340.262949:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ade810bb reply state 00000000f4dab72d transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba667014e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.263000:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba667014e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.263007:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff28227a000) 00010000:00010000:1.0:1788263340.263009:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788263340.263012:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788263340.263049:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:1.0:1788263340.263503:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+34:11881:x1875129699233664:12345-192.168.203.26@tcp:36:bash.0 Request processed in 835us (1152us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788263340.263512:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 208 00000020:00080000:1.0:1788263340.263517:0:6492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788263340.267857:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263340.267975:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699233792 00000100:00100000:3.0:1788263340.267985:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699233792 00000100:00100000:3.0:1788263340.268052:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 209 00000100:00100000:3.0:1788263340.268062:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+34:11881:x1875129699233792:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1788263340.268085:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263340.268103:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba6670155 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11700cb expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.268167:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba6670155 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700cb expref: 35 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.268182:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba6670155 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700cb expref: 35 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.268199:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff28227a000) 00010000:00010000:3.0:1788263340.268202:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788263340.268206:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150ee00, rc 0) 00000100:00100000:3.0:1788263340.268511:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+35:11881:x1875129699233792:12345-192.168.203.26@tcp:101:bash.0 Request processed in 448us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263340.268528:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 209 00000100:00100000:0.0:1788263340.272467:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263340.272556:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699233920 00000100:00100000:3.0:1788263340.272565:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699233920 00000100:00100000:3.0:1788263340.272655:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00100000:3.0:1788263340.272665:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:11881:x1875129699233920:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1788263340.272682:0:8404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263340.272703:0:8404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031fe45e8/0x4b1103cba667015c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11700d2 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788263340.272730:0:8404:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a96bba9, atime: 0x6a96bba8, ctime: 0x6a96bba9, blocks: 0x8 00010000:00010000:3.0:1788263340.272752:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=349s v=(0 0) 00010000:00010000:3.0:1788263340.272756:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263340.272763:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031fe45e8/0x4b1103cba667015c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700d2 expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.272779:0:8404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000031fe45e8/0x4b1103cba667015c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700d2 expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.272791:0:8404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150e800, rc 0) 00000100:00100000:3.0:1788263340.272837:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:11881:x1875129699233920:12345-192.168.203.26@tcp:101:bash.0 Request processed in 174us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263340.272844:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00100000:2.0:1788263340.276760:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263340.277075:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699234048 00000100:00100000:0.0:1788263340.277084:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699234048 00002000:00010000:0.0:1788263340.277133:0:8410:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1788263340.277138:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ff283b70380 with x1875129699234048 ext(0->18446744073709551615) 00002000:00010000:0.0:1788263340.277151:0:8410:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ff283b70380. 00000100:00100000:0.0:1788263340.277225:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:0.0:1788263340.277245:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2387:x1875129699234048:12345-192.168.203.26@tcp:10:bash.0 00002000:00010000:0.0:1788263340.277508:0:8410:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788263340.277512:0:8410:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788263337 -> 1788263339 00002000:00010000:0.0:1788263340.277514:0:8410:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788263336 -> 1788263336 00002000:00010000:0.0:1788263340.277516:0:8410:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788263337 -> 1788263339 00002000:00010000:0.0:1788263340.277518:0:8410:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788263340.277623:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:2387:x1875129699234048:12345-192.168.203.26@tcp:10:bash.0 Request processed in 388us (870us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788263340.277631:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 5 00002000:00010000:0.0:1788263340.277796:0:8410:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1788263340.277803:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ff283b70380 with x1875129699234048 ext(0->18446744073709551615) 00002000:00010000:0.0:1788263340.277808:0:8410:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ff283b70380. 00000100:00100000:0.0:1788263340.378814:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263340.378900:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699234176 00000100:00100000:3.0:1788263340.378910:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699234176 00000100:00100000:3.0:1788263340.378977:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 210 00000100:00100000:3.0:1788263340.378987:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+35:12363:x1875129699234176:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:3.0:1788263340.379067:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670163 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379084:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670163 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379095:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670163 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379110:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba667016a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379116:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba667016a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379132:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba667016a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379199:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba6670171 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379219:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba6670171 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379226:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba6670171 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788263340.379467:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba6670171 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379480:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670163 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379496:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670163 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379502:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670163 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379508:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150fa00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263340.379514:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670163 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379522:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670163 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379535:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:3.0:1788263340.379538:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263340.379543:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670163 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379549:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba6670163 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379565:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba667016a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379571:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba667016a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379576:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba667016a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379700:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150f600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263340.379708:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba667016a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379715:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba667016a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379723:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ff282126300) 00010000:00010000:3.0:1788263340.379726:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263340.379728:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba667016a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379734:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba667016a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379749:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba6670171 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379754:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba6670171 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379759:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba6670171 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379763:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150f000 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263340.379766:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba6670171 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379771:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba6670171 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379777:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff28227a000) 00010000:00010000:3.0:1788263340.379779:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263340.379787:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba6670171 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.379793:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba6670171 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263340.379861:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+35:12363:x1875129699234176:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 874us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263340.379869:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 210 00000100:00100000:1.0:1788263340.459495:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263340.459721:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699234432 00000100:00100000:2.0:1788263340.459735:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699234432 00000100:00100000:2.0:1788263340.459814:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 211 00000100:00100000:2.0:1788263340.459837:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+35:12366:x1875129699234432:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788263340.459866:0:8884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263340.459892:0:8884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba6670178 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11700d9 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.459996:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba667017f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.460031:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba667017f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.460044:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba667017f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.460061:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba6670186 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.460068:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba6670186 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.460074:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba6670186 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.460220:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba667018d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.460230:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba667018d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.460237:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba667018d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263340.460249:0:8884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788263340.460348:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba667017f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.460699:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba667017f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.460707:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba667017f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.460724:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1000 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263340.460729:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba667017f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.460737:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba667017f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.460751:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:2.0:1788263340.460754:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263340.460759:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba667017f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.460766:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba667017f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.460784:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba6670186 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.460790:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba6670186 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.460796:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba6670186 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.460801:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0a00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263340.460804:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba6670186 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.460810:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba6670186 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.460951:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ff28227a100) 00010000:00010000:2.0:1788263340.460954:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263340.460958:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba6670186 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.460965:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba6670186 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.461505:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba6670178 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700d9 expref: 38 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.461526:0:8884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba667018d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700d9 expref: 37 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.461671:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff28227a000) 00010000:00010000:2.0:1788263340.461674:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788263340.461677:0:8884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d1c00, rc 0) 00000100:00100000:2.0:1788263340.461776:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+37:12366:x1875129699234432:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1941us (2293us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788263340.461787:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 211 00000100:00100000:0.0:1788263340.470651:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263340.470815:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699234560 00000100:00100000:1.0:1788263340.470835:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699234560 00000100:00100000:1.0:1788263340.470906:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 212 00000100:00100000:1.0:1788263340.470918:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3856a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+37:12366:x1875129699234560:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:1.0:1788263340.471017:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba667019b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.471039:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba6670132 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700bd expref: 37 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.471050:0:10388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba667019b lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.471095:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba6670132 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700bd expref: 37 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.471142:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba6670132 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700bd expref: 37 pid: 6491 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263340.471159:0:10388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff38541bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10388:1875129709780480:192.168.203.26@tcp:104: 00000100:00100000:1.0:1788263340.471283:0:10388:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff283128480 going to sleep for 11 seconds 00000100:00100000:3.0:1788263340.479115:0:10388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff38541bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10388:1875129709780480:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263340.479168:0:10388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba667019b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263340.485414:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263340.490163:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699234816 00000100:00100000:3.0:1788263340.490184:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699234816 00000100:00100000:3.0:1788263340.490283:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:3.0:1788263340.490296:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+38:6155:x1875129699234816:12345-192.168.203.26@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788263340.492888:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+39:6155:x1875129699234816:12345-192.168.203.26@tcp:35:ldlm_bl.0 Request processed in 2582us (7476us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788263340.492904:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:1.0:1788263340.498998:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263340.499148:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699234944 00000100:00100000:2.0:1788263340.499162:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699234944 00010000:00010000:2.0:1788263340.499231:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba6670132 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700bd expref: 39 pid: 6491 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263340.499281:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 93 00000100:00100000:2.0:1788263340.499292:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38541a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+39:2387:x1875129699234944:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263340.499330:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263340.499339:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba6670132 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700bd expref: 39 pid: 6491 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.499365:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba6670132 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700bd expref: 39 pid: 6491 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.499398:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba6670132 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700bd expref: 39 pid: 6491 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.499420:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff28227a000) 00010000:00010000:2.0:1788263340.499425:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba667019b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.499438:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba667019b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.499445:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba667019b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.499488:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263340.499562:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38541a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+38:2387:x1875129699234944:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 271us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263340.499570:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 93 00010000:00010000:3.0:1788263340.500262:0:10388:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba667019b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.500274:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba667019b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.500325:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba667019b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.500332:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba667019b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.500351:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba667019b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.500368:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381681600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263340.500380:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba667019b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.500389:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba667019b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.500402:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff28227a000) 00010000:00010000:3.0:1788263340.500405:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788263340.500409:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba667019b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.500414:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba667019b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263340.500555:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3856a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+37:12366:x1875129699234560:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 29637us (29916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263340.500565:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 212 00000100:00100000:1.0:1788263340.511116:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263340.511263:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699235200 00000100:00100000:2.0:1788263340.511288:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699235200 00000100:00100000:2.0:1788263340.511370:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:2.0:1788263340.511392:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38541a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+37:12366:x1875129699235200:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:2.0:1788263340.511764:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38541a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+38:12366:x1875129699235200:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 375us (661us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788263340.511772:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:0.0:1788263340.593141:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263340.593175:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709780608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263340.593286:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263340.593824:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709780608 00000100:00100000:3.0:1788263340.593835:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709780608 00000100:00100000:3.0:1788263340.593906:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788263340.593917:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28414b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3618:x1875129709780608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788263340.593955:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263340.594019:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28414b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3618:x1875129709780608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263340.594027:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788263340.596764:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709780608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788263340.596896:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28414bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709780736:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788263340.596973:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263340.597313:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709780736 00000100:00100000:0.0:1788263340.597322:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709780736 00000100:00100000:0.0:1788263340.597401:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788263340.597411:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709780736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788263340.597438:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263340.597501:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709780736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263340.597509:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788263340.597707:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28414bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709780736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788263340.624798:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263340.624931:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699235456 00000100:00100000:1.0:1788263340.624945:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699235456 00000100:00100000:1.0:1788263340.625026:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 213 00000100:00100000:1.0:1788263340.625038:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+38:12377:x1875129699235456:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:1.0:1788263340.625071:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263340.625099:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba66701a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11700e0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.625204:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba66701a9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.625222:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba66701a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.625237:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba66701a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.625255:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba66701b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.625262:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba66701b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.625290:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba66701b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.625444:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba66701b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.625454:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba66701b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.625461:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba66701b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263340.625472:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788263340.625568:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba66701a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.625617:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba66701a9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.625626:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba66701a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.625634:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381681600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263340.625639:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba66701a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.625648:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba66701a9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.625662:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:1.0:1788263340.625666:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263340.625678:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba66701a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.625686:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba66701a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.625704:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba66701b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.625711:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba66701b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.625717:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba66701b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.625723:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381680c00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263340.625727:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba66701b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.625733:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba66701b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.625741:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ff383b6e200) 00010000:00010000:1.0:1788263340.625743:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263340.625746:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba66701b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.625752:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba66701b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.625804:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba66701a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700e0 expref: 41 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.625834:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba66701b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700e0 expref: 40 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.625842:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff28227a000) 00010000:00010000:1.0:1788263340.625845:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788263340.625848:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae765a00, rc 0) 00000100:00100000:1.0:1788263340.625941:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+40:12377:x1875129699235456:12345-192.168.203.26@tcp:101:cat.0 Request processed in 904us (1157us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1788263340.625950:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 213 00000100:00100000:0.0:1788263340.638636:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263340.638843:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699235712 00000100:00100000:2.0:1788263340.638856:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699235712 00000100:00100000:2.0:1788263340.638921:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:2.0:1788263340.638931:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28414a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+40:12377:x1875129699235712:12345-192.168.203.26@tcp:35:cat.0 00000100:00100000:2.0:1788263340.639309:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28414a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+41:12377:x1875129699235712:12345-192.168.203.26@tcp:35:cat.0 Request processed in 377us (737us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788263340.639317:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:0.0:1788263340.697913:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263340.699493:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699235968 00000100:00100000:2.0:1788263340.699514:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699235968 00000100:00100000:2.0:1788263340.702536:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 214 00000100:00100000:2.0:1788263340.702605:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+41:12378:x1875129699235968:12345-192.168.203.26@tcp:36:rm.0 00010000:00010000:2.0:1788263340.702691:0:8884:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788263340.702727:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba6670155 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700cb expref: 41 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.702758:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba66701b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700e0 expref: 40 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.702773:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba667018d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700d9 expref: 39 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.702804:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680a00/0x4b1103cba6670147 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700c4 expref: 38 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.702818:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff28227a000) 00010000:00010000:2.0:1788263340.702824:0:8884:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788263340.702853:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba66701c5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.702867:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba66701c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.702877:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba66701c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.702893:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba66701cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.702900:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba66701cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.702907:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba66701cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.703003:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba66701d3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.703012:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba66701d3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.703019:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba66701d3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788263340.703334:0:8884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1788263340.703345:0:8884:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 349774765674ns, next at 350774762495ns, rc = 0 00010000:00010000:2.0:1788263340.703760:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba66701da lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.703771:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba66701da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.703781:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba66701da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.703789:0:8884:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba66701da lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.703796:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba66701da lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.703804:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba66701da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.703833:0:8884:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263340.703855:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba66701d3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.703862:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba66701d3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.703869:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba66701d3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.703874:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1000 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263340.703889:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba66701d3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.703897:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba66701d3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.703908:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff28227a000) 00010000:00010000:2.0:1788263340.703910:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788263340.703915:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba66701d3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.703921:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba66701d3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.703939:0:8884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba66701c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.703946:0:8884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba66701c5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.703951:0:8884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba66701c5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.703955:0:8884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1e00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263340.703958:0:8884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba66701c5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.703965:0:8884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba66701c5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.703972:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:2.0:1788263340.703975:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263340.703984:0:8884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba66701c5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.703990:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1e00/0x4b1103cba66701c5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788263340.704000:0:8884:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054880f9c reply state 00000000e42f2ab0 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba66701cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.704012:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba66701cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.704019:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ff28227a100) 00010000:00010000:2.0:1788263340.704021:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788263340.704024:0:8884:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788263340.707683:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263340.707706:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba66701da lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.707720:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1800 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:1.0:1788263340.707725:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba66701da lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.707735:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba66701da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.707760:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff28227a000) 00010000:00010000:1.0:1788263340.707763:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788263340.707768:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba66701da lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.707774:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba66701da lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.707800:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263340.707825:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263340.707828:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263340.708277:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+39:12378:x1875129699235968:12345-192.168.203.26@tcp:36:rm.0 Request processed in 1569us (6226us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788263340.708291:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 214 00010000:00010000:2.0:1788263340.725513:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263340.812510:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263340.812983:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699236224 00000100:00100000:3.0:1788263340.812997:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699236224 00000100:00100000:3.0:1788263340.813083:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 215 00000100:00100000:3.0:1788263340.813095:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+39:12384:x1875129699236224:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1788263340.813136:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263340.813163:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66701e1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11700e7 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.813313:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba66701e8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.813332:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba66701e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.813346:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba66701e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.813359:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba66701ef lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.813378:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba66701ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.813387:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba66701ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788263340.813845:0:10388:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788263340.814745:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66701f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.814767:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66701f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.814796:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66701f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.814844:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba66701e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.814852:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba66701e8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.814859:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba66701e8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.814877:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150f600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263340.814883:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba66701e8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.814891:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba66701e8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.814906:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:3.0:1788263340.814910:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263340.814916:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba66701e8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.814922:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba66701e8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788263340.814942:0:10388:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba5e45c6 reply state 000000008bc670b3 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba66701ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.814955:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba66701ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.814970:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ff28227a100) 00010000:00010000:3.0:1788263340.814972:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788263340.814976:0:10388:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788263340.815022:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66701e1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700e7 expref: 42 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.815040:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66701f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700e7 expref: 41 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263340.815048:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff282126300) 00010000:00010000:3.0:1788263340.815051:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263340.815053:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150ee00, rc 0) 00000100:00100000:3.0:1788263340.815516:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+42:12384:x1875129699236224:12345-192.168.203.26@tcp:101:bash.0 Request processed in 2420us (3018us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788263340.815527:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 215 00000100:00100000:0.0:1788263340.825132:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263340.828340:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699236352 00000100:00100000:1.0:1788263340.828364:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699236352 00000100:00100000:1.0:1788263340.828717:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00100000:1.0:1788263340.828732:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2386:x1875129699236352:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1788263340.828758:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263340.828787:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d25ec67a/0x4b1103cba6670204 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11700ee expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788263340.828823:0:8406:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263340.828849:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=349s v=(0 0) 00010000:00010000:1.0:1788263340.828854:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263340.828880:0:8406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d25ec67a/0x4b1103cba6670204 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700ee expref: 8 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.828903:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d25ec67a/0x4b1103cba6670204 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700ee expref: 8 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.828920:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae764400, rc 0) 00000100:00100000:1.0:1788263340.829012:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2386:x1875129699236352:12345-192.168.203.26@tcp:101:bash.0 Request processed in 283us (3905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263340.829020:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00080000:3.0:1788263340.830835:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788263340.838537:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263340.838811:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699236480 00000100:00100000:1.0:1788263340.838825:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699236480 00000100:00100000:1.0:1788263340.838981:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 68 00000100:00100000:1.0:1788263340.838995:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:12384:x1875129699236480:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1788263340.839041:0:14442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263340.839072:0:14442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f9a4adf/0x4b1103cba667020b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11700f5 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.839135:0:14442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d25ec67a/0x4b1103cba6670204 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700ee expref: 9 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.839146:0:14442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263340.839152:0:14442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263340.839158:0:14442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f9a4adf/0x4b1103cba667020b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700f5 expref: 9 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.839523:0:14442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d25ec67a/0x4b1103cba6670204 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700ee expref: 9 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.839540:0:14442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d25ec67a/0x4b1103cba6670204 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700ee expref: 9 pid: 8406 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263340.839557:0:14442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385419880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14442:1875129709780864:192.168.203.26@tcp:104: 00000100:00100000:1.0:1788263340.839788:0:14442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2831289c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263340.845298:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263340.845462:0:14442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385419880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14442:1875129709780864:192.168.203.26@tcp:104: 00010000:00010000:1.0:1788263340.845510:0:14442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f9a4adf/0x4b1103cba667020b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700f5 expref: 9 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263340.845536:0:14442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae765c00, rc 0) 00000100:00100000:1.0:1788263340.845668:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:12384:x1875129699236480:12345-192.168.203.26@tcp:101:bash.0 Request processed in 6676us (7145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263340.845678:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 68 00000100:00100000:2.0:1788263340.846006:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699236608 00000100:00100000:2.0:1788263340.846015:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699236608 00010000:00010000:2.0:1788263340.846056:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d25ec67a/0x4b1103cba6670204 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700ee expref: 9 pid: 8406 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263340.846097:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 94 00000100:00100000:2.0:1788263340.846107:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0455450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:2387:x1875129699236608:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263340.846133:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263340.846160:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d25ec67a/0x4b1103cba6670204 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700ee expref: 9 pid: 8406 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.846512:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d25ec67a/0x4b1103cba6670204 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700ee expref: 9 pid: 8406 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.846541:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d25ec67a/0x4b1103cba6670204 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700ee expref: 9 pid: 8406 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.846560:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263340.846565:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263340.846575:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007f9a4adf/0x4b1103cba667020b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700f5 expref: 8 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.846844:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f9a4adf/0x4b1103cba667020b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700f5 expref: 8 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263340.846905:0:6477:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007f9a4adf/0x4b1103cba667020b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700f5 expref: 8 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263340.846923:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b71180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6477:1875129709780992:192.168.203.26@tcp:105: 00000100:00100000:2.0:1788263340.847021:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28410e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788263340.861859:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b71180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6477:1875129709780992:192.168.203.26@tcp:105: 00010000:00010000:2.0:1788263340.861904:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263340.861976:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0455450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2387:x1875129699236608:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 15869us (16693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263340.861990:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 94 00000100:00100000:0.0:1788263340.862500:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263340.874223:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699236864 00000100:00100000:1.0:1788263340.874246:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699236864 00000100:00100000:1.0:1788263340.874331:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:1.0:1788263340.874364:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28414b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+42:12384:x1875129699236864:12345-192.168.203.26@tcp:35:bash.0 00000100:00100000:1.0:1788263340.874752:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28414b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+43:12384:x1875129699236864:12345-192.168.203.26@tcp:35:bash.0 Request processed in 408us (12251us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788263340.874761:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:1.0:1788263341.139066:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263341.139215:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699236992 00000100:00100000:3.0:1788263341.139227:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699236992 00000100:00100000:3.0:1788263341.139304:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 216 00000100:00100000:3.0:1788263341.139316:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+43:12400:x1875129699236992:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788263341.139349:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263341.139387:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba6670212 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11700fc expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.139478:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba6670219 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.139522:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba6670219 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.139539:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba6670219 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263341.139643:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788263341.139648:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788263341.139671:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba6670219 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.139700:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba6670212 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700fc expref: 45 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.139723:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba6670219 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700fc expref: 44 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.139733:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:3.0:1788263341.139736:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788263341.139740:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150f600, rc 0) 00000100:00100000:3.0:1788263341.139822:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+44:12400:x1875129699236992:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 509us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263341.139830:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 216 00000100:00100000:0.0:1788263341.147909:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263341.148237:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699237248 00000100:00100000:2.0:1788263341.148250:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699237248 00000100:00100000:2.0:1788263341.148329:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 217 00000100:00100000:2.0:1788263341.148343:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28414a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+44:12400:x1875129699237248:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788263341.148369:0:8884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263341.148396:0:8884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670220 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170103 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.148540:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba6670227 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.148558:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba6670227 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.148573:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba6670227 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263341.150177:0:8884:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788263341.150356:0:8884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670220 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170103 expref: 47 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.150381:0:8884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba6670227 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170103 expref: 46 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.150391:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff282126300) 00010000:00010000:2.0:1788263341.150395:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788263341.150399:0:8884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d1c00, rc 0) 00000100:00100000:2.0:1788263341.150505:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28414a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+46:12400:x1875129699237248:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 2164us (2608us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1788263341.150538:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 217 00000100:00100000:2.0:1788263341.160223:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263341.160272:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263341.160409:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699237632 00000100:00100000:0.0:1788263341.160421:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699237632 00000100:00100000:0.0:1788263341.160501:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:0.0:1788263341.160514:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+46:2389:x1875129699237632:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263341.160535:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263341.160567:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba6670227 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170103 expref: 46 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.164610:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff282126300) 00010000:00010000:0.0:1788263341.164626:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263341.164776:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+45:2389:x1875129699237632:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 4257us (4495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263341.164788:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:3.0:1788263341.167296:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699237504 00000100:00100000:3.0:1788263341.167317:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699237504 00000100:00100000:3.0:1788263341.167407:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 218 00000100:00100000:3.0:1788263341.167420:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+45:12400:x1875129699237504:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788263341.167452:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263341.167498:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba6670235 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d117010a expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.167679:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba667023c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.167697:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba667023c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.167712:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba667023c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263341.167726:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788263341.167853:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba6670235 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117010a expref: 48 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.167875:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba667023c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117010a expref: 47 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.167885:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff282126300) 00010000:00010000:3.0:1788263341.167888:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788263341.167891:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150e400, rc 0) 00000100:00100000:3.0:1788263341.167967:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+47:12400:x1875129699237504:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 550us (7760us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1788263341.167975:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 218 00000100:00100000:3.0:1788263341.204222:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263341.205433:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699237760 00000100:00100000:1.0:1788263341.205454:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699237760 00000100:00100000:1.0:1788263341.205542:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 69 00000100:00100000:1.0:1788263341.205555:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2388:x1875129699237760:12345-192.168.203.26@tcp:1:lfs.0 00010000:00010000:1.0:1788263341.205763:0:9885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6948eb3/0x4b1103cba667024a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.205792:0:9885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f9a4adf/0x4b1103cba667020b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700f5 expref: 8 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.205802:0:9885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788263341.205807:0:9885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788263341.205812:0:9885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6948eb3/0x4b1103cba667024a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.205863:0:9885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007f9a4adf/0x4b1103cba667020b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700f5 expref: 8 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.205971:0:9885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007f9a4adf/0x4b1103cba667020b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700f5 expref: 8 pid: 14442 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263341.205989:0:9885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385419500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9885:1875129709781120:192.168.203.26@tcp:104: 00000100:00100000:1.0:1788263341.206187:0:9885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2831289c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263341.230781:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263341.230866:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699237888 00000100:00100000:3.0:1788263341.230877:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699237888 00002000:00100000:3.0:1788263341.230936:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9ff38541b100 x1875129699237888/t0(0) o4->ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp:552/0 lens 504/0 e 0 to 0 dl 1788263352 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788263341.230971:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ff38541b100 with x1875129699237888 ext(0->8) 00010000:00010000:3.0:1788263341.230982:0:8409:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007f9a4adf/0x4b1103cba667020b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700f5 expref: 9 pid: 14442 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.231001:0:8409:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007f9a4adf/0x4b1103cba667020b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700f5 expref: 9 pid: 14442 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788263341.231010:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ff38541b100 00000100:00100000:3.0:1788263341.231045:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:3.0:1788263341.231055:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38541b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:2387:x1875129699237888:12345-192.168.203.26@tcp:4:lfs.0 00000100:00100000:0.0:1788263341.232370:0:9885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385419500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9885:1875129709781120:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788263341.232406:0:9885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c6948eb3/0x4b1103cba667024a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263341.236236:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38541b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+11:2387:x1875129699237888:12345-192.168.203.26@tcp:4:lfs.0 Request processed in 5162us (5448us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788263341.236257:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 3 00002000:00100000:3.0:1788263341.236273:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9ff38541b100 x1875129699237888/t4294967309(0) o4->ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp:552/0 lens 504/448 e 0 to 0 dl 1788263352 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788263341.239088:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ff38541b100 with x1875129699237888 ext(0->8) 00010000:00010000:3.0:1788263341.239131:0:8409:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007f9a4adf/0x4b1103cba667020b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700f5 expref: 11 pid: 14442 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.239154:0:8409:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007f9a4adf/0x4b1103cba667020b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700f5 expref: 11 pid: 14442 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788263341.239165:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ff38541b100 00000100:00100000:0.0:1788263341.245935:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263341.247175:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699238016 00000100:00100000:3.0:1788263341.247416:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699238016 00010000:00010000:3.0:1788263341.247477:0:9493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007f9a4adf/0x4b1103cba667020b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700f5 expref: 11 pid: 14442 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263341.247608:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 95 00000100:00100000:3.0:1788263341.247620:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284148a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+11:2387:x1875129699238016:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263341.247640:0:9493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788263341.247664:0:9493:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788263341.247667:0:9493:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788263340 00002000:00010000:3.0:1788263341.247670:0:9493:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788263340 00002000:00010000:3.0:1788263341.247672:0:9493:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788263340 00002000:00010000:3.0:1788263341.247674:0:9493:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788263341.247681:0:9493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007f9a4adf/0x4b1103cba667020b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700f5 expref: 11 pid: 14442 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.247696:0:9493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007f9a4adf/0x4b1103cba667020b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700f5 expref: 11 pid: 14442 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.247724:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f9a4adf/0x4b1103cba667020b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700f5 expref: 11 pid: 14442 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.247744:0:9493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788263341.247749:0:9493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788263341.247756:0:9493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6948eb3/0x4b1103cba667024a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.247768:0:9493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6948eb3/0x4b1103cba667024a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.247852:0:9493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263341.247927:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284148a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+10:2387:x1875129699238016:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 308us (2006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263341.247935:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 95 00010000:00010000:0.0:1788263341.248714:0:9885:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c6948eb3/0x4b1103cba667024a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.248732:0:9885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6948eb3/0x4b1103cba667024a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.248761:0:9885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6948eb3/0x4b1103cba667024a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.248769:0:9885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6948eb3/0x4b1103cba667024a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.248778:0:9885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6948eb3/0x4b1103cba667024a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.248787:0:9885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765a00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263341.248792:0:9885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6948eb3/0x4b1103cba667024a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.248819:0:9885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6948eb3/0x4b1103cba667024a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.248838:0:9885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6948eb3/0x4b1103cba667024a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.248845:0:9885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6948eb3/0x4b1103cba667024a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263341.248942:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:2388:x1875129699237760:12345-192.168.203.26@tcp:1:lfs.0 Request processed in 43389us (44737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263341.249139:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 69 00000100:00100000:0.0:1788263341.252317:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263341.252415:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699238272 00000100:00100000:1.0:1788263341.252425:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699238272 00000100:00100000:1.0:1788263341.252485:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:1.0:1788263341.252495:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a973d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+47:12400:x1875129699238272:12345-192.168.203.26@tcp:35:lfs.0 00000004:00010000:1.0:1788263341.252555:0:6494:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba667023c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117010a expref: 47 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788263341.252760:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1788263341.252789:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1788263341.253062:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:1.0:1788263341.253095:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba6670251 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.253110:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66701f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700e7 expref: 51 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.253130:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba6670251 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.253164:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66701f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700e7 expref: 51 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.253190:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66701f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700e7 expref: 51 pid: 10388 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263341.253205:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385418a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6494:1875129709781248:192.168.203.26@tcp:104: 00000100:00100000:1.0:1788263341.253286:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff283128e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788263341.258415:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263341.258506:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699238400 00000100:00100000:0.0:1788263341.258515:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699238400 00010000:00010000:0.0:1788263341.258555:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66701f6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700e7 expref: 52 pid: 10388 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263341.258626:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 96 00000100:00100000:0.0:1788263341.258636:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385419180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+52:2386:x1875129699238400:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263341.258654:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263341.258665:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66701f6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700e7 expref: 52 pid: 10388 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.258682:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66701f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700e7 expref: 52 pid: 10388 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.258716:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff282126300) 00010000:00010000:0.0:1788263341.258721:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba6670251 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.258731:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba6670251 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.258738:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba6670251 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.258864:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66701f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700e7 expref: 52 pid: 10388 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.258866:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263341.258888:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385418a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6494:1875129709781248:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263341.258912:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba6670251 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.258921:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba6670251 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.258928:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba6670251 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263341.258973:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385419180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+51:2386:x1875129699238400:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 324us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263341.258986:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 96 00000001:00080000:3.0:1788263341.259046:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:3.0:1788263341.259184:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1788263341.259271:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6494:1875129709781376:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788263341.259327:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263341.259909:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2822443c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263341.265250:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709781376 00000100:00100000:0.0:1788263341.265264:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709781376 00000100:00100000:1.0:1788263341.265523:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788263341.265536:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b016f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6494:x1875129709781376:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788263341.265701:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b016f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6494:x1875129709781376:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 168us (6373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263341.265710:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:3.0:1788263341.266097:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263341.267197:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6494:1875129709781376:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788263341.267352:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1788263341.267422:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b73480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6494:1875129709781504:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788263341.267520:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263341.267555:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28410e840 going to sleep for 11 seconds 00000100:00100000:0.0:1788263341.267636:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709781504 00000100:00100000:0.0:1788263341.267645:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709781504 00000100:00100000:0.0:1788263341.267695:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788263341.267705:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6494:x1875129709781504:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788263341.267841:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6494:x1875129709781504:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 137us (321us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788263341.267851:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788263341.267879:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b73480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6494:1875129709781504:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788263341.267917:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1788263341.267948:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba6670251 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.267958:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba6670251 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.267967:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba6670251 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.267973:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381681a00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263341.267978:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba6670251 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.267985:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba6670251 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.268012:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff282126300) 00010000:00010000:2.0:1788263341.268015:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788263341.268030:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba6670251 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.268037:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba6670251 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788263341.268289:0:6494:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788263341.268346:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1788263341.268356:0:6494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 350339776384ns, next at 351339774425ns, rc = 0 00000001:00080000:2.0:1788263341.268362:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1788263341.268384:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff282126300) 00010000:00010000:2.0:1788263341.268387:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788263341.268393:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba667023c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117010a expref: 55 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263341.268937:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a973d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+54:12400:x1875129699238272:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 16441us (16627us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788263341.268945:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 56 00000020:00080000:2.0:1788263341.268950:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788263341.274964:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263341.279719:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699238528 00000100:00100000:0.0:1788263341.279734:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699238528 00000100:00100000:0.0:1788263341.279807:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 219 00000100:00100000:0.0:1788263341.279817:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38541ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+54:12400:x1875129699238528:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788263341.279840:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263341.279861:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69400/0x4b1103cba6670258 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170111 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.279911:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69400/0x4b1103cba6670258 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170111 expref: 55 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.279937:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69400/0x4b1103cba6670258 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170111 expref: 55 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.280865:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:0.0:1788263341.280871:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788263341.280875:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b69400, rc 0) 00000100:00100000:2.0:1788263341.281073:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38541ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+55:12400:x1875129699238528:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1254us (6116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263341.281082:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 219 00000100:00100000:1.0:1788263341.284867:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263341.284940:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699238784 00000100:00100000:3.0:1788263341.284950:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699238784 00000100:00100000:3.0:1788263341.285012:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:3.0:1788263341.285023:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38541b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+55:12400:x1875129699238784:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1788263341.285315:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38541b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+56:12400:x1875129699238784:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 292us (455us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1788263341.285323:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:0.0:1788263341.408983:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263341.409428:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699238912 00000100:00100000:1.0:1788263341.409438:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699238912 00000100:00100000:1.0:1788263341.409495:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 220 00000100:00100000:1.0:1788263341.409514:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28414ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+56:12410:x1875129699238912:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:1.0:1788263341.409631:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba667025f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.409649:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba667025f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.409662:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba667025f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.409692:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba6670266 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.409701:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba6670266 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.409709:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba6670266 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.409778:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba667026d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.409787:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba667026d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.409794:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba667026d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788263341.409849:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba667026d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.409862:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba667025f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.409868:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba667025f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.409876:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba667025f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.409883:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381681600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263341.409888:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba667025f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.409901:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba667025f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.409914:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:1.0:1788263341.409917:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263341.409922:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba667025f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.409927:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681600/0x4b1103cba667025f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.409941:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba6670266 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.409947:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba6670266 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.409952:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba6670266 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.409957:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381680c00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263341.409960:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba6670266 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.409966:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba6670266 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.409973:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ff28227a100) 00010000:00010000:1.0:1788263341.409975:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263341.409979:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba6670266 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.409994:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba6670266 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.410006:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba667026d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.410011:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba667026d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.410017:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba667026d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.410021:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381681a00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263341.410024:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba667026d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.410029:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba667026d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.410037:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:1.0:1788263341.410039:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263341.410043:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba667026d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.410049:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba667026d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263341.410136:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28414ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+56:12410:x1875129699238912:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 623us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263341.410145:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 220 00000100:00100000:1.0:1788263341.467299:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263341.467549:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699239168 00000100:00100000:0.0:1788263341.467559:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699239168 00000100:00100000:0.0:1788263341.467652:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 221 00000100:00100000:0.0:1788263341.467662:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+56:12413:x1875129699239168:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788263341.467683:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263341.467704:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69800/0x4b1103cba6670274 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170118 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.467775:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba667027b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.467791:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba667027b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.467803:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba667027b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.467813:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69200/0x4b1103cba6670282 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.467821:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69200/0x4b1103cba6670282 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.468153:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69200/0x4b1103cba6670282 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.468270:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670289 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.468280:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670289 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.468287:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670289 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263341.468297:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788263341.468510:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba667027b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.468518:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba667027b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.468525:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba667027b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.468530:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b69000 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263341.468535:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba667027b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.468543:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba667027b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.468555:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:0.0:1788263341.468558:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263341.468566:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba667027b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.468573:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba667027b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.468605:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69200/0x4b1103cba6670282 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.468612:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69200/0x4b1103cba6670282 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.468618:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69200/0x4b1103cba6670282 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.468623:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b69200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263341.468626:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69200/0x4b1103cba6670282 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.468631:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69200/0x4b1103cba6670282 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.468638:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ff28227a100) 00010000:00010000:0.0:1788263341.468641:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263341.468644:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69200/0x4b1103cba6670282 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.468649:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69200/0x4b1103cba6670282 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.468682:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69800/0x4b1103cba6670274 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170118 expref: 59 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.468706:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670289 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170118 expref: 58 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.468714:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:0.0:1788263341.468716:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263341.468718:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b68c00, rc 0) 00000100:00100000:0.0:1788263341.468834:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+58:12413:x1875129699239168:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1165us (1537us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788263341.468842:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 221 00000100:00100000:2.0:1788263341.477431:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263341.477530:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699239296 00000100:00100000:3.0:1788263341.477539:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699239296 00000100:00100000:3.0:1788263341.477780:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 222 00000100:00100000:3.0:1788263341.477795:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+58:12413:x1875129699239296:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:3.0:1788263341.477863:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba6670297 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.477881:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba6670297 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.477892:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba6670297 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.477925:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba6670297 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.477930:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba6670297 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.477937:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba6670297 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.477942:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150ee00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263341.477946:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba6670297 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.477952:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba6670297 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.477978:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:3.0:1788263341.477981:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788263341.477986:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba6670297 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.477992:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba6670297 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263341.478072:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+58:12413:x1875129699239296:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 283us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263341.478079:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 222 00000100:00100000:2.0:1788263341.483631:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263341.483756:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699239552 00000100:00100000:3.0:1788263341.483765:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699239552 00000100:00100000:3.0:1788263341.483817:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00100000:3.0:1788263341.483828:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+58:12413:x1875129699239552:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1788263341.484064:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+59:12413:x1875129699239552:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 237us (441us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1788263341.484073:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00100000:1.0:1788263341.596350:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263341.596743:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699239808 00000100:00100000:3.0:1788263341.596754:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699239808 00000100:00100000:3.0:1788263341.596819:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 223 00000100:00100000:3.0:1788263341.596839:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a0e63850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+59:12422:x1875129699239808:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1788263341.596861:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263341.596865:0:10388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788263341.596890:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba6670219 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700fc expref: 59 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.596927:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:3.0:1788263341.596931:0:10388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263341.596944:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba667029e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d117011f expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.597054:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66702a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.597068:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66702a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.597077:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66702a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263341.597087:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788263341.597194:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba667029e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117011f expref: 61 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.597220:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66702a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117011f expref: 60 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.597227:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:3.0:1788263341.597230:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263341.597233:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150f000, rc 0) 00000100:00100000:3.0:1788263341.597301:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a0e63850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+60:12422:x1875129699239808:12345-192.168.203.26@tcp:101:bash.0 Request processed in 473us (960us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788263341.597308:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 223 00000100:00100000:1.0:1788263341.615200:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263341.615373:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263341.616429:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699239936 00000100:00100000:0.0:1788263341.616441:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699239936 00000100:00100000:0.0:1788263341.616500:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 224 00000100:00100000:0.0:1788263341.616510:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+60:12422:x1875129699239936:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1788263341.616534:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263341.616555:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69200/0x4b1103cba66702b3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170126 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.616621:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba66702ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.616636:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba66702ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.616646:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba66702ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.616755:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69200/0x4b1103cba66702b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170126 expref: 62 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.616781:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba66702ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170126 expref: 61 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.616789:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:0.0:1788263341.616791:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788263341.616796:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b69000, rc 0) 00000100:00100000:0.0:1788263341.616864:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+61:12422:x1875129699239936:12345-192.168.203.26@tcp:101:bash.0 Request processed in 355us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263341.616871:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 224 00000100:00100000:2.0:1788263341.618416:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699240064 00000100:00100000:2.0:1788263341.618426:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699240064 00000100:00100000:2.0:1788263341.618545:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:2.0:1788263341.618555:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38541aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+61:2389:x1875129699240064:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263341.618568:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263341.618613:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66702a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117011f expref: 61 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.618630:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:2.0:1788263341.618634:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263341.618681:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38541aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+60:2389:x1875129699240064:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 128us (3491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263341.618688:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:1.0:1788263341.622096:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263341.622177:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699240320 00000100:00100000:3.0:1788263341.622186:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699240320 00000100:00100000:3.0:1788263341.622345:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 225 00000100:00100000:3.0:1788263341.622355:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+60:12422:x1875129699240320:12345-192.168.203.26@tcp:36:bash.0 00010000:00010000:3.0:1788263341.622404:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263341.622430:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670289 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170118 expref: 60 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.622449:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:3.0:1788263341.622454:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263341.622654:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66702c1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.622668:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66702c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.622677:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66702c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788263341.622714:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:3.0:1788263341.622735:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018682e22 reply state 0000000090b81392 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66702c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.622748:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66702c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.622755:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:3.0:1788263341.622757:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788263341.622760:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788263341.622856:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+62:12422:x1875129699240320:12345-192.168.203.26@tcp:36:bash.0 Request processed in 502us (768us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1788263341.622878:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 225 00000020:00080000:3.0:1788263341.622883:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788263341.628371:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263341.628439:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699240448 00000100:00100000:3.0:1788263341.628448:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699240448 00000100:00100000:3.0:1788263341.628511:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 226 00000100:00100000:3.0:1788263341.628520:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+62:12422:x1875129699240448:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1788263341.628541:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263341.628559:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba66702c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d117012d expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.628675:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66702cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.628689:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66702cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.628701:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66702cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263341.628726:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788263341.628730:0:10388:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788263341.628746:0:10388:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66702cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.628907:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba66702c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117012d expref: 64 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.628923:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66702cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117012d expref: 63 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.628950:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:3.0:1788263341.628953:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263341.628956:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150e400, rc 0) 00000100:00100000:2.0:1788263341.630742:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+63:12422:x1875129699240448:12345-192.168.203.26@tcp:101:bash.0 Request processed in 2215us (2373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263341.630753:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 226 00000100:00100000:1.0:1788263341.634744:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263341.638153:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699240704 00000100:00100000:3.0:1788263341.638167:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699240704 00000100:00100000:2.0:1788263341.638647:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:2.0:1788263341.638658:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+63:12422:x1875129699240704:12345-192.168.203.26@tcp:35:bash.0 00000100:00100000:2.0:1788263341.638864:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+64:12422:x1875129699240704:12345-192.168.203.26@tcp:35:bash.0 Request processed in 208us (4129us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1788263341.638872:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:1.0:1788263341.733305:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263341.733449:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699240832 00000100:00100000:0.0:1788263341.733458:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699240832 00000100:00100000:0.0:1788263341.733522:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 227 00000100:00100000:0.0:1788263341.733532:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38541b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+64:12429:x1875129699240832:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788263341.733556:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263341.733576:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69e00/0x4b1103cba66702d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170134 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.733667:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68200/0x4b1103cba66702dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.733680:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68200/0x4b1103cba66702dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.733690:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68200/0x4b1103cba66702dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263341.733748:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788263341.733752:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788263341.733771:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68200/0x4b1103cba66702dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.733797:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69e00/0x4b1103cba66702d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170134 expref: 66 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.733815:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68200/0x4b1103cba66702dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170134 expref: 65 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.733824:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:0.0:1788263341.733826:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788263341.733830:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b68200, rc 0) 00000100:00100000:0.0:1788263341.733890:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38541b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+65:12429:x1875129699240832:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 360us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263341.733897:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 227 00000100:00100000:0.0:1788263341.738246:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263341.738327:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699240960 00000100:00100000:3.0:1788263341.738337:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699240960 00000100:00100000:3.0:1788263341.738401:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 228 00000100:00100000:3.0:1788263341.738411:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+65:12429:x1875129699240960:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788263341.738430:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263341.738452:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba66702e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d117013b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738512:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66702eb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738526:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66702eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738537:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66702eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738550:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba66702f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738557:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba66702f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738563:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba66702f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738667:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba66702f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738676:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba66702f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738684:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba66702f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263341.738723:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788263341.738727:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788263341.738744:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba66702f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738756:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba66702f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738763:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66702eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738769:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66702eb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738775:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66702eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738780:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150f000 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263341.738784:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66702eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738790:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66702eb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738808:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:3.0:1788263341.738811:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263341.738816:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66702eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738822:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66702eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738837:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba66702f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738843:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba66702f2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738848:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba66702f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738853:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765a00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263341.738856:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba66702f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738862:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba66702f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738869:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ff28227a100) 00010000:00010000:3.0:1788263341.738871:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263341.738875:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba66702f2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738880:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba66702f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738916:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba66702e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117013b expref: 67 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738929:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba66702f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117013b expref: 66 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.738936:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:3.0:1788263341.738938:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263341.738940:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae765c00, rc 0) 00000100:00100000:3.0:1788263341.739461:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+66:12429:x1875129699240960:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1049us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263341.739469:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 228 00000100:00100000:1.0:1788263341.742691:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263341.742810:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699241088 00000100:00100000:2.0:1788263341.742820:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699241088 00000100:00100000:2.0:1788263341.742918:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:2.0:1788263341.742928:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385418e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+66:2386:x1875129699241088:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263341.742943:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263341.742976:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba66702f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117013b expref: 66 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.743006:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:2.0:1788263341.743011:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263341.743068:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385418e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+65:2386:x1875129699241088:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 142us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263341.743075:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:3.0:1788263341.746490:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263341.746795:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699241344 00000100:00100000:0.0:1788263341.746805:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699241344 00000100:00100000:0.0:1788263341.746858:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 229 00000100:00100000:0.0:1788263341.746867:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+65:12429:x1875129699241344:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788263341.746887:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263341.746908:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68600/0x4b1103cba6670300 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170142 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.747022:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670307 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.747049:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66702cf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117012d expref: 66 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.747058:0:10388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670307 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.747091:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66702cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117012d expref: 66 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.747104:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66702cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117012d expref: 66 pid: 10388 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263341.747128:0:10388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28414aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10388:1875129709781632:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788263341.747224:0:10388:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff283a5ef00 going to sleep for 11 seconds 00010000:00010000:3.0:1788263341.750977:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263341.757660:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263341.757767:0:10388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28414aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10388:1875129709781632:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788263341.757794:0:10388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670307 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263341.757864:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699241472 00000100:00100000:3.0:1788263341.757872:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699241472 00010000:00010000:3.0:1788263341.757906:0:9493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66702cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117012d expref: 67 pid: 10388 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263341.757944:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 97 00000100:00100000:3.0:1788263341.757965:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284148380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+67:2387:x1875129699241472:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263341.757979:0:9493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263341.757986:0:9493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66702cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117012d expref: 67 pid: 10388 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.757998:0:9493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66702cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117012d expref: 67 pid: 10388 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.758032:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66702cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117012d expref: 67 pid: 10388 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.758047:0:9493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:3.0:1788263341.758052:0:9493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670307 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.758061:0:9493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670307 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.758069:0:9493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670307 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.758096:0:9493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263341.758158:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284148380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+66:2387:x1875129699241472:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 205us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263341.758166:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 97 00010000:00010000:0.0:1788263341.758910:0:10388:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670307 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.758920:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670307 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263341.758937:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788263341.759074:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68600/0x4b1103cba6670300 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170142 expref: 67 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.759091:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670307 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170142 expref: 66 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.759110:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:0.0:1788263341.759123:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788263341.759127:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b68000, rc 0) 00000100:00100000:0.0:1788263341.759171:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+66:12429:x1875129699241344:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 12304us (12689us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788263341.759178:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 229 00000100:00100000:0.0:1788263341.772798:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263341.772889:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699241728 00000100:00100000:1.0:1788263341.772899:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699241728 00000100:00100000:2.0:1788263341.773057:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:2.0:1788263341.773071:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0456050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+66:12429:x1875129699241728:12345-192.168.203.26@tcp:103:lfs.0 00010000:00010000:2.0:1788263341.773087:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263341.773125:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69400/0x4b1103cba6670258 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170111 expref: 66 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.773145:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:2.0:1788263341.773151:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263341.773218:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0456050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+65:12429:x1875129699241728:12345-192.168.203.26@tcp:103:lfs.0 Request processed in 151us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263341.773225:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:0.0:1788263341.775537:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263341.775655:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699241856 00000100:00100000:2.0:1788263341.775664:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699241856 00000100:00100000:2.0:1788263341.775710:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 230 00000100:00100000:2.0:1788263341.775719:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28414b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+65:12429:x1875129699241856:12345-192.168.203.26@tcp:58:lfs.0 00010000:00010000:2.0:1788263341.775832:0:8884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba6670315 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.775848:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba6670315 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.775859:0:8884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba6670315 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788263341.775945:0:8884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788263341.776036:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28414b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+65:12429:x1875129699241856:12345-192.168.203.26@tcp:58:lfs.0 Request processed in 318us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263341.776043:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 230 00000100:00100000:3.0:1788263341.778854:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263341.778939:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699241984 00000100:00100000:2.0:1788263341.778948:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699241984 00000100:00100000:2.0:1788263341.779009:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 231 00000100:00100000:2.0:1788263341.779019:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+65:12429:x1875129699241984:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788263341.779036:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263341.779056:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba667031c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170149 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.779105:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba6670315 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.779126:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba667031c lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170149 expref: 66 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.779143:0:6493:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba6670315 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.779171:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba667031c lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170149 expref: 66 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.779185:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:2.0:1788263341.779189:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263341.779192:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba667031c lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170149 expref: 66 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.779199:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d0e00, rc 0) 00000100:00100000:2.0:1788263341.779266:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+66:12429:x1875129699241984:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 248us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263341.779273:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 231 00000040:00080000:2.0:1788263341.871786:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788263341.871795:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788263341.871823:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788263341.871831:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788263341.871974:0:13769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b71180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13769:1875129709781760:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788263341.872093:0:13769:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28410e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263341.876177:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263341.876267:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699242112 00000100:00100000:0.0:1788263341.876275:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699242112 00000100:00100000:0.0:1788263341.876340:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 232 00000100:00100000:0.0:1788263341.876351:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+67:12430:x1875129699242112:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788263341.876393:0:10388:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788263341.876503:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+67:12430:x1875129699242112:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 153us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263341.876512:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 232 00000100:00100000:2.0:1788263341.877768:0:13769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b71180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13769:1875129709781760:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788263341.887299:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263341.888414:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699242240 00000100:00100000:0.0:1788263341.888425:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699242240 00000100:00100000:0.0:1788263341.888488:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 233 00000100:00100000:0.0:1788263341.888499:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+66:12430:x1875129699242240:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788263341.888566:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69a00/0x4b1103cba6670323 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.888626:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69a00/0x4b1103cba6670323 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.888657:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69a00/0x4b1103cba6670323 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.888674:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667032a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.888682:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667032a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.888689:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667032a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.888712:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670331 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.888721:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670331 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.888728:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670331 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263341.889134:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788263341.889138:0:6491:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788263341.889152:0:6491:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670331 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.889163:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69a00/0x4b1103cba6670323 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.889170:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69a00/0x4b1103cba6670323 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.889187:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69a00/0x4b1103cba6670323 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.889192:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b69a00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263341.889196:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69a00/0x4b1103cba6670323 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.889213:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69a00/0x4b1103cba6670323 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.889225:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ff28314fa00) 00010000:00010000:0.0:1788263341.889228:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263341.889232:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69a00/0x4b1103cba6670323 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.889237:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69a00/0x4b1103cba6670323 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.889250:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667032a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.889255:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667032a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.889260:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667032a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.889265:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b69c00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263341.889268:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667032a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.889281:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667032a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.889289:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9ff28314fe00) 00010000:00010000:0.0:1788263341.889291:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263341.889294:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667032a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.889298:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667032a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.889311:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670331 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.889316:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670331 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.889321:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670331 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.889326:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b68400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263341.889328:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670331 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.889333:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670331 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.889339:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:0.0:1788263341.889342:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263341.889344:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670331 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.891472:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670331 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263341.891605:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+66:12430:x1875129699242240:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 Request processed in 3104us (4312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263341.891614:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 233 00000100:00100000:3.0:1788263341.906846:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263341.906966:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699242496 00000100:00100000:0.0:1788263341.906977:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699242496 00000100:00100000:0.0:1788263341.907035:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 234 00000100:00100000:0.0:1788263341.907044:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+66:12430:x1875129699242496:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788263341.907063:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263341.907081:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670338 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170150 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.907197:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667033f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.907213:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667033f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.907224:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667033f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263341.907234:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788263341.907310:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667033f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.907317:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667033f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.907338:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667033f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.907344:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b69c00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263341.907347:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667033f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.907354:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667033f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.907679:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:0.0:1788263341.907683:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788263341.907687:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667033f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.907694:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667033f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.907737:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670338 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170150 expref: 68 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.907747:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ff28314fa00) 00010000:00010000:0.0:1788263341.907749:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788263341.907752:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670338 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170150 expref: 68 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.907760:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b68400, rc 0) 00000100:00100000:0.0:1788263341.907823:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+67:12430:x1875129699242496:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 780us (985us total) trans 4294967505 rc 301/301 00000100:00100000:0.0:1788263341.907842:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 234 00000100:00100000:1.0:1788263341.915913:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263341.916015:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699242624 00000100:00100000:2.0:1788263341.916025:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699242624 00000100:00100000:2.0:1788263341.916081:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 235 00000100:00100000:2.0:1788263341.916091:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+67:12430:x1875129699242624:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788263341.916139:0:8884:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788263341.916256:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+67:12430:x1875129699242624:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 166us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263341.916276:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 235 00000100:00100000:3.0:1788263341.924910:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263341.925257:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699242880 00000100:00100000:0.0:1788263341.925267:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699242880 00000100:00100000:0.0:1788263341.925511:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 236 00000100:00100000:0.0:1788263341.925523:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+67:12430:x1875129699242880:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788263341.925542:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263341.925545:0:6491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788263341.925571:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68200/0x4b1103cba66702dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170134 expref: 67 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.925627:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:0.0:1788263341.925631:0:6491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788263341.925644:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667034d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170157 expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788263341.926006:0:6491:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:0.0:1788263341.926156:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69a00/0x4b1103cba6670354 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.926168:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69a00/0x4b1103cba6670354 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.926177:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69a00/0x4b1103cba6670354 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.926238:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69c00/0x4b1103cba667034d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170157 expref: 69 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.926273:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69a00/0x4b1103cba6670354 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170157 expref: 68 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.926280:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ff28314fe00) 00010000:00010000:0.0:1788263341.926283:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263341.926286:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b69a00, rc 0) 00000100:00100000:0.0:1788263341.926341:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+68:12430:x1875129699242880:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 820us (1441us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788263341.926348:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 236 00000100:00100000:1.0:1788263341.940277:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263341.940497:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699243136 00000100:00100000:0.0:1788263341.940506:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699243136 00000100:00100000:0.0:1788263341.940563:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 237 00000100:00100000:0.0:1788263341.940573:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+68:12430:x1875129699243136:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788263341.940667:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263341.940696:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69a00/0x4b1103cba6670354 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170157 expref: 68 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.940716:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ff28314fe00) 00010000:00010000:0.0:1788263341.940726:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788263341.940746:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68e00/0x4b1103cba6670362 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.940760:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68e00/0x4b1103cba6670362 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.940770:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68e00/0x4b1103cba6670362 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.940827:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba6670369 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x98adbf52 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.940835:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba6670369 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x98adbf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.940842:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba6670369 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x98adbf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.940882:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68e00/0x4b1103cba6670362 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.940890:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68e00/0x4b1103cba6670362 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.940896:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68e00/0x4b1103cba6670362 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.940902:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b68e00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263341.940906:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68e00/0x4b1103cba6670362 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.940913:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68e00/0x4b1103cba6670362 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.940921:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:0.0:1788263341.940924:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263341.940928:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68e00/0x4b1103cba6670362 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.940934:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68e00/0x4b1103cba6670362 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.940965:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba6670369 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x98adbf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.940972:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba6670369 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x98adbf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.940979:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba6670369 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x98adbf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.940989:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b68800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263341.940992:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba6670369 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x98adbf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.940999:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba6670369 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x98adbf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.941007:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x98adbf52 (ffff9ff28314f800) 00010000:00010000:0.0:1788263341.941010:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263341.941013:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba6670369 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x98adbf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.941019:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba6670369 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x98adbf52 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263341.941088:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+67:12430:x1875129699243136:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 516us (820us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788263341.941096:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 237 00000100:00100000:1.0:1788263341.945067:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263341.945219:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699243264 00000100:00100000:3.0:1788263341.945230:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699243264 00000100:00100000:3.0:1788263341.945287:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 238 00000100:00100000:3.0:1788263341.945298:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38541ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+67:12430:x1875129699243264:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788263341.945316:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263341.945352:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670370 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d117015e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.945402:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba6670377 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.945415:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba6670377 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.945426:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba6670377 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.945527:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670370 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117015e expref: 69 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.945547:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba6670377 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117015e expref: 68 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.945556:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ff282126900) 00010000:00010000:3.0:1788263341.945559:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788263341.945563:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae764400, rc 0) 00000100:00100000:3.0:1788263341.946037:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38541ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+68:12430:x1875129699243264:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 737us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263341.946046:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 238 00000100:00100000:3.0:1788263341.951125:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263341.951465:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699243520 00000100:00100000:0.0:1788263341.951476:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699243520 00000100:00100000:0.0:1788263341.951536:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 239 00000100:00100000:0.0:1788263341.951558:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+68:12430:x1875129699243520:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788263341.951668:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba667037e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.951685:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba667037e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.951696:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba667037e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788263341.951856:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1788263341.951867:0:6491:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 351023286975ns, next at 352023284197ns, rc = 0 00000004:00010000:0.0:1788263341.951917:0:6491:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b740182d reply state 00000000ef4e36ed transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba667037e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.951929:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba667037e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.951937:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ff282126900) 00010000:00010000:0.0:1788263341.951939:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788263341.951943:0:6491:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788263341.952034:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+70:12430:x1875129699243520:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 476us (933us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788263341.952042:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 239 00000100:00100000:1.0:1788263341.955302:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263341.955397:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699243648 00000100:00100000:2.0:1788263341.955406:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699243648 00000100:00100000:2.0:1788263341.955460:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 240 00000100:00100000:2.0:1788263341.955470:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+70:12430:x1875129699243648:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788263341.955494:0:8884:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263341.955515:0:8884:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba6670385 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170165 expref: -99 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.955571:0:8884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba6670385 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170165 expref: 71 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.955630:0:8884:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba6670385 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170165 expref: 71 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.955649:0:8884:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ff282126900) 00010000:00010000:2.0:1788263341.955652:0:8884:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788263341.955656:0:8884:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d0800, rc 0) 00000100:00100000:2.0:1788263341.955710:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+71:12430:x1875129699243648:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 240us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263341.955716:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 240 00000100:00100000:1.0:1788263341.958742:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263341.958924:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699243776 00000100:00100000:0.0:1788263341.958932:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699243776 00000100:00100000:0.0:1788263341.959006:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 70 00000100:00100000:0.0:1788263341.959015:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38541a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:2386:x1875129699243776:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788263341.959225:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38541a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+10:2386:x1875129699243776:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 211us (491us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1788263341.959243:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 70 00000100:00080000:3.0:1788263341.960262:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788263341.962145:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263341.962296:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699244032 00000100:00100000:2.0:1788263341.962305:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699244032 00000100:00100000:2.0:1788263341.962369:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:2.0:1788263341.962380:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+71:12430:x1875129699244032:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788263341.962768:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+72:12430:x1875129699244032:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 389us (629us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1788263341.962789:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:1.0:1788263341.965893:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263341.965989:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699244288 00000100:00100000:2.0:1788263341.965998:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699244288 00000100:00100000:2.0:1788263341.966050:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 241 00000100:00100000:2.0:1788263341.966060:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+72:12430:x1875129699244288:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788263341.966212:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+72:12430:x1875129699244288:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 146us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263341.966219:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 241 00000100:00100000:1.0:1788263341.969542:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263341.969752:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699244416 00000100:00100000:3.0:1788263341.969763:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699244416 00000100:00100000:3.0:1788263341.969818:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 242 00000100:00100000:3.0:1788263341.969829:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+72:12430:x1875129699244416:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788263341.969860:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263341.969879:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba667038c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d117016c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.969947:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670393 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.970026:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670393 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.970038:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670393 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263341.970081:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788263341.970098:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670393 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.970267:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba667038c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117016c expref: 74 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.970284:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670393 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117016c expref: 73 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263341.970293:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ff282126900) 00010000:00010000:3.0:1788263341.970295:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788263341.970299:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae765c00, rc 0) 00000100:00100000:3.0:1788263341.971511:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+73:12430:x1875129699244416:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 532us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263341.971524:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 242 00000100:00100000:3.0:1788263341.974247:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263341.974537:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699244544 00000100:00100000:1.0:1788263341.974545:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699244544 00000100:00100000:1.0:1788263341.974619:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 71 00000100:00100000:1.0:1788263341.974629:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+10:2387:x1875129699244544:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788263341.974644:0:14442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263341.974665:0:14442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2f1bf78/0x4b1103cba667039a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170173 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788263341.974690:0:14442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96bbad, blocks: 0x0 00010000:00010000:1.0:1788263341.974706:0:14442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=351s v=(0 0) 00010000:00010000:1.0:1788263341.974710:0:14442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263341.974731:0:14442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2f1bf78/0x4b1103cba667039a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170173 expref: 11 pid: 14442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.974750:0:14442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f2f1bf78/0x4b1103cba667039a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170173 expref: 11 pid: 14442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.974763:0:14442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381681a00, rc 0) 00000100:00100000:1.0:1788263341.974813:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+11:2387:x1875129699244544:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 186us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263341.974820:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 71 00000100:00100000:1.0:1788263341.978099:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263341.978247:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699244800 00000100:00100000:3.0:1788263341.978257:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699244800 00000100:00100000:3.0:1788263341.978309:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 243 00000100:00100000:3.0:1788263341.978318:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38541a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+73:12430:x1875129699244800:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788263341.978425:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38541a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+73:12430:x1875129699244800:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 108us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263341.978433:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 243 00000100:00100000:3.0:1788263341.982071:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263341.982338:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699244928 00000100:00100000:0.0:1788263341.982347:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699244928 00000100:00100000:0.0:1788263341.982412:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 72 00000100:00100000:0.0:1788263341.982422:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+11:12430:x1875129699244928:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788263341.982438:0:9885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263341.982454:0:9885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010849d8a/0x4b1103cba66703a1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d117017a expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.982484:0:9885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2f1bf78/0x4b1103cba667039a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170173 expref: 12 pid: 14442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.982493:0:9885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263341.982498:0:9885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263341.982503:0:9885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010849d8a/0x4b1103cba66703a1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117017a expref: 12 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.982536:0:9885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f2f1bf78/0x4b1103cba667039a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170173 expref: 12 pid: 14442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263341.982549:0:9885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f2f1bf78/0x4b1103cba667039a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170173 expref: 12 pid: 14442 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263341.982563:0:9885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff284148a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9885:1875129709781888:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788263341.982704:0:9885:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff283a5ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788263341.985718:0:9885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff284148a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9885:1875129709781888:192.168.203.26@tcp:104: 00010000:00010000:1.0:1788263341.985753:0:9885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000010849d8a/0x4b1103cba66703a1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d117017a expref: 12 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263341.985774:0:9885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b69c00, rc 0) 00000100:00100000:1.0:1788263341.985832:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+12:12430:x1875129699244928:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 3410us (3769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263341.985841:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 72 00000100:00100000:3.0:1788263341.987787:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263341.987879:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699245056 00000100:00100000:2.0:1788263341.987888:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699245056 00010000:00010000:2.0:1788263341.987924:0:9493:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f2f1bf78/0x4b1103cba667039a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170173 expref: 12 pid: 14442 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263341.987967:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 98 00000100:00100000:2.0:1788263341.987977:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+12:2387:x1875129699245056:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263341.987991:0:9493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263341.988010:0:9493:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f2f1bf78/0x4b1103cba667039a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170173 expref: 12 pid: 14442 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.988024:0:9493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f2f1bf78/0x4b1103cba667039a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170173 expref: 12 pid: 14442 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.988047:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2f1bf78/0x4b1103cba667039a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170173 expref: 12 pid: 14442 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.988081:0:9493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263341.988084:0:9493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263341.988092:0:9493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000010849d8a/0x4b1103cba66703a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d117017a expref: 11 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.988102:0:9493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010849d8a/0x4b1103cba66703a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d117017a expref: 11 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263341.988153:0:9493:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000010849d8a/0x4b1103cba66703a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d117017a expref: 11 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263341.988165:0:9493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b71180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9493:1875129709782016:192.168.203.26@tcp:105: 00000100:00100000:2.0:1788263341.988237:0:9493:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28410e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788263341.994340:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263341.994692:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699245184 00000100:00100000:0.0:1788263341.994703:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699245184 00002000:00100000:0.0:1788263341.994766:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9ff3bf6d4e00 x1875129699245184/t0(0) o4->ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp:552/0 lens 504/0 e 0 to 0 dl 1788263352 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788263341.994777:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ff3bf6d4e00 with x1875129699245184 ext(0->12) 00002000:00010000:0.0:1788263341.994783:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ff3bf6d4e00 00000100:00100000:0.0:1788263341.994814:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:0.0:1788263341.995038:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+12:2387:x1875129699245184:12345-192.168.203.26@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788263341.996122:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+14:2387:x1875129699245184:12345-192.168.203.26@tcp:4:lhsmtool_posix.0 Request processed in 1278us (1770us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788263341.996132:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 6 00002000:00100000:0.0:1788263341.996140:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9ff3bf6d4e00 x1875129699245184/t4294967321(0) o4->ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp:552/0 lens 504/448 e 0 to 0 dl 1788263352 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788263341.996150:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ff3bf6d4e00 with x1875129699245184 ext(0->12) 00002000:00010000:0.0:1788263341.996156:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ff3bf6d4e00 00000100:00100000:2.0:1788263341.997171:0:9493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b71180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9493:1875129709782016:192.168.203.26@tcp:105: 00010000:00010000:2.0:1788263341.997196:0:9493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263341.997256:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+13:2387:x1875129699245056:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 9279us (9474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263341.997266:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 98 00000100:00100000:3.0:1788263342.002252:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263342.002517:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699245312 00000100:00100000:0.0:1788263342.002527:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699245312 00000100:00100000:0.0:1788263342.002636:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 244 00000100:00100000:0.0:1788263342.002648:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+73:12430:x1875129699245312:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 00000100:00080000:3.0:1788263342.003351:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1788263342.007906:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1788263342.007925:0:6470:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:1.0:1788263342.007972:0:6470:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1788263342.008000:0:6470:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ff28410e780 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788263342.008005:0:6470:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ff2833f6100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ff28410ecc0 00000020:00080000:1.0:1788263342.008008:0:6470:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ff2833f6a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ff3918fe600 00000004:00080000:1.0:1788263342.008046:0:6470:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1788263342.008067:0:6470:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ff282244480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788263342.008069:0:6470:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ff3bd1aa000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ff282244000 00000020:00080000:1.0:1788263342.008072:0:6470:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ff3bd1aaa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ff2833fe600 00010000:00010000:2.0:1788263342.008309:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba66700a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008322:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba66700a6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008330:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba66700a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008344:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150e600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263342.008350:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba66700a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008357:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba66700a6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008375:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9ff282126e00) 00010000:00010000:2.0:1788263342.008378:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263342.008383:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba66700a6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008389:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e600/0x4b1103cba66700a6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008419:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba667014e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008426:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba667014e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008432:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba667014e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008437:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381680200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263342.008440:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba667014e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008447:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba667014e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008466:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9ff28227a000) 00010000:00010000:2.0:1788263342.008469:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263342.008473:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba667014e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008479:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba667014e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008497:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba66701cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008503:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba66701cc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008509:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba66701cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008514:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0a00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263342.008516:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba66701cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008523:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba66701cc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008531:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ff28227a100) 00010000:00010000:2.0:1788263342.008533:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263342.008536:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba66701cc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008542:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0a00/0x4b1103cba66701cc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008619:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba66701ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008627:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba66701ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008633:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba66701ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008638:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150fa00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263342.008641:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba66701ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008648:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba66701ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008656:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ff28227a100) 00010000:00010000:2.0:1788263342.008658:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263342.008661:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba66701ef lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008666:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150fa00/0x4b1103cba66701ef lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008683:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66702c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008690:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66702c1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008696:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66702c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263342.008707:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff284148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709782144:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788263342.008708:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150ee00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263342.008714:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66702c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008721:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66702c1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008730:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:2.0:1788263342.008743:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263342.008747:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66702c1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008753:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66702c1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008765:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba667037e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008772:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba667037e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008777:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba667037e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008782:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b68800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263342.008785:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba667037e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008791:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba667037e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008808:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ff282126900) 00010000:00010000:2.0:1788263342.008810:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788263342.008813:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba667037e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.008819:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68800/0x4b1103cba667037e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788263342.008836:0:6523:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1788263342.008891:0:6523:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788263342.009298:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709782400:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788263342.009488:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+21:12430:x1875129699245312:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 Request processed in 6840us (7242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263342.009498:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 244 00000100:00100000:3.0:1788263342.009708:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263342.009752:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788263342.009758:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709782272:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788263342.009779:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263342.009805:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709782400 00000100:00100000:3.0:1788263342.009811:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709782400 00000100:00100000:3.0:1788263342.009850:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709782272 00000100:00100000:3.0:1788263342.009853:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709782272 00000100:00100000:3.0:1788263342.009869:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788263342.009877:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3619:x1875129709782400:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788263342.009999:0:14442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788263342.010003:0:14442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788263341 00002000:00010000:3.0:1788263342.010005:0:14442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788263342.010017:0:14442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788263341 -> 1788263341 00002000:00010000:3.0:1788263342.010019:0:14442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788263342.010053:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3619:x1875129709782400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 177us (346us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788263342.010059:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788263342.010072:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788263342.010078:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3619:x1875129709782272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788263342.010091:0:14442:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:3.0:1788263342.010106:0:14442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7428ee1/0x4b1103cba66703a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.010347:0:14442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000031fe45e8/0x4b1103cba667015c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700d2 expref: 12 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.010358:0:14442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788263342.010362:0:14442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788263342.010367:0:14442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7428ee1/0x4b1103cba66703a8 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.010394:0:14442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000031fe45e8/0x4b1103cba667015c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700d2 expref: 12 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.010407:0:14442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000031fe45e8/0x4b1103cba667015c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700d2 expref: 12 pid: 8404 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263342.010419:0:14442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14442:1875129709782528:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788263342.010471:0:14442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff282244cc0 going to sleep for 11 seconds 00000100:00080000:3.0:1788263342.010489:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788263342.010516:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ff3bf6d7800/2, rc 0, transno 4294967322 00000100:00100000:3.0:1788263342.010523:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709782400:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788263342.013310:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263342.013396:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699245440 00000100:00100000:1.0:1788263342.013405:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699245440 00000100:00100000:1.0:1788263342.013456:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 75 00000100:00100000:1.0:1788263342.013467:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+13:2386:x1875129699245440:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788263342.018747:0:14442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14442:1875129709782528:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263342.018778:0:14442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a7428ee1/0x4b1103cba66703a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263342.018821:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263342.018847:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699245568 00000100:00100000:3.0:1788263342.018854:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699245568 00010000:00010000:3.0:1788263342.018885:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000031fe45e8/0x4b1103cba667015c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700d2 expref: 14 pid: 8404 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263342.018920:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 99 00000100:00100000:0.0:1788263342.018922:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263342.018932:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+14:2386:x1875129699245568:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263342.018959:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263342.018966:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000031fe45e8/0x4b1103cba667015c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700d2 expref: 14 pid: 8404 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263342.018980:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709782144 00010000:00010000:3.0:1788263342.018981:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000031fe45e8/0x4b1103cba667015c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700d2 expref: 14 pid: 8404 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263342.018987:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709782144 00010000:00010000:3.0:1788263342.019006:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031fe45e8/0x4b1103cba667015c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.26@tcp remote: 0xd405f293d11700d2 expref: 14 pid: 8404 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.019030:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788263342.019035:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00000100:00100000:0.0:1788263342.019037:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00010000:00010000:3.0:1788263342.019043:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7428ee1/0x4b1103cba66703a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263342.019049:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28414aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3621:x1875129709782144:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788263342.019058:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7428ee1/0x4b1103cba66703a8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788263342.019076:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:3.0:1788263342.019083:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263342.019142:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+13:2386:x1875129699245568:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 213us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263342.019150:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 99 00010000:00010000:3.0:1788263342.019170:0:14442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a7428ee1/0x4b1103cba66703a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.019178:0:14442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7428ee1/0x4b1103cba66703a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.019186:0:14442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7428ee1/0x4b1103cba66703a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.019193:0:14442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7428ee1/0x4b1103cba66703a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.019208:0:14442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788263342.020869:0:8406:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a96bbac, atime: 0x6a96bbac, ctime: 0x6a96bbac, blocks: 0x8 00010000:00010000:0.0:1788263342.020884:0:8406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059a0b3fa/0x4b1103cba66703af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.020902:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=351s v=(0 0) 00010000:00010000:0.0:1788263342.020906:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263342.020912:0:8406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059a0b3fa/0x4b1103cba66703af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.020927:0:8406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059a0b3fa/0x4b1103cba66703af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.020936:0:8406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059a0b3fa/0x4b1103cba66703af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.020944:0:8406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059a0b3fa/0x4b1103cba66703af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.020963:0:8406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788263342.021874:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28414aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3621:x1875129709782144:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2823us (2950us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788263342.021887:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:0.0:1788263342.021929:0:9492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788263342.021937:0:9492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7428ee1/0x4b1103cba66703a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.021954:0:9492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150e400 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263342.021958:0:9492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7428ee1/0x4b1103cba66703a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.021966:0:9492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7428ee1/0x4b1103cba66703a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.021983:0:9492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7428ee1/0x4b1103cba66703a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.021989:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7428ee1/0x4b1103cba66703a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.022011:0:9492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263342.022015:0:9492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059a0b3fa/0x4b1103cba66703af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.022022:0:9492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b68200 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263342.022026:0:9492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059a0b3fa/0x4b1103cba66703af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.022032:0:9492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059a0b3fa/0x4b1103cba66703af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.022043:0:9492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059a0b3fa/0x4b1103cba66703af lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.022055:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059a0b3fa/0x4b1103cba66703af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.022068:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263342.022069:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263342.022071:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263342.023275:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788263342.024657:0:3621:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ff284148380/2, rc 0, transno 4294967311 00000100:00100000:0.0:1788263342.024670:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff284148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709782144:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788263342.028236:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3619:x1875129709782272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18149us (18446us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788263342.028252:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:0.0:1788263342.028275:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ff3bf6d6680/2, rc 0, transno 4294967323 00000100:00100000:0.0:1788263342.028285:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709782272:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1788263342.036840:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1788263342.036853:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:1.0:1788263342.037052:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2386:x1875129699245440:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 Request processed in 23581us (23745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263342.037064:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 75 00000100:00100000:2.0:1788263342.051232:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263342.052363:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699245824 00000100:00100000:3.0:1788263342.052373:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699245824 00000100:00100000:3.0:1788263342.052470:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 245 00000100:00100000:3.0:1788263342.052478:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+21:12430:x1875129699245824:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788263342.052525:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263342.052551:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670393 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117016c expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.052565:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ff282126900) 00010000:00010000:3.0:1788263342.052568:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263342.052623:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba66703b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.052632:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba66703b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.052638:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba66703b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788263342.052736:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da977e9a reply state 0000000085d09db6 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba66703b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.052744:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba66703b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.052748:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ff282126900) 00010000:00010000:3.0:1788263342.052750:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788263342.052763:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788263342.052850:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:12430:x1875129699245824:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 372us (1626us total) trans 4294967509 rc 0/0 00000100:00100000:3.0:1788263342.052857:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 245 00000100:00100000:3.0:1788263342.056999:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263342.057267:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699245952 00000100:00100000:2.0:1788263342.057278:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699245952 00000100:00100000:2.0:1788263342.057342:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 77 00000100:00100000:2.0:1788263342.057353:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2386:x1875129699245952:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788263342.057514:0:8405:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788263342.057519:0:8405:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788263341 -> 1788263340 00002000:00010000:2.0:1788263342.057522:0:8405:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788263340 00002000:00010000:2.0:1788263342.057525:0:8405:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788263341 -> 1788263340 00002000:00010000:2.0:1788263342.057527:0:8405:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788263342.057612:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2386:x1875129699245952:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 260us (630us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788263342.057621:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 77 00000100:00100000:1.0:1788263342.063389:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263342.063708:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699246208 00000100:00100000:2.0:1788263342.063720:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699246208 00000100:00100000:2.0:1788263342.063894:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 246 00000100:00100000:2.0:1788263342.063906:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38541bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:12430:x1875129699246208:12345-192.168.203.26@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788263342.064041:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba66703bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.064062:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba6670377 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117015e expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.064072:0:10388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba66703bd lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.064119:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba6670377 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117015e expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.064135:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba6670377 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117015e expref: 22 pid: 6493 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263342.064150:0:10388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b71f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10388:1875129709782656:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788263342.064242:0:10388:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28410ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788263342.071628:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263342.071679:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699246336 00000100:00100000:0.0:1788263342.071689:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699246336 00000100:00100000:2.0:1788263342.071725:0:10388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b71f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10388:1875129709782656:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788263342.071732:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba6670377 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117015e expref: 23 pid: 6493 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263342.071781:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 100 00000100:00100000:0.0:1788263342.071792:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385419180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+23:2386:x1875129699246336:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263342.071807:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263342.071815:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba6670377 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117015e expref: 23 pid: 6493 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.071829:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba6670377 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117015e expref: 23 pid: 6493 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.071866:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba6670377 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d117015e expref: 23 pid: 6493 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.071871:0:10388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba66703bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.071887:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ff282126900) 00010000:00010000:0.0:1788263342.071893:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba66703bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.071904:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba66703bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.071913:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba66703bd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.071931:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263342.072071:0:10388:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba66703bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.072079:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba66703bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.072124:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba66703bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.072132:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba66703bd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.072139:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba66703bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.072145:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0000 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263342.072150:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba66703bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.072157:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba66703bd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.072167:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ff282126900) 00010000:00010000:3.0:1788263342.072169:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788263342.072183:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba66703bd lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.072200:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0000/0x4b1103cba66703bd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263342.072259:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385419180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:2386:x1875129699246336:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 468us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263342.072275:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 100 00000100:00100000:3.0:1788263342.073400:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38541bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+21:12430:x1875129699246208:12345-192.168.203.26@tcp:55:lhsmtool_posix.0 Request processed in 9492us (10016us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788263342.073411:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 246 00000100:00100000:3.0:1788263342.076190:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263342.076251:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699246464 00000100:00100000:0.0:1788263342.076261:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699246464 00000100:00100000:0.0:1788263342.076316:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 78 00000100:00100000:0.0:1788263342.076326:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2387:x1875129699246464:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788263342.076364:0:8404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000059a0b3fa/0x4b1103cba66703c4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.076383:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000010849d8a/0x4b1103cba66703a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d117017a expref: 8 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.076408:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263342.076412:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788263342.076417:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059a0b3fa/0x4b1103cba66703c4 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.076451:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000010849d8a/0x4b1103cba66703a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.26@tcp remote: 0xd405f293d117017a expref: 8 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.076466:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000010849d8a/0x4b1103cba66703a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d117017a expref: 8 pid: 9885 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263342.076481:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff284149500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1875129709782784:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788263342.076564:0:8404:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff283a5ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263342.080755:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff284149500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8404:1875129709782784:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788263342.080785:0:8404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000059a0b3fa/0x4b1103cba66703c4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263342.081613:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263342.081891:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699246592 00000100:00100000:2.0:1788263342.081899:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699246592 00010000:00010000:2.0:1788263342.081932:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000010849d8a/0x4b1103cba66703a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d117017a expref: 9 pid: 9885 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263342.082027:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 101 00000100:00100000:2.0:1788263342.082037:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5634a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:2387:x1875129699246592:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263342.082050:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263342.082071:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000010849d8a/0x4b1103cba66703a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d117017a expref: 9 pid: 9885 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.082084:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000010849d8a/0x4b1103cba66703a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d117017a expref: 9 pid: 9885 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.082105:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010849d8a/0x4b1103cba66703a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d117017a expref: 9 pid: 9885 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.082132:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788263342.082136:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788263342.082141:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000059a0b3fa/0x4b1103cba66703c4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.082150:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059a0b3fa/0x4b1103cba66703c4 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.082190:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263342.082245:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5634a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2387:x1875129699246592:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 210us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263342.082252:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 101 00010000:00010000:1.0:1788263342.082674:0:8404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000059a0b3fa/0x4b1103cba66703c4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.082684:0:8404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059a0b3fa/0x4b1103cba66703c4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.082703:0:8404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000059a0b3fa/0x4b1103cba66703c4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.082711:0:8404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059a0b3fa/0x4b1103cba66703c4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.082719:0:8404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059a0b3fa/0x4b1103cba66703c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.082733:0:8404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b68200 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:1.0:1788263342.082738:0:8404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059a0b3fa/0x4b1103cba66703c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.082746:0:8404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059a0b3fa/0x4b1103cba66703c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.082759:0:8404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059a0b3fa/0x4b1103cba66703c4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.082766:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059a0b3fa/0x4b1103cba66703c4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263342.082816:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2387:x1875129699246464:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 Request processed in 6491us (6633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263342.082824:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 78 00000100:00100000:3.0:1788263342.087758:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263342.087856:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699246848 00000100:00100000:1.0:1788263342.087864:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699246848 00000100:00100000:1.0:1788263342.087911:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 247 00000100:00100000:1.0:1788263342.087921:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+21:12430:x1875129699246848:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788263342.088004:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba66703cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.088021:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba66702ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170126 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.088048:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba66703cb lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.088082:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba66702ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170126 expref: 21 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.088096:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba66702ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170126 expref: 21 pid: 6491 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263342.088120:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff38541aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6491:1875129709782912:192.168.203.26@tcp:104: 00000100:00100000:1.0:1788263342.088195:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff283128cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263342.092524:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff38541aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6491:1875129709782912:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263342.092551:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba66703cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263342.094915:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263342.095629:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699246976 00000100:00100000:2.0:1788263342.095639:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699246976 00010000:00010000:2.0:1788263342.095675:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba66702ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170126 expref: 22 pid: 6491 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263342.095706:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 102 00000100:00100000:2.0:1788263342.095715:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:2387:x1875129699246976:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263342.095728:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263342.095734:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba66702ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170126 expref: 22 pid: 6491 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.095747:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba66702ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170126 expref: 22 pid: 6491 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.095767:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69000/0x4b1103cba66702ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170126 expref: 22 pid: 6491 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.095782:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:2.0:1788263342.095787:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba667031c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170149 expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.095796:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba66703cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.095802:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba66703cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.095809:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba66703cb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.095847:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263342.095898:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+21:2387:x1875129699246976:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 183us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263342.095905:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 102 00010000:00010000:3.0:1788263342.097004:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba66703cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.097017:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba66703cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.097765:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66703d2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.097784:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba6670385 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170165 expref: 21 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.097793:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66703d2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.097847:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba6670385 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170165 expref: 21 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.097860:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba6670385 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170165 expref: 21 pid: 8884 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263342.097874:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5635880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6491:1875129709783040:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788263342.098988:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2822440c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263342.102888:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263342.103290:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699247104 00000100:00100000:0.0:1788263342.103298:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699247104 00010000:00010000:0.0:1788263342.103334:0:6476:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba6670385 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170165 expref: 22 pid: 8884 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263342.103380:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 103 00000100:00100000:0.0:1788263342.103389:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5635500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:2386:x1875129699247104:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263342.103415:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263342.103422:0:6476:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba6670385 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170165 expref: 22 pid: 8884 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.103434:0:6476:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba6670385 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170165 expref: 22 pid: 8884 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.103454:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ff282126900) 00010000:00010000:0.0:1788263342.103459:0:6476:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66703d2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.103468:0:6476:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66703d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.103475:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66703d2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.103491:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263342.103535:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5635500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:2386:x1875129699247104:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 147us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263342.103541:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 103 00010000:00010000:1.0:1788263342.105727:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0800/0x4b1103cba6670385 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170165 expref: 21 pid: 8884 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263342.105748:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5635880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6491:1875129709783040:192.168.203.26@tcp:104: 00010000:00010000:1.0:1788263342.105773:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66703d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.105782:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66703d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.105787:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66703d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788263342.105892:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1788263342.106200:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1788263342.106238:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1788263342.106329:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385418e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6491:1875129709783168:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788263342.106383:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263342.106490:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff283128480 going to sleep for 11 seconds 00000100:00100000:0.0:1788263342.107192:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709783168 00000100:00100000:0.0:1788263342.107199:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709783168 00000100:00100000:0.0:1788263342.107280:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788263342.107290:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38541aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6491:x1875129709783168:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788263342.107376:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38541aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6491:x1875129709783168:12345-0@lo:1000:mdt00_000.0 Request processed in 88us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263342.107384:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788263342.107458:0:6491:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1788263342.107464:0:6491:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:3.0:1788263342.107479:0:6491:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ff3bf6d7800, transno 4294967322 00000100:00100000:3.0:1788263342.107531:0:6491:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9ff3bf6d6680 x1875129709782272/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788263358 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263342.107543:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385418e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6491:1875129709783168:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788263342.107678:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1788263342.107728:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5637800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6491:1875129709783296:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788263342.107762:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263342.107787:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff282244f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788263342.107886:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709783296 00000100:00100000:1.0:1788263342.107891:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709783296 00000100:00100000:1.0:1788263342.107925:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788263342.107932:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6491:x1875129709783296:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788263342.108048:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6491:x1875129709783296:12345-0@lo:1000:mdt00_000.0 Request processed in 116us (286us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788263342.108055:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788263342.108391:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5637800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6491:1875129709783296:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788263342.108425:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66703d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.108433:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66703d2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.108453:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66703d2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.108458:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150f000 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263342.108462:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66703d2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.108468:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66703d2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.108482:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ff282126900) 00010000:00010000:3.0:1788263342.108485:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788263342.108488:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66703d2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.108494:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66703d2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.108515:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba6670315 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.108520:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba6670315 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.108525:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba6670315 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.108529:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263342.108531:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba6670315 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.108545:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba6670315 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.108553:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:3.0:1788263342.108555:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788263342.108561:0:6491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba667031c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170149 expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.108571:0:6491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba667031c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170149 expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.108610:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba667031c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170149 expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.108638:0:6491:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba667031c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170149 expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263342.108649:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5635c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6491:1875129709783424:192.168.203.26@tcp:105: 00000100:00100000:3.0:1788263342.108707:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff282244f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788263342.114407:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5635c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6491:1875129709783424:192.168.203.26@tcp:105: 00010000:00010000:1.0:1788263342.114435:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba6670315 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.114446:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba6670315 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8884 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.114477:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba66703d9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263342.114478:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00010000:00010000:1.0:1788263342.114490:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba66703d9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.114501:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba66703d9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.114511:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba66703d9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.114517:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba66703d9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.114538:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba66703d9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.114543:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381681a00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263342.114547:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba66703d9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.114554:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba66703d9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.114565:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:1.0:1788263342.114567:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788263342.114568:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699247232 00010000:00010000:1.0:1788263342.114571:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba66703d9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.114576:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba66703d9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263342.114607:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699247232 00010000:00010000:1.0:1788263342.114733:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba66703cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.114740:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba66703cb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.114745:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba66703cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.114750:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381680c00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263342.114753:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba66703cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.114769:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba66703cb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.114778:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:1.0:1788263342.114781:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788263342.114784:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba66703cb lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263342.114789:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba66703cb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263342.114933:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+25:12430:x1875129699246848:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 27013us (27183us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1788263342.114943:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 247 00000100:00100000:0.0:1788263342.115067:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:0.0:1788263342.115077:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+25:12429:x1875129699247232:12345-192.168.203.26@tcp:49:lfs.0 00000100:00100000:0.0:1788263342.115184:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+25:12429:x1875129699247232:12345-192.168.203.26@tcp:49:lfs.0 Request processed in 101us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263342.115192:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 61 00000040:00080000:0.0:1788263342.115280:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788263342.115284:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788263342.115782:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788263342.115791:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:00080000:1.0:1788263342.117300:0:6491:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788263342.120013:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263342.120121:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699247488 00000100:00100000:2.0:1788263342.120130:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699247488 00000100:00100000:2.0:1788263342.120198:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 62 00000100:00100000:2.0:1788263342.120209:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a9738850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+24:12430:x1875129699247488:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788263342.120497:0:6494:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788263342.120530:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1788263342.120563:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba66703e0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.120609:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba66703e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263342.121839:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263342.122058:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699247744 00000100:00100000:0.0:1788263342.122066:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699247744 00000100:00100000:0.0:1788263342.122119:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 248 00000100:00100000:0.0:1788263342.122128:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+27:12429:x1875129699247744:12345-192.168.203.26@tcp:58:lfs.0 00000040:00080000:0.0:1788263342.122274:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788263342.122345:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+27:12429:x1875129699247744:12345-192.168.203.26@tcp:58:lfs.0 Request processed in 218us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263342.122353:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 248 00010000:00010000:2.0:1788263342.122400:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba66703e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.122413:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba66703e0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.122419:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba66703e0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.122425:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba66703e0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263342.122469:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788263342.122522:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a9738850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+26:12430:x1875129699247488:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 2316us (2518us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788263342.122533:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 62 00000020:00080000:2.0:1788263342.122537:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788263342.123290:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263342.123297:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba66703e0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.123305:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1a00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263342.123310:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba66703e0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.123319:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba66703e0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.123345:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ff282126900) 00010000:00010000:0.0:1788263342.123347:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788263342.123352:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba66703e0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.123358:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba66703e0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.123371:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263342.123372:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263342.123374:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263342.160454:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263342.160576:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699247872 00000100:00100000:3.0:1788263342.160618:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699247872 00000100:00100000:3.0:1788263342.160675:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 249 00000100:00100000:3.0:1788263342.160685:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff38541b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+26:12432:x1875129699247872:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788263342.160707:0:10388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263342.160737:0:10388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba66703e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170181 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.160798:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66703ee lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.160812:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66703ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.160822:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66703ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.160836:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66703f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.160844:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66703f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.160850:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66703f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.160915:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66703fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.160926:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670307 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170142 expref: 27 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.160934:0:10388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66703fc lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.161175:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670307 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170142 expref: 27 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.161201:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670307 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170142 expref: 27 pid: 10388 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263342.161215:0:10388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5634e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10388:1875129709783552:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788263342.161312:0:10388:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2822443c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263342.166208:0:10388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5634e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10388:1875129709783552:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788263342.166236:0:10388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66703fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263342.168848:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263342.168934:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699248128 00000100:00100000:0.0:1788263342.168944:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699248128 00000100:00100000:0.0:1788263342.169004:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 63 00000100:00100000:0.0:1788263342.169015:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+28:6156:x1875129699248128:12345-192.168.203.26@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788263342.169256:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:6156:x1875129699248128:12345-192.168.203.26@tcp:35:ldlm_bl.0 Request processed in 242us (416us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788263342.169468:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 63 00000100:00100000:3.0:1788263342.173787:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263342.174101:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699248256 00000100:00100000:0.0:1788263342.174124:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699248256 00010000:00010000:0.0:1788263342.174164:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670307 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170142 expref: 29 pid: 10388 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263342.174215:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 104 00000100:00100000:0.0:1788263342.174239:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0455c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:2387:x1875129699248256:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263342.174253:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263342.174260:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670307 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170142 expref: 29 pid: 10388 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.174273:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670307 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170142 expref: 29 pid: 10388 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.174295:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670307 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170142 expref: 29 pid: 10388 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.174310:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:0.0:1788263342.174314:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66703fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.174507:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66703fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.174516:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66703fc lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263342.174653:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263342.174704:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0455c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+28:2387:x1875129699248256:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 466us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263342.174712:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 104 00010000:00010000:3.0:1788263342.175141:0:10388:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66703fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.175150:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66703fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263342.175199:0:10388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788263342.175437:0:10388:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788263342.175462:0:10388:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66703fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.175475:0:10388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66703fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.175484:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66703ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.175490:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66703ee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.175496:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66703ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.175501:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150f000 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263342.175514:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66703ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.175522:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66703ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.175533:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:3.0:1788263342.175536:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263342.175540:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66703ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.175546:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f000/0x4b1103cba66703ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.175559:0:10388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66703f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.175565:0:10388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66703f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.175571:0:10388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66703f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.175576:0:10388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150e400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263342.175801:0:10388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66703f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.175809:0:10388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66703f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.175818:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9ff282126700) 00010000:00010000:3.0:1788263342.175821:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263342.175831:0:10388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66703f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.175837:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e400/0x4b1103cba66703f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.175944:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150f600/0x4b1103cba66703e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170181 expref: 28 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.176078:0:10388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66703fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170181 expref: 27 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263342.176086:0:10388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:3.0:1788263342.176089:0:10388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263342.176091:0:10388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150ee00, rc 0) 00000100:00100000:3.0:1788263342.176150:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff38541b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+27:12432:x1875129699247872:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 15465us (15703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263342.176158:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 249 00000100:00100000:3.0:1788263342.199499:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263342.199641:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263342.199675:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263342.199697:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263342.199719:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263342.199878:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699248384 00000100:00100000:2.0:1788263342.199888:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699248384 00000100:00100000:2.0:1788263342.199955:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 395 00000100:00100000:2.0:1788263342.199972:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2386:x1875129699248384:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263342.200034:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2386:x1875129699248384:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 65us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263342.200042:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 395 00000100:00100000:3.0:1788263342.200443:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699248512 00000100:00100000:3.0:1788263342.200448:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699248512 00000100:00100000:3.0:1788263342.200496:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699248768 00000100:00100000:3.0:1788263342.200500:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699248768 00000100:00100000:3.0:1788263342.200522:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699248896 00000100:00100000:3.0:1788263342.200525:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699248896 00000100:00100000:3.0:1788263342.200543:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 344 00000100:00100000:3.0:1788263342.200549:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699248512:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263342.200608:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2386:x1875129699248512:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 58us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263342.200625:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 344 00000100:00100000:3.0:1788263342.200639:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 345 00000100:00100000:3.0:1788263342.200645:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699248768:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263342.200672:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699248768:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 28us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263342.200678:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 345 00000100:00100000:3.0:1788263342.200689:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 346 00000100:00100000:3.0:1788263342.200695:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699248896:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263342.200717:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8481cd9-d282-4057-bab5-8c571435635f+5:2386:x1875129699248896:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 23us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263342.200723:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 346 00000100:00100000:1.0:1788263342.200793:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699248640 00000100:00100000:1.0:1788263342.200798:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699248640 00000100:00100000:1.0:1788263342.200828:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 153 00000100:00100000:1.0:1788263342.200834:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:2386:x1875129699248640:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263342.200861:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+9:2386:x1875129699248640:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 27us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263342.200868:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 153 00000100:00080000:2.0:1788263342.203170:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788263342.203187:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788263342.203190:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:1.0:1788263342.646193:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1788263342.646208:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00010000:00010000:3.0:1788263342.769605:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788263342.977387:0:14629:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788263342.977396:0:14629:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788263342.977431:0:14629:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788263342.977438:0:14629:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788263343.154251:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788263343.154261:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788263343.154289:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788263343.154297:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788263343.154415:0:13769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28414a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13769:1875129709783680:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788263343.154784:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709783808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788263343.154894:0:13769:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff283a5e840 going to sleep for 11 seconds 00000100:00100000:2.0:1788263343.155246:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263343.155683:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788263343.155692:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709783936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788263343.155720:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263343.164324:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709783808 00000100:00100000:3.0:1788263343.164339:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709783808 00000100:00100000:2.0:1788263343.164608:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263343.164657:0:13769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28414a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13769:1875129709783680:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788263343.166204:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709783936 00000100:00100000:1.0:1788263343.166214:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709783936 00000100:00100000:1.0:1788263343.166432:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699249024 00000100:00100000:1.0:1788263343.166437:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699249024 00000100:00100000:1.0:1788263343.166676:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 250 00000100:00100000:1.0:1788263343.166687:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+27:12444:x1875129699249024:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788263343.166720:0:8884:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788263343.166836:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+27:12444:x1875129699249024:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 151us (2233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263343.166844:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 250 00000100:00100000:1.0:1788263343.169265:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788263343.169278:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709783808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788263343.169311:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788263343.169389:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709783808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (14143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263343.169396:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788263343.169415:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788263343.169422:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709783936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788263343.169438:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788263343.170724:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709783936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1297us (14998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263343.170735:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788263343.170807:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709783936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788263343.170825:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709783808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788263343.172301:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263343.173459:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699249280 00000100:00100000:1.0:1788263343.173472:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699249280 00000100:00100000:1.0:1788263343.173534:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 251 00000100:00100000:1.0:1788263343.173544:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28414ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+27:12444:x1875129699249280:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788263343.173564:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263343.173600:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba6670403 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170188 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263343.173701:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba667040a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263343.173715:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba667040a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263343.173728:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba667040a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263343.173739:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788263343.173846:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681a00/0x4b1103cba6670403 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170188 expref: 30 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263343.173864:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba667040a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170188 expref: 29 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263343.173873:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:1.0:1788263343.173876:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788263343.173887:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381680c00, rc 0) 00000100:00100000:1.0:1788263343.173959:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28414ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:12444:x1875129699249280:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 415us (1666us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788263343.173966:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 251 00000100:00100000:3.0:1788263343.177523:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263343.177653:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699249408 00000100:00100000:2.0:1788263343.177662:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699249408 00000100:00100000:2.0:1788263343.177723:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:2.0:1788263343.177733:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:2386:x1875129699249408:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263343.177759:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263343.177783:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba667040a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170188 expref: 29 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263343.177800:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:2.0:1788263343.177805:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263343.177852:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+28:2386:x1875129699249408:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 120us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263343.177859:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:3.0:1788263343.178792:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263343.178902:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699249664 00000100:00100000:2.0:1788263343.178908:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699249664 00000100:00100000:2.0:1788263343.178956:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 252 00000100:00100000:2.0:1788263343.178965:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+28:12444:x1875129699249664:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788263343.179031:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba6670418 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263343.179045:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba6670418 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263343.179054:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba6670418 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263343.179216:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba6670418 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263343.179224:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba6670418 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263343.179232:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba6670418 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263343.179249:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263343.179253:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba6670418 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263343.179260:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba6670418 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263343.179270:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:2.0:1788263343.179273:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788263343.179277:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba6670418 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263343.179283:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0200/0x4b1103cba6670418 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263343.179394:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:12444:x1875129699249664:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 429us (604us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788263343.179402:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 252 00000040:00080000:2.0:1788263343.179509:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788263343.179513:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788263343.180062:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788263343.180070:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788263343.183345:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263343.190034:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699249920 00000100:00100000:2.0:1788263343.190048:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699249920 00000100:00100000:2.0:1788263343.190210:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:2.0:1788263343.190222:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+29:12444:x1875129699249920:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788263343.190450:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+30:12444:x1875129699249920:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 230us (7111us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788263343.190481:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 64 00000040:00080000:2.0:1788263343.728241:0:13773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788263343.791751:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263344.688193:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff284149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709784192:0@lo:400:kworker.0 00000100:00100000:0.0:1788263344.688260:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263344.688305:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28414a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709784704:0@lo:400:kworker.0 00000100:00100000:0.0:1788263344.688330:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263344.688350:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709785216:0@lo:400:kworker.0 00000100:00100000:0.0:1788263344.688372:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263344.688391:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709785728:0@lo:400:kworker.0 00000100:00100000:0.0:1788263344.688410:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263344.688435:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788263344.688441:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709784064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263344.688462:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263344.688480:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28414bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709784576:0@lo:400:kworker.0 00000100:00100000:0.0:1788263344.688504:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263344.688518:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709785088:0@lo:400:kworker.0 00000100:00100000:0.0:1788263344.688537:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263344.688554:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709785600:0@lo:400:kworker.0 00000100:00100000:0.0:1788263344.688575:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263344.688669:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28414a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709784320:0@lo:400:kworker.0 00000100:00100000:0.0:1788263344.688703:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263344.688722:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff284148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709784832:0@lo:400:kworker.0 00000100:00100000:0.0:1788263344.688742:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263344.688758:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283ae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875129709785344:0@lo:400:kworker.0 00000100:00100000:0.0:1788263344.688778:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263344.688797:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788263344.688802:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28414b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709784448:0@lo:400:kworker.0 00000100:00100000:0.0:1788263344.688822:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263344.688839:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff284148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709784960:0@lo:400:kworker.0 00000100:00100000:0.0:1788263344.688860:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263344.688877:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875129709785472:0@lo:400:kworker.0 00000100:00100000:0.0:1788263344.688896:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263344.688924:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709784192 00000100:00100000:0.0:1788263344.688930:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709784192 00000100:00100000:0.0:1788263344.688975:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1788263344.688983:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3619:x1875129709784192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263344.689032:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3619:x1875129709784192:12345-0@lo:400:kworker.0 Request processed in 49us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263344.689039:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1788263344.689072:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709784704 00000100:00100000:0.0:1788263344.689075:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709784704 00000100:00100000:0.0:1788263344.689110:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709784448 00000100:00100000:0.0:1788263344.689113:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709784448 00000100:00100000:0.0:1788263344.689126:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788263344.689131:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709784704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263344.689165:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709784704:12345-0@lo:400:kworker.0 Request processed in 33us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263344.689178:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788263344.689191:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788263344.689197:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709784448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263344.689439:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709784576 00000100:00100000:1.0:1788263344.689443:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709784576 00000100:00100000:1.0:1788263344.689466:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709784320 00000100:00100000:1.0:1788263344.689469:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709784320 00000100:00100000:1.0:1788263344.689478:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709784832 00000100:00100000:1.0:1788263344.689480:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709784832 00000100:00100000:1.0:1788263344.689501:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709785344 00000100:00100000:1.0:1788263344.689504:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709785344 00000100:00100000:1.0:1788263344.689514:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709784960 00000100:00100000:1.0:1788263344.689516:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709784960 00000100:00100000:1.0:1788263344.689527:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709785472 00000100:00100000:1.0:1788263344.689528:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709785472 00000100:00100000:1.0:1788263344.689539:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788263344.689545:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709784576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263344.689598:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709784576:12345-0@lo:400:kworker.0 Request processed in 34us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263344.689604:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788263344.689618:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788263344.689624:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709784320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263344.689657:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709784320:12345-0@lo:400:kworker.0 Request processed in 33us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263344.689663:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788263344.689674:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788263344.689679:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709784832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263344.689705:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709784832:12345-0@lo:400:kworker.0 Request processed in 26us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263344.689717:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788263344.689729:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788263344.689734:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875129709785344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263344.689761:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875129709785344:12345-0@lo:400:kworker.0 Request processed in 28us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263344.689767:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788263344.689779:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788263344.689785:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf78b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709784960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263344.689809:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf78b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709784960:12345-0@lo:400:kworker.0 Request processed in 25us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263344.689814:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788263344.689825:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788263344.689831:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875129709785472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263344.689857:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf789180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875129709785472:12345-0@lo:400:kworker.0 Request processed in 26us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263344.689862:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00080000:1.0:1788263344.689879:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788263344.689883:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263344.689994:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709785216 00000100:00100000:1.0:1788263344.690000:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709785216 00000100:00100000:1.0:1788263344.690032:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709785728 00000100:00100000:1.0:1788263344.690036:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709785728 00000100:00100000:1.0:1788263344.690049:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709785088 00000100:00100000:1.0:1788263344.690051:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709785088 00000100:00100000:1.0:1788263344.690062:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709785600 00000100:00100000:1.0:1788263344.690065:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709785600 00000100:00100000:1.0:1788263344.690077:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788263344.690089:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709785216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263344.690133:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709785216:12345-0@lo:400:kworker.0 Request processed in 45us (1760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263344.690140:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788263344.690151:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788263344.690157:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3619:x1875129709785728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263344.690184:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3619:x1875129709785728:12345-0@lo:400:kworker.0 Request processed in 28us (1773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263344.690190:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788263344.690201:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788263344.690207:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709785088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263344.690233:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709785088:12345-0@lo:400:kworker.0 Request processed in 26us (1695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263344.690239:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788263344.690250:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788263344.690256:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709785600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263344.690283:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709785600:12345-0@lo:400:kworker.0 Request processed in 27us (1707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263344.690288:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788263344.690309:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709784064 00000100:00100000:1.0:1788263344.690313:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709784064 00000100:00100000:1.0:1788263344.690336:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788263344.690343:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1875129709784064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788263344.690364:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788263344.690395:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1875129709784064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (1932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263344.690407:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:1.0:1788263344.690428:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788263344.690431:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263344.690506:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709784064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263344.690520:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28414bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709784576:0@lo:400:kworker.0 00000100:00100000:1.0:1788263344.690531:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709785088:0@lo:400:kworker.0 00000100:00100000:1.0:1788263344.690542:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709785600:0@lo:400:kworker.0 00000100:00100000:1.0:1788263344.690553:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff284149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709784192:0@lo:400:kworker.0 00000100:00100000:1.0:1788263344.690564:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28414a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709784704:0@lo:400:kworker.0 00000100:00100000:1.0:1788263344.690573:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1788263344.690665:0:3619:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:1.0:1788263344.690692:0:3619:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ff3a0f6f480, transno 4294967308 00000004:00080000:1.0:1788263344.690704:0:3619:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:1.0:1788263344.690712:0:3619:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ff284148380, transno 4294967311 00000100:00100000:1.0:1788263344.690718:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709785216:0@lo:400:kworker.0 00000100:00100000:1.0:1788263344.690730:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709785728:0@lo:400:kworker.0 00010000:00080000:1.0:1788263344.690796:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff284148a80 x1875129709784960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263344.690807:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff284148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709784960:0@lo:400:kworker.0 00010000:00080000:1.0:1788263344.690818:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283aeaa00 x1875129709785472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263344.690826:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875129709785472:0@lo:400:kworker.0 00000100:00100000:1.0:1788263344.690845:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28414a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709784320:0@lo:400:kworker.0 00000100:00100000:1.0:1788263344.690858:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff284148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709784832:0@lo:400:kworker.0 00000100:00100000:1.0:1788263344.690868:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283ae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875129709785344:0@lo:400:kworker.0 00000100:00100000:0.0:1788263344.693396:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709784448:12345-0@lo:400:kworker.0 Request processed in 4192us (4565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263344.693410:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788263344.693468:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28414b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709784448:0@lo:400:kworker.0 00000040:00080000:3.0:1788263344.757184:0:14680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788263344.757193:0:14680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788263344.757300:0:14680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788263344.757306:0:14680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788263344.816166:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263344.866116:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263344.866405:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699250176 00000100:00100000:1.0:1788263344.866414:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699250176 00000100:00100000:1.0:1788263344.866493:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 253 00000100:00100000:1.0:1788263344.866505:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+30:12465:x1875129699250176:12345-192.168.203.26@tcp:101:lfs.0 00000100:00080000:3.0:1788263344.866509:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788263344.866530:0:6491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263344.866551:0:6491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba667041f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d117018f expref: -99 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263344.866677:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba6670426 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263344.866692:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba6670426 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263344.866703:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba6670426 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263344.866714:0:6491:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788263344.866814:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680200/0x4b1103cba667041f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117018f expref: 33 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263344.866832:0:6491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba6670426 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117018f expref: 32 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263344.866855:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:1.0:1788263344.866858:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788263344.866862:0:6491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381680c00, rc 0) 00000100:00100000:1.0:1788263344.866923:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+32:12465:x1875129699250176:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 419us (814us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788263344.866933:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 253 00000100:00100000:3.0:1788263344.871936:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263344.872703:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699250304 00000100:00100000:2.0:1788263344.872713:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699250304 00000100:00100000:2.0:1788263344.872771:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 254 00000100:00100000:2.0:1788263344.872781:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+32:12465:x1875129699250304:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:2.0:1788263344.872843:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba6670434 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263344.872858:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba6670434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263344.872869:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba6670434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263344.872902:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba6670434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263344.872909:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba6670434 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263344.872915:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba6670434 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263344.872921:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263344.872925:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba6670434 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263344.872932:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba6670434 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263344.872952:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:2.0:1788263344.872956:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788263344.872960:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba6670434 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263344.872966:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0600/0x4b1103cba6670434 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263344.874180:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+32:12465:x1875129699250304:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 1395us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263344.874191:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 254 00000100:00100000:1.0:1788263344.953481:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263344.953622:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699250432 00000100:00100000:2.0:1788263344.953633:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699250432 00000100:00100000:2.0:1788263344.953714:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 79 00000100:00100000:2.0:1788263344.953724:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2387:x1875129699250432:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:2.0:1788263344.953740:0:9885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263344.953758:0:9885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005063539c/0x4b1103cba667043b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170196 expref: -99 pid: 9885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788263344.953782:0:9885:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a96bbac, atime: 0x6a96bbac, ctime: 0x6a96bbac, blocks: 0x8 00010000:00010000:2.0:1788263344.953814:0:9885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=354s v=(0 0) 00010000:00010000:2.0:1788263344.953818:0:9885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263344.953827:0:9885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005063539c/0x4b1103cba667043b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170196 expref: 8 pid: 9885 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263344.953844:0:9885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005063539c/0x4b1103cba667043b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170196 expref: 8 pid: 9885 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788263344.953865:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788263344.953887:0:9885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d0600, rc 0) 00000100:00100000:2.0:1788263344.953941:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2387:x1875129699250432:12345-192.168.203.26@tcp:101:cat.0 Request processed in 218us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263344.953948:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 79 00000100:00100000:3.0:1788263344.964920:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263344.965025:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699250560 00000100:00100000:2.0:1788263344.965034:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699250560 00002000:00100000:2.0:1788263344.965080:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9ff3b5635880 x1875129699250560/t0(0) o3->ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp:555/0 lens 488/0 e 0 to 0 dl 1788263355 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788263344.965108:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ff3b5635880 with x1875129699250560 ext(0->4095) 00002000:00010000:2.0:1788263344.965113:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ff3b5635880 00000100:00100000:2.0:1788263344.965143:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:2.0:1788263344.965152:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2389:x1875129699250560:12345-192.168.203.26@tcp:3:cat.0 00000100:00100000:2.0:1788263344.965455:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2389:x1875129699250560:12345-192.168.203.26@tcp:3:cat.0 Request processed in 302us (542us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788263344.965463:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 7 00002000:00100000:2.0:1788263344.965470:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9ff3b5635880 x1875129699250560/t0(0) o3->ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea@192.168.203.26@tcp:555/0 lens 488/4536 e 0 to 0 dl 1788263355 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788263344.965478:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ff3b5635880 with x1875129699250560 ext(0->4095) 00002000:00010000:2.0:1788263344.965481:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ff3b5635880 00000100:00100000:2.0:1788263345.199795:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788263345.199818:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709785856:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788263345.199886:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263345.200124:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709785856 00000100:00100000:3.0:1788263345.200132:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709785856 00000100:00100000:3.0:1788263345.200185:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788263345.200194:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709785856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788263345.200217:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788263345.202144:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709785856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1943us (2251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263345.202156:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788263345.204785:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709785856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788263345.713101:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263345.713125:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709785984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263345.713189:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263345.713210:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709786112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788263345.713240:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263345.713264:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709785984 00000100:00100000:1.0:1788263345.713272:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709785984 00000100:00100000:1.0:1788263345.713320:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709786112 00000100:00100000:1.0:1788263345.713323:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709786112 00000100:00100000:2.0:1788263345.713340:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788263345.713364:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709785984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788263345.713393:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263345.713411:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788263345.713417:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709786112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788263345.713427:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263345.713450:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709785984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263345.713451:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709786112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263345.713458:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788263345.713499:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709786112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788263345.713531:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709785984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788263345.720975:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00010000:00010000:3.0:1788263345.839796:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263346.863982:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263347.318117:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263347.318172:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263347.318638:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263347.318675:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263347.318716:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699250688 00000100:00100000:2.0:1788263347.318726:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699250688 00000100:00100000:2.0:1788263347.318780:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 397 00000100:00100000:2.0:1788263347.318801:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a96b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2386:x1875129699250688:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263347.318870:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a96b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2386:x1875129699250688:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 82us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263347.318878:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 397 00000100:00100000:0.0:1788263347.319308:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699251072 00000100:00100000:0.0:1788263347.319314:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699251072 00000100:00100000:0.0:1788263347.319376:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 158 00000100:00100000:0.0:1788263347.319385:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699251072:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263347.319418:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699251072:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 35us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263347.319424:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 158 00000100:00080000:0.0:1788263347.319439:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263347.325248:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699250816 00000100:00100000:1.0:1788263347.325264:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699250816 00000100:00100000:1.0:1788263347.325339:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699251328 00000100:00100000:1.0:1788263347.325355:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699251328 00000100:00080000:2.0:1788263347.325503:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263347.326436:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 353 00000100:00100000:1.0:1788263347.326454:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+32:2386:x1875129699250816:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263347.327604:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+32:2386:x1875129699250816:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 1151us (9425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263347.328779:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263347.329126:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263347.330059:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263347.330100:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699251200 00000100:00100000:3.0:1788263347.330109:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699251200 00000100:00100000:3.0:1788263347.330672:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 159 00000100:00100000:2.0:1788263347.330692:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 354 00000100:00100000:0.0:1788263347.330713:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699250944 00000100:00100000:2.0:1788263347.330716:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699251456 00000100:00100000:0.0:1788263347.330719:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699250944 00000100:00100000:2.0:1788263347.330723:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699251456 00000100:00100000:0.0:1788263347.330754:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 355 00000100:00100000:0.0:1788263347.330764:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699250944:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263347.330836:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699250944:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 74us (2060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263347.330843:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 355 00000100:00100000:0.0:1788263347.330873:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 356 00000100:00100000:0.0:1788263347.330878:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699251456:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263347.330897:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2387:x1875129699251200:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263347.330973:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699251456:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 94us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263347.330979:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 356 00000100:00080000:0.0:1788263347.331146:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788263347.331150:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788263347.331543:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+8:2387:x1875129699251200:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 861us (2416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263347.331551:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 159 00000100:00100000:3.0:1788263347.331607:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699251328:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263347.331652:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699251328:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 945us (12976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263347.331660:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 354 00000100:00100000:1.0:1788263347.337655:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 353 00000001:00080000:0.0:1788263347.762293:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:0.0:1788263347.762307:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1788263347.762868:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1788263347.762889:0:6470:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ff282244180 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788263347.762893:0:6470:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ff3bd1aa700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ff282244000 00000020:00080000:1.0:1788263347.762896:0:6470:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ff3bd1aab00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ff282f5b800 00000020:00080000:1.0:1788263347.762910:0:6470:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1788263347.762936:0:6523:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00010000:00010000:0.0:1788263347.763057:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba66703b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788263347.763067:0:6523:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1788263347.763079:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba66703b6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263347.763090:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba66703b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263347.763097:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150e800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263347.763102:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba66703b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263347.763109:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba66703b6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263347.763127:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9ff282126900) 00010000:00010000:0.0:1788263347.763130:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263347.763135:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba66703b6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263347.763140:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e800/0x4b1103cba66703b6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263347.889533:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263348.273822:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709786240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788263348.273890:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263348.273960:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709786240 00000100:00100000:3.0:1788263348.273967:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709786240 00000100:00100000:3.0:1788263348.274010:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788263348.274019:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709786240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788263348.274048:0:13780:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788263348.274102:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709786240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263348.274110:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788263348.274157:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709786240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788263348.274760:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709786368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788263348.274796:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263348.274880:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709786368 00000100:00100000:2.0:1788263348.274885:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709786368 00000100:00100000:2.0:1788263348.274920:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788263348.274927:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709786368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788263348.274946:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788263348.274982:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709786368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263348.274988:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788263348.275059:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709786368:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788263348.911802:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263349.807903:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709786752:0@lo:400:kworker.0 00000100:00100000:3.0:1788263349.807973:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263349.808019:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875129709787264:0@lo:400:kworker.0 00000100:00100000:3.0:1788263349.808044:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263349.808077:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709787776:0@lo:400:kworker.0 00000100:00100000:3.0:1788263349.808118:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263349.808138:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788263349.808143:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709786624:0@lo:400:kworker.0 00000100:00100000:3.0:1788263349.808160:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263349.808173:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875129709787136:0@lo:400:kworker.0 00000100:00100000:3.0:1788263349.808190:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263349.808203:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875129709787648:0@lo:400:kworker.0 00000100:00100000:3.0:1788263349.808233:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263349.808263:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709786752 00000100:00100000:3.0:1788263349.808270:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709786752 00000100:00100000:3.0:1788263349.808305:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788263349.808313:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709786752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263349.808365:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709786752:12345-0@lo:400:kworker.0 Request processed in 51us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263349.808372:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788263349.808394:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709787264 00000100:00100000:3.0:1788263349.808398:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709787264 00000100:00100000:3.0:1788263349.808422:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709787776 00000100:00100000:3.0:1788263349.808424:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709787776 00000100:00100000:3.0:1788263349.808434:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709786624 00000100:00100000:3.0:1788263349.808437:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709786624 00000100:00100000:3.0:1788263349.808446:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709787136 00000100:00100000:3.0:1788263349.808448:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709787136 00000100:00100000:3.0:1788263349.808459:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709787648 00000100:00100000:3.0:1788263349.808463:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709787648 00000100:00100000:3.0:1788263349.808475:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788263349.808480:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875129709787264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263349.808512:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875129709787264:12345-0@lo:400:kworker.0 Request processed in 31us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263349.808525:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788263349.808538:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788263349.808544:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875129709787776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263349.808573:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875129709787776:12345-0@lo:400:kworker.0 Request processed in 29us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263349.808615:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788263349.808627:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788263349.808634:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709786624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263349.808661:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709786624:12345-0@lo:400:kworker.0 Request processed in 28us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263349.808667:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788263349.808679:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788263349.808684:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875129709787136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263349.808709:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875129709787136:12345-0@lo:400:kworker.0 Request processed in 25us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263349.808715:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788263349.808725:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788263349.808732:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875129709787648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263349.808755:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875129709787648:12345-0@lo:400:kworker.0 Request processed in 24us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263349.808761:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788263349.808793:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709786624:0@lo:400:kworker.0 00000100:00100000:3.0:1788263349.808802:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875129709787136:0@lo:400:kworker.0 00000100:00100000:3.0:1788263349.808821:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875129709787648:0@lo:400:kworker.0 00000100:00100000:3.0:1788263349.808828:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709786752:0@lo:400:kworker.0 00010000:00080000:3.0:1788263349.808839:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283957480 x1875129709787264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263349.808849:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875129709787264:0@lo:400:kworker.0 00010000:00080000:3.0:1788263349.808858:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283a4f100 x1875129709787776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263349.808865:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709787776:0@lo:400:kworker.0 00000100:00100000:1.0:1788263349.809223:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709786880:0@lo:400:kworker.0 00000100:00100000:1.0:1788263349.809259:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263349.809281:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709787392:0@lo:400:kworker.0 00000100:00100000:1.0:1788263349.809304:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263349.809320:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709787904:0@lo:400:kworker.0 00000100:00100000:1.0:1788263349.809340:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263349.809360:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788263349.809366:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709786496:0@lo:400:kworker.0 00000100:00100000:1.0:1788263349.809391:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263349.809410:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709787008:0@lo:400:kworker.0 00000100:00100000:1.0:1788263349.809427:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263349.809442:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709787520:0@lo:400:kworker.0 00000100:00100000:1.0:1788263349.809460:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263349.809488:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709788032:0@lo:400:kworker.0 00000100:00100000:1.0:1788263349.809507:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263349.809531:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709786880 00000100:00100000:1.0:1788263349.809535:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709786880 00000100:00100000:1.0:1788263349.809559:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788263349.809565:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709786880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263349.809618:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709786880:12345-0@lo:400:kworker.0 Request processed in 53us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263349.809625:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788263349.809645:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709787392 00000100:00100000:1.0:1788263349.809649:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709787392 00000100:00100000:1.0:1788263349.809672:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709787904 00000100:00100000:1.0:1788263349.809675:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709787904 00000100:00100000:1.0:1788263349.809688:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709787520 00000100:00100000:1.0:1788263349.809691:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709787520 00000100:00100000:1.0:1788263349.809702:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709788032 00000100:00100000:1.0:1788263349.809705:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709788032 00000100:00100000:1.0:1788263349.809717:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788263349.809722:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709787392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263349.809752:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709787392:12345-0@lo:400:kworker.0 Request processed in 30us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263349.809759:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788263349.809771:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788263349.809777:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709787904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263349.809801:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709787904:12345-0@lo:400:kworker.0 Request processed in 25us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263349.809807:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788263349.809818:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788263349.809831:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709787520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263349.809861:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709787520:12345-0@lo:400:kworker.0 Request processed in 32us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263349.810127:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788263349.810141:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788263349.810147:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709788032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263349.810176:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709788032:12345-0@lo:400:kworker.0 Request processed in 30us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263349.810182:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788263349.810204:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709787008 00000100:00100000:1.0:1788263349.810208:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709787008 00000100:00100000:1.0:1788263349.810290:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788263349.810296:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709787008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263349.810329:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709787008:12345-0@lo:400:kworker.0 Request processed in 33us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263349.810334:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788263349.810378:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709787008:0@lo:400:kworker.0 00000100:00100000:1.0:1788263349.810388:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709787520:0@lo:400:kworker.0 00000100:00100000:1.0:1788263349.810396:0:3620:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1788263349.810400:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ff3bf6d6680, transno 4294967323 00000004:00080000:1.0:1788263349.810409:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:1.0:1788263349.810426:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709788032:0@lo:400:kworker.0 00000100:00100000:1.0:1788263349.810436:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709786880:0@lo:400:kworker.0 00000100:00100000:1.0:1788263349.810445:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709787392:0@lo:400:kworker.0 00000100:00100000:1.0:1788263349.810468:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709787904:0@lo:400:kworker.0 00000100:00080000:0.0:1788263349.810572:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788263349.810597:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788263349.810600:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788263349.810603:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788263349.810615:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709786496 00000100:00100000:0.0:1788263349.810619:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709786496 00000100:00100000:0.0:1788263349.810649:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1788263349.810656:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3620:x1875129709786496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263349.810697:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3620:x1875129709786496:12345-0@lo:400:kworker.0 Request processed in 42us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263349.810703:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1788263349.810735:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709786496:0@lo:400:kworker.0 00000100:00100000:0.0:1788263349.812121:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709788160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263349.812173:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263349.812330:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709788160 00000100:00100000:1.0:1788263349.812337:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709788160 00000100:00100000:1.0:1788263349.812384:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788263349.812393:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf78a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709788160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788263349.812417:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788263349.817485:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf78a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709788160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5083us (5301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263349.817499:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788263349.821717:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709788160:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788263349.935862:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263350.164765:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263350.165283:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699251584 00000100:00100000:1.0:1788263350.165295:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699251584 00000100:00100000:1.0:1788263350.165378:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 255 00000100:00100000:1.0:1788263350.165388:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf78bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+18:12118:x1875129699251584:12345-192.168.203.26@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788263350.165483:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf78bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+18:12118:x1875129699251584:12345-192.168.203.26@tcp:60:lhsmtool_posix.0 Request processed in 97us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263350.165491:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 255 00000100:00080000:0.0:1788263350.165548:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263350.168669:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263350.168819:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699251712 00000100:00100000:2.0:1788263350.168829:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699251712 00000100:00100000:2.0:1788263350.169196:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 256 00000100:00100000:2.0:1788263350.169208:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:12118:x1875129699251712:12345-192.168.203.26@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788263350.169472:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:12118:x1875129699251712:12345-192.168.203.26@tcp:60:lhsmtool_posix.0 Request processed in 265us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263350.169481:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 256 00000100:00080000:0.0:1788263350.169799:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788263350.173524:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263350.173672:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699251968 00000100:00100000:0.0:1788263350.173681:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699251968 00000100:00100000:0.0:1788263350.173840:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:0.0:1788263350.173851:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+18:12118:x1875129699251968:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788263350.174094:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+19:12118:x1875129699251968:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 244us (578us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788263350.174114:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:0.0:1788263350.323484:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263350.323508:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709788288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788263350.323597:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263350.323961:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709788288 00000100:00100000:2.0:1788263350.323970:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709788288 00000100:00100000:2.0:1788263350.324025:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788263350.324044:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf78b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709788288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788263350.324075:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788263350.324131:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf78b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709788288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263350.324140:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788263350.324227:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709788288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788263350.477184:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263350.477464:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699252096 00000100:00100000:2.0:1788263350.477473:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699252096 00000100:00100000:2.0:1788263350.477551:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 257 00000100:00100000:2.0:1788263350.477562:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:12921:x1875129699252096:12345-192.168.203.26@tcp:101:lsof.0 00010000:00010000:2.0:1788263350.477609:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263350.477632:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670442 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d117019d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263350.477699:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba6670449 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263350.477730:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba6670449 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263350.477741:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba6670449 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263350.477788:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788263350.477791:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788263350.477809:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba6670449 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263350.477833:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670442 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117019d expref: 7 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263350.477850:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba6670449 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117019d expref: 6 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263350.477858:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff282279000) 00010000:00010000:2.0:1788263350.477861:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788263350.477865:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d1c00, rc 0) 00000100:00100000:2.0:1788263350.477936:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+6:12921:x1875129699252096:12345-192.168.203.26@tcp:101:lsof.0 Request processed in 375us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263350.477943:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 257 00000100:00080000:0.0:1788263350.478062:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263350.832162:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788263350.832186:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709788416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263350.832266:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263350.832339:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709788416 00000100:00100000:3.0:1788263350.832347:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709788416 00000100:00100000:1.0:1788263350.832351:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709788544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788263350.832398:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788263350.832399:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263350.832413:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709788416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788263350.832448:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788263350.832452:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709788544 00000100:00100000:1.0:1788263350.832458:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709788544 00000100:00100000:1.0:1788263350.832480:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788263350.832487:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28414b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709788544:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788263350.832516:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709788416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (250us total) trans 0 rc 0/0 00002000:00000024:1.0:1788263350.832520:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263350.832527:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788263350.832574:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28414b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709788544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263350.832601:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709788416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263350.832617:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788263350.832633:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709788544:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788263350.963136:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263351.985690:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263352.442207:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263352.442256:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263352.442338:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699252352 00000100:00100000:3.0:1788263352.442347:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699252352 00000100:00100000:3.0:1788263352.442430:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 363 00000100:00100000:3.0:1788263352.442441:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+19:2389:x1875129699252352:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263352.442536:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+19:2389:x1875129699252352:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 96us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263352.442544:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 363 00000100:00080000:0.0:1788263352.442624:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263352.443143:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699252224 00000100:00100000:2.0:1788263352.443151:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699252224 00000100:00100000:2.0:1788263352.443201:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 399 00000100:00100000:2.0:1788263352.443210:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2389:x1875129699252224:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263352.443260:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2389:x1875129699252224:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 52us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263352.443276:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 399 00000100:00100000:1.0:1788263352.444026:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263352.444071:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263352.444103:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263352.444141:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263352.444178:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263352.444202:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699252736 00000100:00100000:1.0:1788263352.444209:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699252736 00000100:00100000:0.0:1788263352.444221:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699252480 00000100:00100000:0.0:1788263352.444228:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699252480 00000100:00100000:1.0:1788263352.444257:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699252608 00000100:00100000:1.0:1788263352.444262:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699252608 00000100:00100000:0.0:1788263352.444264:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699252992 00000100:00100000:0.0:1788263352.444269:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699252992 00000100:00100000:0.0:1788263352.444296:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699252864 00000100:00100000:0.0:1788263352.444299:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699252864 00000100:00100000:1.0:1788263352.444303:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 164 00000100:00100000:1.0:1788263352.444314:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28414a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2389:x1875129699252736:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263352.444321:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 364 00000100:00100000:0.0:1788263352.444331:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2389:x1875129699252480:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263352.444376:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28414a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2389:x1875129699252736:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 61us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263352.444376:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2389:x1875129699252480:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 44us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263352.444393:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 164 00000100:00100000:0.0:1788263352.444406:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 364 00000100:00100000:1.0:1788263352.444413:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 165 00000100:00100000:1.0:1788263352.444424:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28414a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2389:x1875129699252608:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263352.444428:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 365 00000100:00100000:0.0:1788263352.444438:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:2389:x1875129699252992:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263352.444459:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28414a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2389:x1875129699252608:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 37us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263352.444466:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 165 00000100:00100000:0.0:1788263352.444474:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:2389:x1875129699252992:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 35us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263352.444481:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 365 00000100:00100000:1.0:1788263352.444501:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 366 00000100:00100000:1.0:1788263352.444572:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8481cd9-d282-4057-bab5-8c571435635f+6:2389:x1875129699252864:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263352.444635:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8481cd9-d282-4057-bab5-8c571435635f+6:2389:x1875129699252864:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 65us (456us total) trans 0 rc 0/0 00000100:00080000:2.0:1788263352.444958:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788263352.444964:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788263352.444966:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788263352.444968:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788263352.457417:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 366 00010000:00010000:2.0:1788263353.007759:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263353.392655:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709788672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788263353.392747:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263353.393102:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709788672 00000100:00100000:3.0:1788263353.393112:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709788672 00000100:00100000:3.0:1788263353.393162:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788263353.393171:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf78a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709788672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788263353.393201:0:13780:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788263353.393243:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf78a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709788672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263353.393250:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788263353.393972:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709788672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788263353.394002:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263353.394011:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709788800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788263353.394056:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263353.394146:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709788800 00000100:00100000:2.0:1788263353.394151:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709788800 00000100:00100000:2.0:1788263353.394188:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788263353.394196:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709788800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788263353.394216:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788263353.394258:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf788000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709788800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263353.394264:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788263353.394327:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709788800:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788263353.457394:0:13769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788263353.457403:0:13769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788263353.457522:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:3.0:1788263353.457529:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1788263353.463900:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1788263353.463917:0:6470:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1788263353.464510:0:6523:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788263353.464523:0:6523:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:0.0:1788263353.969142:0:13773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788263354.037089:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788263354.169381:0:14879:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 07:49:12 (1788263352) 00000100:00100000:1.0:1788263354.927879:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709789184:0@lo:400:kworker.0 00000100:00100000:1.0:1788263354.927940:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263354.927989:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709789696:0@lo:400:kworker.0 00000100:00100000:1.0:1788263354.928010:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263354.928043:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709790208:0@lo:400:kworker.0 00000100:00100000:1.0:1788263354.928063:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263354.928087:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788263354.928094:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709789312:0@lo:400:kworker.0 00000100:00100000:1.0:1788263354.928114:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263354.928131:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709789824:0@lo:400:kworker.0 00000100:00100000:1.0:1788263354.928152:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263354.928167:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709790336:0@lo:400:kworker.0 00000100:00100000:1.0:1788263354.928188:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263354.928221:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709789184 00000100:00100000:1.0:1788263354.928227:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709789184 00000100:00100000:1.0:1788263354.928273:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788263354.928281:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709789184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263354.928334:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709789184:12345-0@lo:400:kworker.0 Request processed in 54us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263354.928352:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788263354.928376:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709789696 00000100:00100000:1.0:1788263354.928381:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709789696 00000100:00100000:1.0:1788263354.928416:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709790208 00000100:00100000:1.0:1788263354.928420:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709790208 00000100:00100000:1.0:1788263354.928436:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709789312 00000100:00100000:1.0:1788263354.928439:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709789312 00000100:00100000:1.0:1788263354.928451:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1788263354.928456:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709789696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263354.928488:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709789696:12345-0@lo:400:kworker.0 Request processed in 32us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263354.928495:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1788263354.928506:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1788263354.928512:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875129709790208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263354.928537:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875129709790208:12345-0@lo:400:kworker.0 Request processed in 26us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263354.928544:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1788263354.928554:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788263354.928560:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709789312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263354.928620:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709789312:12345-0@lo:400:kworker.0 Request processed in 60us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263354.928626:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788263354.928660:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709789824 00000100:00100000:1.0:1788263354.928663:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709789824 00000100:00100000:1.0:1788263354.928687:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709790336 00000100:00100000:1.0:1788263354.928690:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709790336 00000100:00100000:1.0:1788263354.928707:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788263354.928720:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709789824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263354.928752:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709789824:12345-0@lo:400:kworker.0 Request processed in 32us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263354.928757:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788263354.928768:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788263354.928774:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283324a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709790336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263354.928798:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283324a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709790336:12345-0@lo:400:kworker.0 Request processed in 25us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263354.928803:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:1.0:1788263354.928825:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788263354.928828:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788263354.928830:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788263354.928866:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709789312:0@lo:400:kworker.0 00000100:00100000:1.0:1788263354.928876:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709789824:0@lo:400:kworker.0 00000100:00100000:1.0:1788263354.928885:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709790336:0@lo:400:kworker.0 00000100:00100000:1.0:1788263354.928893:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709789184:0@lo:400:kworker.0 00010000:00080000:1.0:1788263354.928903:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283327800 x1875129709789696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263354.928913:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709789696:0@lo:400:kworker.0 00010000:00080000:1.0:1788263354.928930:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283325880 x1875129709790208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263354.928939:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709790208:0@lo:400:kworker.0 00000100:00100000:3.0:1788263354.929178:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875129709789056:0@lo:400:kworker.0 00000100:00100000:3.0:1788263354.929212:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263354.929240:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875129709789568:0@lo:400:kworker.0 00000100:00100000:3.0:1788263354.929261:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263354.929279:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875129709790080:0@lo:400:kworker.0 00000100:00100000:3.0:1788263354.929298:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263354.929316:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1788263354.929322:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28414bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709788928:0@lo:400:kworker.0 00000100:00100000:3.0:1788263354.929348:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263354.929371:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709789440:0@lo:400:kworker.0 00000100:00100000:3.0:1788263354.929401:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263354.929417:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709789952:0@lo:400:kworker.0 00000100:00100000:3.0:1788263354.929434:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263354.929446:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709790464:0@lo:400:kworker.0 00000100:00100000:3.0:1788263354.929461:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263354.929483:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709788928 00000100:00100000:3.0:1788263354.929488:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709788928 00000100:00100000:3.0:1788263354.929515:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1788263354.929520:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3621:x1875129709788928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263354.929550:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3621:x1875129709788928:12345-0@lo:400:kworker.0 Request processed in 30us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263354.929555:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1788263354.929603:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709789440 00000100:00100000:3.0:1788263354.929607:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709789440 00000100:00100000:3.0:1788263354.929629:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788263354.929636:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709789440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263354.929668:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709789440:12345-0@lo:400:kworker.0 Request processed in 33us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263354.929674:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788263354.929692:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709789952 00000100:00100000:3.0:1788263354.929695:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709789952 00000100:00100000:3.0:1788263354.929722:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709790464 00000100:00100000:3.0:1788263354.929725:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709790464 00000100:00100000:3.0:1788263354.929745:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788263354.929751:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709789952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263354.929782:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709789952:12345-0@lo:400:kworker.0 Request processed in 31us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263354.929797:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788263354.929810:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788263354.929815:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709790464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263354.929842:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709790464:12345-0@lo:400:kworker.0 Request processed in 27us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263354.929848:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788263354.929942:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709789056 00000100:00100000:3.0:1788263354.929947:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709789056 00000100:00100000:3.0:1788263354.929971:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709789568 00000100:00100000:3.0:1788263354.929974:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709789568 00000100:00100000:3.0:1788263354.929992:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709790080 00000100:00100000:3.0:1788263354.929994:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709790080 00000100:00100000:3.0:1788263354.930010:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1788263354.930016:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875129709789056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263354.930058:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875129709789056:12345-0@lo:400:kworker.0 Request processed in 42us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263354.930064:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1788263354.930076:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1788263354.930083:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875129709789568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263354.930108:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875129709789568:12345-0@lo:400:kworker.0 Request processed in 26us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263354.930114:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1788263354.930124:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788263354.930130:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875129709790080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263354.930154:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875129709790080:12345-0@lo:400:kworker.0 Request processed in 25us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263354.930169:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00080000:3.0:1788263354.930199:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788263354.930204:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788263354.930205:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788263354.930229:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28414bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:15f48257-b19e-4792-92d2-a48eb49d0ad1:3621:1875129709788928:0@lo:400:kworker.0 00000100:00100000:3.0:1788263354.930239:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709789440:0@lo:400:kworker.0 00000100:00100000:3.0:1788263354.930249:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709789952:0@lo:400:kworker.0 00000100:00100000:3.0:1788263354.930256:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709790464:0@lo:400:kworker.0 00000100:00100000:3.0:1788263354.930265:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875129709789056:0@lo:400:kworker.0 00000100:00100000:3.0:1788263354.930274:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875129709789568:0@lo:400:kworker.0 00000100:00100000:3.0:1788263354.930283:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875129709790080:0@lo:400:kworker.0 00000100:00100000:0.0:1788263354.930539:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709790592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263354.930571:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263354.930663:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709790592 00000100:00100000:1.0:1788263354.930673:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709790592 00000100:00100000:1.0:1788263354.930702:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788263354.930708:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709790592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788263354.930728:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788263354.931110:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf789c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709790592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 400us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263354.931118:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788263354.931177:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709790592:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788263355.059206:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263355.439924:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788263355.439948:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709790720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788263355.440027:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263355.440193:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709790720 00000100:00100000:0.0:1788263355.440202:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709790720 00000100:00100000:0.0:1788263355.440251:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788263355.440260:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709790720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788263355.440281:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788263355.440325:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709790720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263355.440332:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788263355.440454:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709790720:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788263355.951905:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709790976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263355.951972:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263355.952102:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709790976 00000100:00100000:2.0:1788263355.952110:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709790976 00000100:00100000:2.0:1788263355.952165:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788263355.952175:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709790976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788263355.952203:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263355.952250:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf788a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709790976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263355.952315:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788263355.952401:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709790976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263355.952679:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709790848:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788263355.952726:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263355.953058:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709790848 00000100:00100000:0.0:1788263355.953076:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709790848 00000100:00100000:0.0:1788263355.953113:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788263355.953120:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709790848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788263355.953132:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263355.957087:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709790848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3954us (4348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263355.957103:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788263355.957525:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709790848:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788263356.082953:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263357.103792:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263357.555284:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263357.555328:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263357.555359:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263357.555403:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263357.555418:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263357.555432:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263357.555456:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263357.555478:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699253632 00000100:00100000:2.0:1788263357.555486:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699253632 00000100:00100000:2.0:1788263357.555530:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699253504 00000100:00100000:2.0:1788263357.555533:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699253504 00000100:00100000:2.0:1788263357.555550:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 170 00000100:00100000:2.0:1788263357.555559:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2387:x1875129699253632:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263357.555666:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2387:x1875129699253632:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 108us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263357.555673:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 170 00000100:00100000:2.0:1788263357.555688:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 171 00000100:00100000:2.0:1788263357.555694:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699253504:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263357.555729:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699253504:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 23us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263357.555735:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 171 00000100:00100000:0.0:1788263357.556178:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699253120 00000100:00100000:0.0:1788263357.556184:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699253120 00000100:00100000:0.0:1788263357.556233:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 401 00000100:00100000:0.0:1788263357.556241:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2387:x1875129699253120:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263357.556286:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2387:x1875129699253120:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 45us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263357.556294:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 401 00000100:00100000:3.0:1788263357.556876:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699253376 00000100:00100000:3.0:1788263357.556883:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699253376 00000100:00100000:3.0:1788263357.556965:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699253888 00000100:00100000:3.0:1788263357.556969:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699253888 00000100:00100000:3.0:1788263357.556985:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699253248 00000100:00100000:3.0:1788263357.556989:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699253248 00000100:00100000:3.0:1788263357.557000:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699253760 00000100:00100000:1.0:1788263357.557086:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 373 00000100:00100000:1.0:1788263357.557098:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699253376:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263357.557150:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2387:x1875129699253376:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 55us (1821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263357.557157:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 373 00000100:00100000:1.0:1788263357.557176:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 374 00000100:00100000:1.0:1788263357.557183:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699253888:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263357.557208:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8481cd9-d282-4057-bab5-8c571435635f+5:2387:x1875129699253888:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 25us (1805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263357.557215:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 374 00000100:00100000:1.0:1788263357.557227:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 375 00000100:00100000:1.0:1788263357.557234:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+18:2387:x1875129699253248:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263357.557258:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+18:2387:x1875129699253248:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 25us (1838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263357.557276:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 375 00000100:00080000:1.0:1788263357.557317:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788263357.557320:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788263357.557323:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788263357.557325:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788263357.557428:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699253760 00000100:00100000:3.0:1788263357.557478:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 376 00000100:00100000:3.0:1788263357.557485:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8481cd9-d282-4057-bab5-8c571435635f+6:2387:x1875129699253760:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263357.557514:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8481cd9-d282-4057-bab5-8c571435635f+6:2387:x1875129699253760:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 30us (2057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263357.557520:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 376 00000100:00080000:1.0:1788263357.557662:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788263358.128045:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263358.309150:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263358.309252:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699254144 00000100:00100000:0.0:1788263358.309261:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699254144 00000100:00100000:0.0:1788263358.309324:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00100000:0.0:1788263358.309335:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+18:13145:x1875129699254144:12345-192.168.203.26@tcp:35:umount.0 00000100:00100000:0.0:1788263358.309666:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+19:13145:x1875129699254144:12345-192.168.203.26@tcp:35:umount.0 Request processed in 332us (535us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788263358.309676:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00100000:2.0:1788263358.316716:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263358.318414:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699254400 00000100:00100000:1.0:1788263358.318428:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699254400 00000100:00100000:1.0:1788263358.318493:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00100000:1.0:1788263358.318505:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+19:13145:x1875129699254400:12345-192.168.203.26@tcp:35:umount.0 00000100:00100000:1.0:1788263358.318858:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+20:13145:x1875129699254400:12345-192.168.203.26@tcp:35:umount.0 Request processed in 353us (2147us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788263358.318867:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00100000:1.0:1788263358.322452:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263358.322665:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699254656 00000100:00100000:3.0:1788263358.322675:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699254656 00000100:00100000:3.0:1788263358.322729:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 68 00000100:00100000:3.0:1788263358.322739:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3a9739050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+20:13145:x1875129699254656:12345-192.168.203.26@tcp:35:umount.0 00000100:00100000:2.0:1788263358.324233:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3a9739050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+21:13145:x1875129699254656:12345-192.168.203.26@tcp:35:umount.0 Request processed in 1487us (1783us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788263358.324246:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 68 00000100:00100000:2.0:1788263358.328989:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263358.337377:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699254912 00000100:00100000:1.0:1788263358.337392:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699254912 00000100:00100000:1.0:1788263358.337527:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 69 00000100:00100000:1.0:1788263358.337539:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+21:13145:x1875129699254912:12345-192.168.203.26@tcp:35:umount.0 00000100:00100000:1.0:1788263358.338321:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:13145:x1875129699254912:12345-192.168.203.26@tcp:35:umount.0 Request processed in 780us (9336us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1788263358.338331:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 69 00000100:00100000:3.0:1788263358.352798:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263358.352860:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263358.352891:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263358.353034:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699255296 00000100:00100000:1.0:1788263358.353034:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699255168 00000100:00100000:2.0:1788263358.353044:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699255296 00000100:00100000:1.0:1788263358.353044:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699255168 00000100:00100000:2.0:1788263358.353104:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699255040 00000100:00100000:2.0:1788263358.353108:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699255040 00000100:00100000:0.0:1788263358.353200:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:0.0:1788263358.353213:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+15:2389:x1875129699255296:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263358.353228:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263358.353262:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3ae765e00/0x4b1103cba666f63b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdc9 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263358.353277:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263358.353743:0:9493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:1.0:1788263358.353753:0:9493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+14:2386:x1875129699255168:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263358.353768:0:9493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263358.353779:0:9493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff282f5c200/0x4b1103cba666f363 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcb1 expref: 14 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263358.353790:0:9493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263358.354173:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+13:2389:x1875129699255296:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 960us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263358.354182:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:1.0:1788263358.359089:0:9493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+12:2386:x1875129699255168:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 5326us (6288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263358.359105:0:9493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:2.0:1788263358.360028:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:2.0:1788263358.360047:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+11:2389:x1875129699255040:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263358.360063:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263358.360084:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3ae765000/0x4b1103cba666f3a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcf0 expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263358.360100:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263358.360142:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:2389:x1875129699255040:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 105us (7250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263358.360148:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:2.0:1788263358.365395:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263358.365761:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699255680 00000100:00100000:3.0:1788263358.365771:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699255680 00000100:00100000:3.0:1788263358.365828:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 80 00000100:00100000:3.0:1788263358.365840:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+7:2385:x1875129699255680:12345-192.168.203.26@tcp:9:umount.0 00000020:00000080:3.0:1788263358.365868:0:8406:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f9b4 00000020:00010000:3.0:1788263358.365876:0:8406:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ff28389e000: total 0 00000100:00080000:3.0:1788263358.365881:0:8406:0:(import.c:65:import_set_state_nolock()) ffff9ff283899800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788263358.365974:0:8406:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788263358.366165:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2385:x1875129699255680:12345-192.168.203.26@tcp:9:umount.0 Request processed in 327us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263358.366173:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 80 00000020:00010000:1.0:1788263358.372671:0:6479:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ff28389e000: total 0 00010000:00010000:1.0:1788263358.372748:0:6479:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ff28389e000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788263358.372811:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005063539c/0x4b1103cba667043b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170196 expref: 4 pid: 9885 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263358.372853:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b35bc8e/0x4b1103cba666fd6c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffb3 expref: 3 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263358.372869:0:6479:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ff28389e000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788263358.372882:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263358.372884:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263358.372886:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263358.373194:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263358.373477:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699255808 00000100:00100000:1.0:1788263358.373486:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699255808 00000100:00100000:1.0:1788263358.373546:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 81 00000100:00100000:1.0:1788263358.373556:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2385:x1875129699255808:12345-192.168.203.26@tcp:9:umount.0 00000020:00000080:1.0:1788263358.373612:0:9885:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f73e 00000100:00080000:1.0:1788263358.373621:0:9885:0:(import.c:65:import_set_state_nolock()) ffff9ff28334f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788263358.373654:0:9885:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:2.0:1788263358.373682:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263358.373820:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+2:2385:x1875129699255808:12345-192.168.203.26@tcp:9:umount.0 Request processed in 264us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263358.373828:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 81 00000100:00100000:2.0:1788263358.382984:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263358.383049:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699256832 00000100:00100000:1.0:1788263358.383059:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699256832 00000100:00100000:1.0:1788263358.383120:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 258 00000100:00100000:1.0:1788263358.383130:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+22:2385:x1875129699256832:12345-192.168.203.26@tcp:39:umount.0 00000020:00000080:1.0:1788263358.383159:0:10388:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f371 00000020:00010000:1.0:1788263358.383173:0:10388:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ff3bf664800: total 0 00000100:00080000:1.0:1788263358.383178:0:10388:0:(import.c:65:import_set_state_nolock()) ffff9ff3bf662800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788263358.383205:0:10388:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:1.0:1788263358.383351:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+21:2385:x1875129699256832:12345-192.168.203.26@tcp:39:umount.0 Request processed in 222us (374us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1788263358.383358:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 258 00000020:00010000:0.0:1788263358.383450:0:9492:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ff3bf664800: total 0 00010000:00010000:0.0:1788263358.383514:0:9492:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ff3bf664800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788263358.383546:0:9492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:0.0:1788263358.383550:0:9492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788263358.383556:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ea00/0x4b1103cba666fd57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffac expref: 20 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263358.383574:0:9492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:0.0:1788263358.383617:0:9492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788263358.383621:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ea00/0x4b1103cba666fa0f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fecc expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263358.383635:0:9492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ff28314fa00) 00010000:00010000:0.0:1788263358.383637:0:9492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263358.383641:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17ee00/0x4b1103cba666f6b9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdde expref: 18 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263358.383660:0:9492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:0.0:1788263358.383662:0:9492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788263358.383666:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0e00/0x4b1103cba667031c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170149 expref: 17 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263358.383695:0:9492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ff282128a00) 00010000:00010000:0.0:1788263358.383698:0:9492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788263358.383702:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0c00/0x4b1103cba666f69d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdd7 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263358.383717:0:9492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:0.0:1788263358.383719:0:9492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788263358.383722:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e200/0x4b1103cba666fdf1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffd6 expref: 15 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263358.383733:0:9492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:0.0:1788263358.383735:0:9492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788263358.383739:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150e000/0x4b1103cba666fc4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff66 expref: 14 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263358.383750:0:9492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:0.0:1788263358.383753:0:9492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263358.383756:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff38150ee00/0x4b1103cba66703fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170181 expref: 13 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263358.383768:0:9492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9ff28314ff00) 00010000:00010000:0.0:1788263358.383770:0:9492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788263358.383774:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381680c00/0x4b1103cba6670426 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117018f expref: 12 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263358.383788:0:9492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9ff282126a00) 00010000:00010000:0.0:1788263358.383790:0:9492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788263358.383800:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e000/0x4b1103cba666f714 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdf3 expref: 11 pid: 6491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263358.383816:0:9492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9ff3b3a5eb00) 00010000:00010000:0.0:1788263358.383818:0:9492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788263358.383822:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff381681800/0x4b1103cba66700de lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11700af expref: 10 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263358.383836:0:9492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff282279000) 00010000:00010000:0.0:1788263358.383838:0:9492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788263358.383842:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17f600/0x4b1103cba666fdd5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ffcf expref: 9 pid: 8884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263358.383852:0:9492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9ff282126c00) 00010000:00010000:0.0:1788263358.383855:0:9492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263358.383858:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bd17e600/0x4b1103cba666fd2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116ff9e expref: 8 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263358.383868:0:9492:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ff3bf664800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788263358.383882:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263358.383884:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263358.383886:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263358.395385:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263358.395479:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699256960 00000100:00100000:1.0:1788263358.395490:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699256960 00000100:00100000:1.0:1788263358.395550:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 259 00000100:00100000:1.0:1788263358.395560:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+5:2385:x1875129699256960:12345-192.168.203.26@tcp:39:umount.0 00000020:00000080:1.0:1788263358.395626:0:6493:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f378 00000100:00080000:1.0:1788263358.395656:0:6493:0:(import.c:65:import_set_state_nolock()) ffff9ff3bd5b8000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788263358.396273:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788263358.396284:0:6493:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788263358.396453:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea+3:2385:x1875129699256960:12345-192.168.203.26@tcp:39:umount.0 Request processed in 893us (1074us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788263358.396462:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 259 00000100:00100000:3.0:1788263358.511792:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788263358.511815:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28414bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709791104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788263358.511910:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263358.511956:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709791104 00000100:00100000:1.0:1788263358.511966:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709791104 00000100:00100000:1.0:1788263358.512034:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788263358.512045:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709791104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788263358.512078:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788263358.512178:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff385418380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709791232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788263358.512215:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263358.512270:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709791232 00000100:00100000:2.0:1788263358.512274:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709791232 00000100:00100000:2.0:1788263358.512302:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788263358.512310:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709791232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788263358.512395:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788263358.512444:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709791232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263358.512458:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788263358.512562:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff385418380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709791232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788263358.512761:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709791104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 717us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263358.512778:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788263358.512932:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28414bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709791104:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788263359.151954:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263360.047825:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709791360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263360.047896:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263360.047996:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709791872:0@lo:400:kworker.0 00000100:00100000:0.0:1788263360.048025:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263360.048064:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709791488:0@lo:400:kworker.0 00000100:00100000:0.0:1788263360.048076:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709792384:0@lo:400:kworker.0 00000100:00100000:3.0:1788263360.048106:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263360.048116:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263360.048136:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709792000:0@lo:400:kworker.0 00000100:00100000:0.0:1788263360.048150:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709792896:0@lo:400:kworker.0 00000100:00100000:3.0:1788263360.048167:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263360.048187:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709792512:0@lo:400:kworker.0 00000100:00100000:0.0:1788263360.048198:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263360.048219:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263360.048225:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788263360.048234:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709791744:0@lo:400:kworker.0 00000100:00100000:3.0:1788263360.048253:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788263360.048263:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709791616:0@lo:400:kworker.0 00000100:00100000:0.0:1788263360.048265:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263360.048291:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875129709792256:0@lo:400:kworker.0 00000100:00100000:3.0:1788263360.048299:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263360.048325:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709792128:0@lo:400:kworker.0 00000100:00100000:0.0:1788263360.048332:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263360.048382:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709792384 00000100:00100000:1.0:1788263360.048390:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709792384 00000100:00100000:1.0:1788263360.048441:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709792896 00000100:00100000:1.0:1788263360.048444:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709792896 00000100:00100000:1.0:1788263360.048480:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709792512 00000100:00100000:1.0:1788263360.048483:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709792512 00000100:00100000:2.0:1788263360.048489:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709792000 00000100:00100000:2.0:1788263360.048498:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709792000 00000100:00100000:1.0:1788263360.048506:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788263360.048520:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709792384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263360.048534:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709791744 00000100:00100000:2.0:1788263360.048538:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709791744 00000100:00100000:2.0:1788263360.048556:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788263360.048564:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709792000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263360.055111:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709792768:0@lo:400:kworker.0 00000100:00100000:0.0:1788263360.055177:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263360.055895:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709791360 00000100:00100000:0.0:1788263360.055905:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709791360 00000100:00100000:0.0:1788263360.056039:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788263360.056049:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709791360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263360.056081:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788263360.056134:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf789f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709791360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (8237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263360.056142:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788263360.056164:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709791872 00000100:00100000:0.0:1788263360.056168:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709791872 00000100:00100000:0.0:1788263360.059166:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709791616 00000100:00100000:0.0:1788263360.059416:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709791616 00000100:00100000:0.0:1788263360.059456:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709792256 00000100:00100000:0.0:1788263360.059459:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709792256 00000100:00100000:0.0:1788263360.059477:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709792768 00000100:00100000:0.0:1788263360.059480:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709792768 00000100:00100000:0.0:1788263360.059498:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1788263360.059522:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf78ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709791872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263360.059627:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf78ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709791872:12345-0@lo:400:kworker.0 Request processed in 107us (11600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263360.059634:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1788263360.059651:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788263360.059657:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709791616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263360.059795:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709791616:12345-0@lo:400:kworker.0 Request processed in 138us (11498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263360.059802:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788263360.059815:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788263360.059821:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875129709792256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263360.060277:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf788e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875129709792256:12345-0@lo:400:kworker.0 Request processed in 456us (11949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263360.060284:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788263360.060301:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1788263360.060307:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875129709792768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263360.060335:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875129709792768:12345-0@lo:400:kworker.0 Request processed in 29us (5158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263360.060340:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00010000:00080000:0.0:1788263360.060396:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283326a00 x1875129709792256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263360.060411:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875129709792256:0@lo:400:kworker.0 00010000:00080000:0.0:1788263360.060423:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283327100 x1875129709792768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263360.060445:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709792768:0@lo:400:kworker.0 00000100:00100000:0.0:1788263360.060461:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709791872:0@lo:400:kworker.0 00000100:00100000:0.0:1788263360.060480:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709791360:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788263360.060538:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788263360.060543:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788263360.060547:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788263360.060571:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788263360.060605:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709792896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263360.060647:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf789500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709792896:12345-0@lo:400:kworker.0 Request processed in 67us (12450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263360.060653:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788263360.060681:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788263360.060689:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709792512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263360.060720:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709792512:12345-0@lo:400:kworker.0 Request processed in 33us (12503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263360.060725:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788263360.060752:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709792896:0@lo:400:kworker.0 00000100:00100000:0.0:1788263360.060799:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788263360.060807:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709791744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263360.060857:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709791744:12345-0@lo:400:kworker.0 Request processed in 51us (12594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263360.060863:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788263360.060902:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709791744:0@lo:400:kworker.0 00000100:00100000:0.0:1788263360.061420:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709791488 00000100:00100000:0.0:1788263360.061427:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709791488 00000100:00100000:0.0:1788263360.061465:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1788263360.061472:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3620:x1875129709791488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263360.061509:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3620:x1875129709791488:12345-0@lo:400:kworker.0 Request processed in 38us (13404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263360.061515:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1788263360.062631:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf788380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709792384:12345-0@lo:400:kworker.0 Request processed in 14112us (14511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263360.062643:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788263360.062924:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709792384:0@lo:400:kworker.0 00000100:00100000:2.0:1788263360.066965:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709792000:12345-0@lo:400:kworker.0 Request processed in 18394us (18791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263360.066979:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788263360.072658:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263360.072871:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875129709792640:0@lo:400:kworker.0 00000100:00100000:3.0:1788263360.072924:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263360.072971:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709791488:0@lo:400:kworker.0 00000100:00100000:3.0:1788263360.072997:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709792000:0@lo:400:kworker.0 00000100:00100000:3.0:1788263360.073014:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709792512:0@lo:400:kworker.0 00000100:00100000:2.0:1788263360.073018:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709792128 00000100:00100000:2.0:1788263360.073027:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709792128 00000100:00100000:2.0:1788263360.073087:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709792640 00000100:00100000:2.0:1788263360.073092:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709792640 00000100:00100000:3.0:1788263360.073097:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709791616:0@lo:400:kworker.0 00000100:00080000:3.0:1788263360.073127:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263360.073138:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1788263360.073150:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709792128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263360.073155:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1788263360.073167:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875129709792640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263360.073218:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709792128:12345-0@lo:400:kworker.0 Request processed in 70us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263360.073226:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1788263360.073231:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875129709792640:12345-0@lo:400:kworker.0 Request processed in 64us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263360.073240:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1788263360.073279:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709792128:0@lo:400:kworker.0 00000100:00100000:2.0:1788263360.073291:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875129709792640:0@lo:400:kworker.0 00010000:00010000:0.0:1788263360.176343:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263360.306790:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263360.306835:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263360.306874:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263360.306967:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699257216 00000100:00100000:0.0:1788263360.306977:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699257216 00000100:00100000:0.0:1788263360.307044:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699257088 00000100:00100000:0.0:1788263360.307047:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699257088 00000100:00100000:0.0:1788263360.307060:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699257344 00000100:00100000:0.0:1788263360.307063:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699257344 00000100:00100000:0.0:1788263360.307079:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:0.0:1788263360.307088:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+12:2389:x1875129699257216:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263360.307103:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263360.307122:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff398eec000/0x4b1103cba666f47b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd36 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263360.307139:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263360.307188:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+11:2389:x1875129699257216:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 101us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263360.307205:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:0.0:1788263360.307223:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00100000:0.0:1788263360.307229:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+10:2389:x1875129699257088:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263360.307250:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263360.307260:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff398eed800/0x4b1103cba666f474 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fd05 expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263360.307269:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263360.307290:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+9:2389:x1875129699257088:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 62us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263360.307296:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00100000:0.0:1788263360.307311:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:0.0:1788263360.307317:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0454450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+8:2389:x1875129699257344:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263360.307330:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263360.307339:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3ae764000/0x4b1103cba666f634 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fdc2 expref: 8 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263360.307349:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263360.307365:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0454450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+7:2389:x1875129699257344:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 48us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263360.307370:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:0.0:1788263360.316022:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263360.316114:0:10388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699257600 00000100:00100000:1.0:1788263360.316125:0:10388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699257600 00000100:00100000:1.0:1788263360.316215:0:10388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 260 00000100:00100000:1.0:1788263360.316225:0:10388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8481cd9-d282-4057-bab5-8c571435635f+6:2385:x1875129699257600:12345-192.168.203.26@tcp:39:umount.0 00000020:00000080:1.0:1788263360.316268:0:10388:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f490 00000020:00010000:1.0:1788263360.316276:0:10388:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ff283213800: total 0 00000100:00080000:1.0:1788263360.316281:0:10388:0:(import.c:65:import_set_state_nolock()) ffff9ff283211800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788263360.316315:0:10388:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:1.0:1788263360.316473:0:10388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d8481cd9-d282-4057-bab5-8c571435635f+5:2385:x1875129699257600:12345-192.168.203.26@tcp:39:umount.0 Request processed in 250us (461us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1788263360.316481:0:10388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 260 00000020:00010000:0.0:1788263360.316887:0:6479:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ff283213800: total 0 00010000:00010000:0.0:1788263360.316891:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263360.316943:0:6479:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ff283213800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788263360.316977:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff282279000) 00010000:00010000:0.0:1788263360.316981:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788263360.316997:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1c00/0x4b1103cba6670449 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117019d expref: 4 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263360.317038:0:6479:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ff283213800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788263360.317051:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263360.317052:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263360.317063:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788263360.317518:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263360.323946:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263360.324102:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699257728 00000100:00100000:0.0:1788263360.324110:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699257728 00000100:00100000:0.0:1788263360.324189:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 261 00000100:00100000:0.0:1788263360.324208:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+5:2385:x1875129699257728:12345-192.168.203.26@tcp:39:umount.0 00000020:00000080:0.0:1788263360.324243:0:6493:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f489 00000100:00080000:0.0:1788263360.324250:0:6493:0:(import.c:65:import_set_state_nolock()) ffff9ff3bf638000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788263360.324271:0:6493:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788263360.324406:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8481cd9-d282-4057-bab5-8c571435635f+3:2385:x1875129699257728:12345-192.168.203.26@tcp:39:umount.0 Request processed in 208us (467us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788263360.324423:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 261 00000100:00080000:3.0:1788263360.324486:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788263360.324545:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263360.371131:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263360.371339:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699257984 00000100:00100000:0.0:1788263360.371353:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699257984 00000100:00100000:0.0:1788263360.371432:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 403 00000100:00100000:0.0:1788263360.371444:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+7:2385:x1875129699257984:12345-192.168.203.26@tcp:251:umount.0 00000020:00000080:0.0:1788263360.371654:0:6485:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f34e 00000020:00010000:0.0:1788263360.371664:0:6485:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ff3bf667800: total 0 00000100:00080000:0.0:1788263360.371669:0:6485:0:(import.c:65:import_set_state_nolock()) ffff9ff3bf661800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788263360.371799:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b76a18b-dd04-4b81-8dda-882bf3f4d7c6+3:2385:x1875129699257984:12345-192.168.203.26@tcp:251:umount.0 Request processed in 357us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263360.371808:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 403 00000020:00010000:3.0:1788263360.373708:0:9492:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ff3bf667800: total 0 00010000:00010000:3.0:1788263360.373802:0:9492:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ff3bf667800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788263360.375402:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3bd17f400/0x4b1103cba666f3a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d116fcf7 expref: 2 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263360.375434:0:9492:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ff3bf667800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788263360.375472:0:9492:0:(genops.c:885:class_export_put()) final put ffff9ff3bf667800/2b76a18b-dd04-4b81-8dda-882bf3f4d7c6 00010000:00010000:3.0:1788263360.375572:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263360.375575:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263360.375600:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788263360.382755:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3bf667800/2b76a18b-dd04-4b81-8dda-882bf3f4d7c6 for MGS 00000020:00000080:1.0:1788263360.394597:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff3bf661800 for MGS 00000100:00100000:2.0:1788263360.559928:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709793024:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788263360.560008:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263360.560201:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709793024 00000100:00100000:1.0:1788263360.560216:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709793024 00000100:00100000:1.0:1788263360.560268:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788263360.560278:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709793024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788263360.560300:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788263360.560362:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709793024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263360.560369:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788263360.560495:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709793024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788263361.073831:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709793152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263361.073910:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263361.073992:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709793152 00000100:00100000:0.0:1788263361.073999:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709793152 00000100:00100000:0.0:1788263361.074047:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788263361.074057:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709793152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788263361.074084:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788263361.074127:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709793152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263361.074134:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788263361.074179:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709793152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788263361.079505:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709793280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788263361.079606:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263361.079676:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709793280 00000100:00100000:3.0:1788263361.079683:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709793280 00000100:00100000:3.0:1788263361.079725:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788263361.079733:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709793280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788263361.079754:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263361.079796:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709793280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263361.079803:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788263361.079857:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709793280:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788263361.199892:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788263361.973809:0:15075:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788263361.983374:0:15075:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788263361.983428:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eed400/0x4b1103cba666f435 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f43c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263361.983441:0:15075:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eed400/0x4b1103cba666f435 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f43c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263361.983448:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eed400/0x4b1103cba666f435 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f43c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263361.983455:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9ff398eed400/0x4b1103cba666f435 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f43c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263361.983480:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788263361.983486:0:15075:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788263361.983511:0:15075:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788263361.983515:0:15075:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788263361.983530:0:15075:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788263361.983564:0:15075:0:(import.c:65:import_set_state_nolock()) ffff9ff3851c2000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788263361.983764:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263361.983772:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff398eed400/0x4b1103cba666f435 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f43c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263361.983780:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eed400 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:1.0:1788263361.983784:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eed400/0x4b1103cba666f435 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f43c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263361.983792:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff398eed400/0x4b1103cba666f435 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b1103cba666f43c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263361.983799:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eed400/0x4b1103cba666f435 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b1103cba666f43c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263361.983805:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788263361.983808:0:6480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788263361.983810:0:6480:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788263361.983837:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff398eed400/0x4b1103cba666f435 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666f43c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263361.983844:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263361.983869:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff398eed400/0x4b1103cba666f435 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666f43c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263361.983886:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff398eed400/0x4b1103cba666f435 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666f43c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263361.983896:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263361.983898:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263361.983900:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263361.983908:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788263361.983924:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709793536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788263361.983996:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263361.984058:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709793536 00000100:00100000:1.0:1788263361.984065:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709793536 00000100:00100000:1.0:1788263361.984115:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788263361.984123:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3618:x1875129709793536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788263361.984135:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263361.984149:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3bd17fe00/0x4b1103cba666f43c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b1103cba666f435 expref: 24 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263361.984160:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263361.984407:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:3618:x1875129709793536:12345-0@lo:103:ldlm_bl.0 Request processed in 284us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263361.984415:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788263361.987645:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875129709793408:0@lo:39:umount.0 00000100:00100000:1.0:1788263361.987715:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263361.987774:0:8884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709793408 00000100:00100000:1.0:1788263361.987782:0:8884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709793408 00000100:00100000:1.0:1788263361.987826:0:8884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788263361.987835:0:8884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875129709793408:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788263361.987876:0:8884:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666ef65 00000100:00080000:1.0:1788263361.987886:0:8884:0:(import.c:65:import_set_state_nolock()) ffff9ff3843fb800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788263361.987956:0:8884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3617:x1875129709793408:12345-0@lo:39:umount.0 Request processed in 121us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263361.987964:0:8884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:1.0:1788263361.987987:0:8884:0:(genops.c:885:class_export_put()) final put ffff9ff3843ff000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1788263361.988017:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788263361.988027:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3843ff000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788263361.988073:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff3843fb800 for lustre-MDT0000 00000100:00080000:1.0:1788263361.988110:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3851c2000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788263361.988123:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875129709793408:0@lo:39:umount.0 00000100:00100000:0.0:1788263361.989195:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709793536:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788263361.989229:0:15075:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788263361.989234:0:15075:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788263361.989240:0:15075:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788263361.991142:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f443 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f44a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263361.991159:0:15075:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f443 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f44a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263361.991167:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f443 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f44a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263361.991174:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f443 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f44a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263361.991201:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263361.991209:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f308 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f30f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263361.991215:0:15075:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f308 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f30f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263361.991220:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f308 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f30f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263361.991227:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f30f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263361.991261:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788263361.991268:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f66c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f673 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263361.991279:0:15075:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f66c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f673 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263361.991285:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f66c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f673 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263361.991291:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f66c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f673 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263361.991308:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788263361.991314:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9c00/0x4b1103cba666eec4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666eecb expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263361.991321:0:15075:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9c00/0x4b1103cba666eec4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666eecb expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263361.991328:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9c00/0x4b1103cba666eec4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666eecb expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263361.991335:0:15075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9c00/0x4b1103cba666eec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666eecb expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263361.991946:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788263361.991956:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f443 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f44a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263361.991965:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17f200 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:1.0:1788263361.991970:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f443 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f44a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263361.991991:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b1103cba666f44a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263361.991999:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b1103cba666f44a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263361.992006:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788263361.992009:0:6480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788263361.992053:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f443 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666f44a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263361.992069:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263361.992098:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f443 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666f44a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263361.992105:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f200/0x4b1103cba666f443 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666f44a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263361.992120:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788263361.992124:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f30f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263361.992130:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17fa00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:1.0:1788263361.992134:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f30f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263361.992141:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b1103cba666f30f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263361.992147:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b1103cba666f30f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263361.992153:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788263361.992155:0:6480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788263361.992158:0:6480:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788263361.992176:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f308 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666f30f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263361.992182:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263361.992190:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f308 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666f30f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263361.992206:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17fa00/0x4b1103cba666f308 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666f30f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263361.992218:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788263361.992222:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f66c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f673 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263361.992732:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765800 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:1.0:1788263361.992736:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f66c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f673 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263361.992745:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f66c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b1103cba666f673 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263361.992753:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f66c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b1103cba666f673 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263361.992759:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788263361.992761:0:6480:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788263361.992764:0:6480:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788263361.992783:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f66c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666f673 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263361.992788:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788263361.993685:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263361.993695:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9c00/0x4b1103cba666eec4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666eecb expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263361.993702:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9c00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:2.0:1788263361.993705:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9c00/0x4b1103cba666eec4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666eecb expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263361.993712:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9c00/0x4b1103cba666eec4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b1103cba666eecb expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263361.993719:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9c00/0x4b1103cba666eec4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b1103cba666eecb expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263361.993724:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788263361.993726:0:6479:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:2.0:1788263361.993750:0:6479:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9c00/0x4b1103cba666eec4 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666eecb expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263361.993756:0:6479:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263361.993876:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f66c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666f673 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263361.993885:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765800/0x4b1103cba666f66c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666f673 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263361.993914:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263361.993916:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263361.993918:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263361.993942:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709793664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788263361.994017:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263361.994068:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263361.994075:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709793792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788263361.994098:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263361.994131:0:9493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709793664 00000100:00100000:1.0:1788263361.994137:0:9493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709793664 00010000:00010000:2.0:1788263361.994306:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9c00/0x4b1103cba666eec4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666eecb expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263361.994316:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263361.994318:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263361.994319:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263361.994335:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf6d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709794048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263361.994369:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263361.994399:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788263361.994406:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709793920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263361.994431:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263361.994454:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709793792 00000100:00100000:2.0:1788263361.994458:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709793792 00000100:00100000:2.0:1788263361.994479:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709794048 00000100:00100000:2.0:1788263361.994482:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709794048 00000100:00100000:2.0:1788263361.994494:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709793920 00000100:00100000:2.0:1788263361.994496:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709793920 00000100:00100000:2.0:1788263361.994510:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788263361.994518:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+26:3620:x1875129709793664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788263361.994530:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263361.994545:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff398eede00/0x4b1103cba666f44a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b1103cba666f443 expref: 26 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263361.994558:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263361.994612:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+25:3620:x1875129709793664:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263361.994619:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788263361.994636:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788263361.994642:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+24:3620:x1875129709793792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788263361.994649:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263361.994657:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3ae764200/0x4b1103cba666f30f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b1103cba666f308 expref: 24 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263361.994666:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263361.994688:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+23:3620:x1875129709793792:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263361.994694:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788263361.994715:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788263361.994721:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+22:3619:x1875129709794048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788263361.994730:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263361.994739:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff381681400/0x4b1103cba666eecb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b1103cba666eec4 expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263361.994747:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263361.994773:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+21:3619:x1875129709794048:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263361.994779:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788263361.994791:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788263361.994796:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398742300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+20:3619:x1875129709793920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788263361.994804:0:6476:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263361.994911:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263361.994985:0:15075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788263361.994994:0:15075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9c00/0x4b1103cba666eec4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666eecb expref: -99 pid: 6468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263361.995012:0:15075:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:0.0:1788263361.995016:0:15075:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788263361.995018:0:15075:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788263361.995064:0:15075:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788263361.995067:0:15075:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788263361.995072:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788263361.995078:0:15075:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1788263361.995082:0:15075:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ff3bc671800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788263361.995087:0:15075:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ff3af758000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788263361.995091:0:15075:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ff387646000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788263361.995095:0:15075:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ff3bd2db800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:0.0:1788263361.995101:0:15075:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9ff283213800 d8481cd9-d282-4057-bab5-8c571435635f 192.168.203.26@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788263361.995105:0:15075:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9ff3bf664800 ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea 192.168.203.26@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:0.0:1788263361.995109:0:15075:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9ff3876b0000) has exports, disconnecting them 00000020:00080000:0.0:1788263361.995113:0:15075:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ff3bc671800), last request at 1788263360 00000020:00000080:0.0:1788263361.995119:0:15075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f275 00000100:00080000:0.0:1788263361.995135:0:15075:0:(import.c:65:import_set_state_nolock()) ffff9ff3bc676000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788263361.995196:0:15075:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ff3bc671800): rc 0 00000020:00000080:0.0:1788263361.995199:0:15075:0:(genops.c:885:class_export_put()) final put ffff9ff3bc671800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788263361.995209:0:15075:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ff3af758000), last request at 1788263360 00000020:00000080:0.0:1788263361.995213:0:15075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f14f 00000100:00080000:0.0:1788263361.995220:0:15075:0:(import.c:65:import_set_state_nolock()) ffff9ff3af75e000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788263361.995367:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3bc671800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788263361.995406:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff3bc676000 for lustre-MDT0000 00000020:00080000:0.0:1788263361.995445:0:15075:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ff3af758000): rc 0 00000020:00000080:0.0:1788263361.995447:0:15075:0:(genops.c:885:class_export_put()) final put ffff9ff3af758000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788263361.995455:0:15075:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ff387646000), last request at 1788263123 00000020:00000080:0.0:1788263361.995465:0:15075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f04c 00000100:00080000:0.0:1788263361.995470:0:15075:0:(import.c:65:import_set_state_nolock()) ffff9ff387641800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788263361.995486:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788263361.995493:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3af758000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788263361.995520:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff3af75e000 for lustre-MDT0000 00010000:00010000:2.0:1788263361.995553:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3ae765200/0x4b1103cba666f673 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b1103cba666f66c expref: 20 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263361.995564:0:6476:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263361.995653:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398742300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:3619:x1875129709793920:12345-0@lo:103:ldlm_bl.0 Request processed in 856us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263361.995660:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788263361.995698:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709793920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263361.995707:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf6d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709794048:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788263361.995728:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263361.995741:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709793792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263361.995749:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709793664:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788263361.995981:0:15075:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ff387646000): rc 0 00000020:00000080:0.0:1788263361.995984:0:15075:0:(genops.c:885:class_export_put()) final put ffff9ff387646000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788263361.996001:0:15075:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ff3bd2db800), last request at 1788263123 00000020:00000080:0.0:1788263361.996006:0:15075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f01b 00000100:00080000:0.0:1788263361.996010:0:15075:0:(import.c:65:import_set_state_nolock()) ffff9ff3bc6a7000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788263361.996043:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff387646000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788263361.996081:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff387641800 for lustre-MDT0000 00010000:00010000:1.0:1788263361.996112:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788263361.996181:0:15075:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:0.0:1788263361.996395:0:15075:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ff3bd2db800): rc 0 00000004:00000080:0.0:1788263361.996401:0:15075:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffad45c0e33ae0 00000100:00080000:0.0:1788263361.996420:0:15075:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788263361.996423:0:15075:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:0.0:1788263361.997474:0:15075:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788263361.997501:0:15075:0:(import.c:65:import_set_state_nolock()) ffff9ff3bd2d9000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788263361.997567:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709794176:0@lo:39:umount.0 00000100:00100000:2.0:1788263361.997656:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788263361.997794:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263361.997953:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709794176 00000100:00100000:2.0:1788263361.997961:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709794176 00000100:00100000:2.0:1788263361.998063:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788263361.998076:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875129709794176:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788263361.998103:0:6496:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f0a7 00000100:00080000:2.0:1788263361.998112:0:6496:0:(import.c:65:import_set_state_nolock()) ffff9ff3c041b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788263361.998140:0:6496:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1788263361.998312:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3617:x1875129709794176:12345-0@lo:39:umount.0 Request processed in 240us (655us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788263361.998320:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00010000:00010000:1.0:1788263361.998361:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788263361.998672:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3bd2d9000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788263361.998680:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709794176:0@lo:39:umount.0 00000100:00080000:0.0:1788263361.998912:0:15075:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788263361.998916:0:15075:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:0.0:1788263361.998963:0:15075:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788263361.999024:0:15075:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788263361.999040:0:15075:0:(import.c:65:import_set_state_nolock()) ffff9ff3af7d8800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788263361.999062:0:15075:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788263361.999064:0:15075:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:0.0:1788263361.999078:0:15075:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788263361.999134:0:15075:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788263361.999142:0:15075:0:(import.c:65:import_set_state_nolock()) ffff9ff283242000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788263361.999196:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709794304:0@lo:9:umount.0 00000100:00100000:3.0:1788263361.999242:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263361.999272:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709794432:0@lo:9:umount.0 00000100:00100000:3.0:1788263361.999294:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263361.999345:0:9885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709794304 00000100:00100000:0.0:1788263361.999356:0:9885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709794304 00000100:00100000:1.0:1788263361.999374:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709794432 00000100:00100000:1.0:1788263361.999380:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709794432 00000100:00100000:0.0:1788263361.999405:0:9885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788263361.999417:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788263361.999419:0:9885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875129709794304:12345-0@lo:9:umount.0 00000100:00100000:1.0:1788263361.999429:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875129709794432:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788263361.999452:0:8404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f339 00000020:00000080:0.0:1788263361.999453:0:9885:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f1f7 00000100:00080000:1.0:1788263361.999462:0:8404:0:(import.c:65:import_set_state_nolock()) ffff9ff283242800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1788263361.999462:0:9885:0:(import.c:65:import_set_state_nolock()) ffff9ff281fa9800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788263361.999507:0:8404:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1788263361.999662:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3617:x1875129709794432:12345-0@lo:9:umount.0 Request processed in 236us (366us total) trans 0 rc 0/0 00000001:00000004:0.0:1788263361.999666:0:9885:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788263361.999679:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1788263361.999741:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff283242000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788263361.999752:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788263361.999753:0:3617:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788263361.999757:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709794432:0@lo:9:umount.0 00000100:00100000:0.0:1788263361.999950:0:9885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3617:x1875129709794304:12345-0@lo:9:umount.0 Request processed in 536us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263361.999956:0:9885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000020:00080000:0.0:1788263361.999990:0:15075:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9ff3876b0000) has no exports 00010000:00010000:3.0:1788263362.000206:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788263362.000416:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3af7d8800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788263362.000464:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788263362.000523:0:3617:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788263362.000527:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709794304:0@lo:9:umount.0 00010000:00010000:1.0:1788263362.004014:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788263362.020359:0:15075:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9ff3876b0000) has no exports 00000020:00000080:3.0:1788263362.085866:0:15075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666ef1f 00000020:00000080:3.0:1788263362.085882:0:15075:0:(genops.c:885:class_export_put()) final put ffff9ff3bc481800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788263362.085944:0:15075:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788263362.086131:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3bc481800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788263362.086156:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788263362.086254:0:15075:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788263362.086259:0:15075:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9ff3876b19b8) has no exports 00000020:00000080:2.0:1788263362.087055:0:15075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666ef18 00000020:00000080:2.0:1788263362.087064:0:15075:0:(genops.c:885:class_export_put()) final put ffff9ff38769b800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788263362.087124:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff38769b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788263362.087310:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788263362.087320:0:15075:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788263362.087324:0:15075:0:(genops.c:885:class_export_put()) final put ffff9ff3876cb000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788263362.087326:0:15075:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3876cb000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788263362.087332:0:15075:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1788263362.224647:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788263363.184279:0:13773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788263363.249732:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263363.632304:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788263363.632365:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28414bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709794560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788263363.632429:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263363.633332:0:13780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709794560 00000100:00100000:2.0:1788263363.633343:0:13780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709794560 00000100:00100000:2.0:1788263363.633385:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788263363.633393:0:13780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3621:x1875129709794560:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1788263363.633401:0:13780:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788263363.633456:0:13780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3621:x1875129709794560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (1026us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788263363.633463:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:02020000:1.0:1788263363.634011:0:3621:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000001:00100000:3.0:1788263363.640643:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788263363.640652:0:8398:0:(genops.c:885:class_export_put()) final put ffff9ff281fab800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788263363.640681:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea 00000020:00000080:3.0:1788263363.640684:0:8398:0:(genops.c:885:class_export_put()) final put ffff9ff28334f000/ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea 00000001:00100000:0.0:1788263363.641363:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788263363.641368:0:9482:0:(genops.c:885:class_export_put()) final put ffff9ff283247000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788263363.641377:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea 00000020:00000080:0.0:1788263363.641379:0:9482:0:(genops.c:885:class_export_put()) final put ffff9ff28389e000/ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea 00000020:00000080:2.0:1788263363.641602:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff281fab800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788263363.641756:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff28334f000/ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea for lustre-OST0000 00000020:00000080:2.0:1788263363.641997:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff283247000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788263363.642280:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff28389e000/ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea for lustre-OST0001 00000020:00000080:2.0:1788263363.642382:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff281fa9800 for lustre-OST0000 00000020:00000080:2.0:1788263363.642389:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff28334f800 for lustre-OST0000 00000020:00000080:2.0:1788263363.642393:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff283242800 for lustre-OST0001 00000020:00000080:2.0:1788263363.642396:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff283899800 for lustre-OST0001 00000100:00080000:1.0:1788263363.643551:0:3621:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788263363.643557:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9ff3ad8e1000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788263363.643562:0:3621:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000001:00100000:2.0:1788263363.652844:0:7422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788263363.652862:0:7422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1788263363.652869:0:7422:0:(genops.c:885:class_export_put()) final put ffff9ff3c041c000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788263363.652919:0:7422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d8481cd9-d282-4057-bab5-8c571435635f 00000001:00080000:2.0:1788263363.652927:0:7422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1788263363.652929:0:7422:0:(genops.c:885:class_export_put()) final put ffff9ff3bf63a800/d8481cd9-d282-4057-bab5-8c571435635f 00000001:00100000:2.0:1788263363.652934:0:7422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea 00000001:00080000:2.0:1788263363.652937:0:7422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1788263363.652939:0:7422:0:(genops.c:885:class_export_put()) final put ffff9ff3bf660000/ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea 00000020:00000080:3.0:1788263363.653313:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3c041c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788263363.653386:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3bf63a800/d8481cd9-d282-4057-bab5-8c571435635f for lustre-MDT0001 00000020:00000080:3.0:1788263363.653409:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3bf660000/ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea for lustre-MDT0001 00000020:00000080:3.0:1788263363.653434:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff3c041b800 for lustre-MDT0001 00000020:00000080:3.0:1788263363.653439:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff3bf638000 for lustre-MDT0001 00000020:00000080:3.0:1788263363.653442:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff3bd5b8000 for lustre-MDT0001 00000100:00080000:1.0:1788263363.663462:0:3621:0:(import.c:65:import_set_state_nolock()) ffff9ff3ad8e1000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788263363.663476:0:3621:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 132 00000100:00080000:1.0:1788263363.663486:0:3621:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ff3ad8e1000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:1.0:1788263363.663547:0:3621:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff2833e2a00 x1875129709794688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788263363.663649:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709794688:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788263363.663715:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263363.663788:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709794688 00000100:00100000:2.0:1788263363.663805:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709794688 00000100:00100000:2.0:1788263363.663840:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788263363.663860:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875129709794688:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788263363.663879:0:6496:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788263363.666872:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875129709794688:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 3016us (3149us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788263363.666888:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00080000:2.0:1788263363.666956:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3ad8e1000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788263363.669017:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788263363.669025:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709794688:0@lo:38:ptlrpcd_00_03.0 00000001:00100000:1.0:1788263364.147770:0:6470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788263364.147780:0:6470:0:(genops.c:885:class_export_put()) final put ffff9ff3bd2db800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788263364.147819:0:6470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d8481cd9-d282-4057-bab5-8c571435635f 00000001:00080000:1.0:1788263364.147829:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1788263364.147833:0:6470:0:(genops.c:885:class_export_put()) final put ffff9ff283213800/d8481cd9-d282-4057-bab5-8c571435635f 00000001:00100000:1.0:1788263364.147839:0:6470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea 00000001:00080000:1.0:1788263364.147843:0:6470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1788263364.147850:0:6470:0:(genops.c:885:class_export_put()) final put ffff9ff3bf664800/ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea 00000020:00000080:2.0:1788263364.148291:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3bd2db800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788263364.148669:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff283213800/d8481cd9-d282-4057-bab5-8c571435635f for lustre-MDT0000 00000020:00000080:2.0:1788263364.148696:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff3bc6a7000 for lustre-MDT0000 00000020:00000080:2.0:1788263364.148701:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff283211800 for lustre-MDT0000 00000020:00000080:3.0:1788263364.148880:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3bf664800/ed1db2ac-cf03-4ffc-9c8b-89a5c66c1dea for lustre-MDT0000 00000020:00000080:3.0:1788263364.148914:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff3bf662800 for lustre-MDT0000 00010000:00010000:1.0:1788263364.272398:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788263365.169111:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788263365.169117:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788263365.169121:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ff3ad8e1000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788263365.169141:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 372 00000100:00080000:2.0:1788263365.169147:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788263365.169153:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ff3ad8e1000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263365.169175:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff398742d80 x1875129709794944/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788263365.169274:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875129709795200:0@lo:400:kworker.0 00000100:00100000:3.0:1788263365.169293:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709795328:0@lo:400:kworker.0 00000100:00100000:2.0:1788263365.169343:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263365.169377:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709795200 00000100:00100000:3.0:1788263365.169385:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709795200 00000100:00100000:2.0:1788263365.169412:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709795712:0@lo:400:kworker.0 00000100:00100000:3.0:1788263365.169435:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788263365.169439:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263365.169453:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875129709795200:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788263365.169462:0:6491:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788263365.169463:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788263365.169470:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709795072:0@lo:400:kworker.0 00000100:00100000:2.0:1788263365.169504:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263365.169513:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875129709795200:12345-0@lo:400:kworker.0 Request processed in 59us (169us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788263365.169520:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788263365.169524:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398740e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875129709795584:0@lo:400:kworker.0 00000100:00100000:3.0:1788263365.169540:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709795712 00000100:00100000:3.0:1788263365.169545:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709795712 00000100:00100000:2.0:1788263365.169550:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263365.169598:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709795072 00000100:00100000:3.0:1788263365.169602:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709795072 00000100:00080000:2.0:1788263365.169606:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788263365.169611:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9ff3bd5bf000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:3.0:1788263365.169616:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709795584 00000100:02000400:2.0:1788263365.169616:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788263365.169621:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709795584 00000100:00100000:3.0:1788263365.169636:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1788263365.169643:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875129709795712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263365.169681:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875129709795712:12345-0@lo:400:kworker.0 Request processed in 39us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263365.169687:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1788263365.169699:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788263365.169703:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875129709795072:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788263365.169708:0:6491:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788263365.169732:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875129709795072:12345-0@lo:400:kworker.0 Request processed in 27us (229us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788263365.169738:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788263365.169749:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788263365.169753:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875129709795584:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788263365.169758:0:6491:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788263365.169786:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875129709795584:12345-0@lo:400:kworker.0 Request processed in 31us (238us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788263365.169791:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:3.0:1788263365.169815:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788263365.169840:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263365.169865:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709795840:0@lo:400:kworker.0 00000100:00100000:3.0:1788263365.169890:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263365.169909:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788263365.169915:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709794816:0@lo:400:kworker.0 00000100:00100000:3.0:1788263365.169939:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263365.169969:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398743800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709795456:0@lo:400:kworker.0 00000100:00100000:3.0:1788263365.169994:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263365.169995:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709795328 00000100:00100000:0.0:1788263365.170002:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709795328 00000100:00100000:3.0:1788263365.170025:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709795840 00000100:00100000:3.0:1788263365.170030:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709795840 00000100:00100000:0.0:1788263365.170044:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1788263365.170054:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709795328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263365.170064:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709795456 00000100:00100000:3.0:1788263365.170068:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709795456 00000100:00100000:3.0:1788263365.170094:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788263365.170103:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28398b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709795840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263365.170105:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709795328:12345-0@lo:400:kworker.0 Request processed in 52us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263365.170114:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1788263365.170138:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709794816 00000100:00100000:0.0:1788263365.170142:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709794816 00000100:00100000:3.0:1788263365.170146:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28398b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709795840:12345-0@lo:400:kworker.0 Request processed in 43us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263365.170152:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788263365.170170:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788263365.170175:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1788263365.170180:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709795456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263365.170187:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c049fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:3620:x1875129709794816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263365.170211:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709795456:12345-0@lo:400:kworker.0 Request processed in 35us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263365.170218:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788263365.170241:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c049fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f48257-b19e-4792-92d2-a48eb49d0ad1+19:3620:x1875129709794816:12345-0@lo:400:kworker.0 Request processed in 57us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263365.170248:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1788263365.170252:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709794816:0@lo:400:kworker.0 00000100:00100000:3.0:1788263365.170269:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398743800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709795456:0@lo:400:kworker.0 00010000:00080000:3.0:1788263365.170281:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff398740380 x1875129709795328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788263365.170284:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788263365.170288:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788263365.170301:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709795328:0@lo:400:kworker.0 00000100:00080000:0.0:1788263365.170313:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788263365.170317:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709795840:0@lo:400:kworker.0 00000100:00100000:0.0:1788263365.170329:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709794944:0@lo:38:kworker.0 00000100:00100000:0.0:1788263365.170360:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263365.170413:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709794944 00000100:00100000:3.0:1788263365.170416:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709794944 00000100:00100000:3.0:1788263365.170448:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788263365.170453:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875129709794944:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1788263365.170466:0:6497:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1788263365.189381:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9ff3bd5bf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788263365.189395:0:3619:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 151 00000100:00080000:2.0:1788263365.189405:0:3619:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ff3bd5bf000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263365.189445:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff398741500 x1875129709795968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788263365.189472:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875129709795200:0@lo:400:kworker.0 00010000:00080000:2.0:1788263365.189506:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff398741f80 x1875129709795712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263365.190254:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709795712:0@lo:400:kworker.0 00000100:00080000:2.0:1788263365.190291:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788263365.190296:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9ff3c041a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788263365.190301:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788263365.190306:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9ff3c041a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788263365.190311:0:3619:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 132 00000100:00080000:2.0:1788263365.190316:0:3619:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9ff3c041a000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263365.190335:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff398741f80 x1875129709796096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788263365.190347:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709795072:0@lo:400:kworker.0 00000100:00080000:2.0:1788263365.190359:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788263365.190361:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9ff3851c6800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788263365.190364:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788263365.190366:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9ff3851c6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788263365.190369:0:3619:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 173 00000100:00080000:2.0:1788263365.190374:0:3619:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ff3851c6800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263365.190383:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff398741c00 x1875129709796224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788263365.190392:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398740e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875129709795584:0@lo:400:kworker.0 00000100:00100000:0.0:1788263365.193652:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875129709795968:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788263365.193728:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263365.193778:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875129709796096:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788263365.193803:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263365.193828:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875129709796224:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788263365.193848:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263365.193942:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709795968 00000100:00100000:1.0:1788263365.193960:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709795968 00000100:00100000:1.0:1788263365.194000:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709796096 00000100:00100000:1.0:1788263365.194003:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709796096 00000100:00100000:1.0:1788263365.194017:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709796224 00000100:00100000:1.0:1788263365.194020:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709796224 00000100:00100000:1.0:1788263365.194032:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788263365.194039:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875129709795968:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1788263365.194057:0:6492:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788263365.194106:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875129709795968:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 66us (378us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788263365.194113:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788263365.194130:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788263365.194133:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875129709796096:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1788263365.194141:0:6492:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788263365.194167:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875129709796096:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 31us (364us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788263365.194172:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788263365.194183:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788263365.194187:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875129709796224:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1788263365.194193:0:6492:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788263365.194215:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875129709796224:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 26us (365us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788263365.194220:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1788263365.194274:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3bd5bf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788263365.194280:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788263365.194283:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875129709795968:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1788263365.194293:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3c041a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788263365.194308:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788263365.194312:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875129709796096:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1788263365.194323:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3851c6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788263365.194326:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788263365.194328:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875129709796224:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788263365.199798:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875129709794944:12345-0@lo:38:kworker.0 Request processed in 29335us (29430us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788263365.199813:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00080000:0.0:1788263365.200029:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3ad8e1000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788263365.200035:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788263365.200039:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709794944:0@lo:38:kworker.0 00010000:00010000:1.0:1788263365.295990:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263365.679852:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788263365.679887:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709796352:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788263365.679963:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263365.680044:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709796352 00000100:00100000:0.0:1788263365.680053:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709796352 00000100:00100000:0.0:1788263365.680107:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788263365.680117:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709796352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788263365.680146:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788263365.680480:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709796352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 364us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263365.680487:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788263365.682192:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709796352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788263366.191886:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788263366.191913:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709796480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788263366.191996:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263366.192145:0:11809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709796480 00000100:00100000:3.0:1788263366.192153:0:11809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709796480 00000100:00100000:3.0:1788263366.192209:0:11809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788263366.192219:0:11809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709796480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788263366.192245:0:11809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788263366.192301:0:11809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709796480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263366.192307:0:11809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788263366.192526:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709796480:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788263366.328140:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263367.343896:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788263368.175716:0:15075:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ff2830e0d80 - data ffff9ff3b8b436c0/ffff9ff282143800 00000020:01000000:2.0:1788263368.175877:0:15075:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ff3b39d4cc0 - data ffff9ff3b893dbd0/ffff9ff3bc4de400 00000001:00000004:2.0:1788263368.183011:0:15075:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:0.0:1788263368.242105:0:15075:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788263368.242113:0:15075:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1788263368.242128:0:15075:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9ff283a4f480 x1875129709794176/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788263371 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263368.242152:0:15075:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788263368.245709:0:15075:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788263368.245717:0:15075:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1788263368.245776:0:15075:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788263368.245779:0:15075:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788263368.247415:0:8609:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788263368.247421:0:8609:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1788263368.247431:0:8609:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788263368.250069:0:15075:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788263368.250076:0:15075:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1788263368.250187:0:15075:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788263368.250190:0:15075:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788263368.253210:0:9888:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788263368.253217:0:9888:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1788263368.253231:0:9888:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788263368.256381:0:15075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666eee7 00000020:00000080:0.0:1788263368.256393:0:15075:0:(genops.c:885:class_export_put()) final put ffff9ff387698800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788263368.257042:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff387698800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788263368.260714:0:15075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666eefc 00000020:00000080:0.0:1788263368.260727:0:15075:0:(genops.c:885:class_export_put()) final put ffff9ff3876cf800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788263368.260742:0:15075:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788263368.260746:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788263368.260755:0:15075:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788263368.260759:0:15075:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9ff3876b3370) has no exports 00000020:00000080:3.0:1788263368.260959:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3876cf800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1788263368.261247:0:15075:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788263368.261392:0:15075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f332 00000020:00000080:0.0:1788263368.261399:0:15075:0:(genops.c:885:class_export_put()) final put ffff9ff283243800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788263368.261446:0:15075:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788263368.261451:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788263368.261462:0:15075:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788263368.261465:0:15075:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9ff2832299b8) has no exports 00000020:00000080:0.0:1788263368.261472:0:15075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f32b 00000020:00000080:0.0:1788263368.261477:0:15075:0:(genops.c:885:class_export_put()) final put ffff9ff283243000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788263368.262608:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff283243800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1788263368.263648:0:15075:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788263368.263655:0:15075:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788263368.263658:0:15075:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1788263368.263665:0:15075:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788263368.263668:0:15075:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788263368.263702:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788263368.263715:0:15075:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788263368.263722:0:15075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f1f0 00000020:00000080:0.0:1788263368.263740:0:15075:0:(genops.c:885:class_export_put()) final put ffff9ff281faa000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788263368.263746:0:15075:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788263368.263750:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788263368.263755:0:15075:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788263368.263759:0:15075:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9ff3af7e0000) has no exports 00000020:00000080:0.0:1788263368.263925:0:15075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f1e9 00000020:00000080:0.0:1788263368.263939:0:15075:0:(genops.c:885:class_export_put()) final put ffff9ff3af7dd800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788263368.264687:0:15075:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788263368.264692:0:15075:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788263368.264695:0:15075:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1788263368.264700:0:15075:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788263368.264701:0:15075:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788263368.264733:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788263368.264743:0:15075:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1788263368.264758:0:15075:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788263368.264941:0:15075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f0a0 00000020:00000080:0.0:1788263368.264947:0:15075:0:(genops.c:885:class_export_put()) final put ffff9ff3ae4a7800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788263368.264953:0:15075:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1788263368.264958:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788263368.264963:0:15075:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788263368.264966:0:15075:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9ff3bc6b0000) has no exports 00000020:00000080:0.0:1788263368.264971:0:15075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f099 00000020:00000080:0.0:1788263368.264975:0:15075:0:(genops.c:885:class_export_put()) final put ffff9ff3bd2de000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788263368.265214:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff283243000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788263368.265904:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff283242000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788263368.265914:0:8:0:(genops.c:885:class_export_put()) final put ffff9ff283246000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788263368.265917:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff283246000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788263368.265923:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788263368.266052:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff281faa000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788263368.266058:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3af7dd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788263368.266063:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff3af7d8800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788263368.266068:0:8:0:(genops.c:885:class_export_put()) final put ffff9ff3af7d9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788263368.266070:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3af7d9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788263368.266074:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788263368.266119:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3ae4a7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788263368.266124:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3bd2de000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788263368.275644:0:15075:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788263368.275653:0:15075:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788263368.275659:0:15075:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1788263368.275668:0:15075:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788263368.275725:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788263368.275738:0:15075:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788263368.275785:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788263368.275789:0:15075:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788263368.275795:0:15075:0:(genops.c:885:class_export_put()) final put ffff9ff38769b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788263368.275799:0:15075:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff38769b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788263368.275813:0:15075:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788263368.275912:0:15075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666ef03 00000020:00000080:1.0:1788263368.275939:0:15075:0:(genops.c:885:class_export_put()) final put ffff9ff3876cc000/lustre-MDD0000_UUID 00000020:01000000:1.0:1788263368.275945:0:15075:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788263368.275949:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788263368.275954:0:15075:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788263368.275957:0:15075:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9ff3876b4d28) has no exports 00000020:00000080:1.0:1788263368.275977:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788263368.275981:0:15075:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788263368.275986:0:15075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666ef0a 00000020:00000080:1.0:1788263368.275990:0:15075:0:(genops.c:885:class_export_put()) final put ffff9ff3876cd800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788263368.275998:0:15075:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ff3888e6000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788263368.276001:0:15075:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ff3888e6000 3 00000020:01000004:1.0:1788263368.276004:0:15075:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ff3888e6000 from lustre-MDT0000 00000020:00000080:1.0:1788263368.276024:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788263368.276028:0:15075:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788263368.276030:0:15075:0:(genops.c:885:class_export_put()) final put ffff9ff38769d800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788263368.276032:0:15075:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff38769d800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788263368.276051:0:15075:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788263368.276083:0:15075:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788263368.276087:0:15075:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788263368.276090:0:15075:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788263368.276092:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788263368.276094:0:15075:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788263368.276111:0:15075:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9ff383778000 15f48257-b19e-4792-92d2-a48eb49d0ad1 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788263368.276116:0:15075:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9ff3b3a63370) has exports, disconnecting them 00000020:00080000:1.0:1788263368.276120:0:15075:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9ff383778000), last request at 1788263105 00000020:00000080:1.0:1788263368.276135:0:15075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666eea8 00000020:00010000:1.0:1788263368.276138:0:15075:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ff383778000: total 2 00000100:00080000:1.0:1788263368.276142:0:15075:0:(import.c:65:import_set_state_nolock()) ffff9ff39ab1d800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788263368.276157:0:15075:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ff383778000): rc 0 00000020:00080000:1.0:1788263368.276160:0:15075:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9ff3b3a63370) has no exports 00000020:00010000:1.0:1788263368.276171:0:6479:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ff383778000: total 2 00010000:00010000:1.0:1788263368.276196:0:6479:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ff383778000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788263368.276232:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff380031800/0x4b1103cba666efa4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b1103cba666ef9d expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263368.276267:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3829e8400/0x4b1103cba666f3be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b1103cba666f3b7 expref: 13 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263368.276279:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff381680e00/0x4b1103cba666efb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b1103cba666efab expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263368.276291:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3bd17fc00/0x4b1103cba666f420 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b1103cba666f419 expref: 11 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263368.276300:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3ae764e00/0x4b1103cba666f657 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b1103cba666f650 expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263368.276309:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3829e9800/0x4b1103cba666f3cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b1103cba666f3c5 expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263368.276328:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3bd17e800/0x4b1103cba666f649 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b1103cba666f642 expref: 8 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263368.276340:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3ae764600/0x4b1103cba666f3e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b1103cba666f3e1 expref: 7 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263368.276349:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff282f5c600/0x4b1103cba666f466 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b1103cba666f45f expref: 6 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263368.276357:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3ae764a00/0x4b1103cba666f665 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b1103cba666f65e expref: 5 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263368.276369:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff282f5c000/0x4b1103cba666f3f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b1103cba666f3ef expref: 4 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263368.276392:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3ae765600/0x4b1103cba666f2c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b1103cba666f2c2 expref: 3 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263368.276404:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3829e9200/0x4b1103cba666f412 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b1103cba666f40b expref: 2 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263368.276414:0:6479:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ff383778000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1788263368.276429:0:6479:0:(genops.c:885:class_export_put()) final put ffff9ff383778000/15f48257-b19e-4792-92d2-a48eb49d0ad1 00010000:00010000:1.0:1788263368.276434:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263368.276436:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263368.276438:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788263368.276754:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff3bd2d9000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788263368.276762:0:8:0:(genops.c:885:class_export_put()) final put ffff9ff3ae4cf000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788263368.276764:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3ae4cf000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788263368.276781:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788263368.276855:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3876cc000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788263368.276859:0:8:0:(genops.c:885:class_export_put()) final put ffff9ff387698000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788263368.276860:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff387698000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788263368.276864:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788263368.276891:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3876cd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788263368.276895:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff383778000/15f48257-b19e-4792-92d2-a48eb49d0ad1 for MGS 00000020:00000080:3.0:1788263368.276920:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff39ab1d800 for MGS 00000100:00100000:1.0:1788263368.278677:0:6484:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9ff384e37000:6484] 0 exiting: rc = 1 00000100:00100000:1.0:1788263368.278804:0:6485:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9ff384e37c00:6485] 1 exiting: rc = 0 00000100:00100000:1.0:1788263368.280700:0:6486:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9ff398ef1c00:6486] 2 exiting: rc = 0 00000100:00100000:0.0:1788263368.300734:0:8424:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9ff281783200:8424] 3 exiting: rc = 0 00000100:00100000:1.0:1788263368.301014:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301022:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301029:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301034:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301051:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301059:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301064:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301070:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301076:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301082:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301088:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301094:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301100:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301106:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301111:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301117:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301122:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301142:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301148:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301154:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301159:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301167:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301172:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301178:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301184:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301191:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301198:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301204:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301210:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301216:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301222:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301228:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301233:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301239:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301244:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301249:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301268:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301275:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301280:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301285:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301290:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301296:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301300:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301305:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301310:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301315:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301331:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301337:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301343:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301349:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301353:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301358:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301370:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301375:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301380:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301385:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301390:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301395:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301400:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301405:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301410:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301415:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301420:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263368.301425:0:15075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1788263368.303179:0:15075:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ff2830e0060 - data ffff9ff3b8b43288/ffff9ff282143400 00000020:01000000:1.0:1788263368.303315:0:15075:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ff398ca4660 - data ffff9ff3b8895ca8/ffff9ff3b3a58800 00000020:00000080:1.0:1788263368.304737:0:15075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666ee8c 00000020:00000080:1.0:1788263368.304748:0:15075:0:(genops.c:885:class_export_put()) final put ffff9ff3b0060800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788263368.304905:0:15075:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ff3888e6000 from MGS, refs=2 00000020:01000004:1.0:1788263368.304909:0:15075:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ff3888e6000 2 00000020:01000004:1.0:1788263368.304912:0:15075:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ff3888e6000 from MGS 00000020:00000080:1.0:1788263368.304949:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788263368.304956:0:15075:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788263368.304959:0:15075:0:(genops.c:885:class_export_put()) final put ffff9ff390445000/MGS 00000020:00000080:1.0:1788263368.304961:0:15075:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff390445000/MGS for MGS 00000020:01000000:1.0:1788263368.304968:0:15075:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788263368.305036:0:15075:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788263368.305102:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788263368.305109:0:15075:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788263368.305116:0:15075:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9ff3843ff800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788263368.305121:0:15075:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9ff3b3a60000) has exports, disconnecting them 00000020:00080000:1.0:1788263368.305125:0:15075:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9ff3843ff800), last request at 1788263105 00000020:00000080:1.0:1788263368.305129:0:15075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666ef57 00000020:00080000:1.0:1788263368.305140:0:15075:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ff3843ff800): rc 0 00000020:00000080:1.0:1788263368.305155:0:15075:0:(genops.c:885:class_export_put()) final put ffff9ff3843ff800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788263368.305996:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3b0060800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788263368.309436:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3843ff800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788263368.309638:0:15075:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788263368.309643:0:15075:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788263368.309647:0:15075:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788263368.309652:0:15075:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788263368.309843:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788263368.309851:0:15075:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788263368.309859:0:15075:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ff3888e6000 1 00000020:00000080:0.0:1788263368.309866:0:15075:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666ee7e 00000020:00000080:0.0:1788263368.309884:0:15075:0:(genops.c:885:class_export_put()) final put ffff9ff385660000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788263368.309889:0:15075:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788263368.309893:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788263368.309898:0:15075:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788263368.309901:0:15075:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9ff3b3a619b8) has no exports 00000020:00000080:3.0:1788263368.312492:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff3851c2000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788263368.312508:0:37:0:(genops.c:885:class_export_put()) final put ffff9ff3843fa000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788263368.312511:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3843fa000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788263368.312530:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788263368.312646:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff385660000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788263368.386954:0:15075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788263368.386967:0:15075:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788263368.386973:0:15075:0:(genops.c:885:class_export_put()) final put ffff9ff390441000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788263368.386978:0:15075:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff390441000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788263368.386985:0:15075:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788263368.387103:0:15075:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ff383965800 00000020:02000400:3.0:1788263368.387163:0:15075:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788263368.490456:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263369.525667:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788263370.287717:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788263370.287723:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788263370.287726:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ff3ad8e1000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788263370.287733:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 374 00000100:00080000:2.0:1788263370.287738:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788263370.287744:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ff3ad8e1000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263370.287768:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff398740000 x1875129709796736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788263370.287785:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398740e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709796608:0@lo:400:kworker.0 00000100:00080000:2.0:1788263370.287787:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788263370.287794:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788263370.287795:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ff3c041a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788263370.287799:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 374 00000100:00080000:2.0:1788263370.287802:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788263370.287805:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9ff3c041a000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263370.287820:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff398742a00 x1875129709796864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788263370.287830:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788263370.287834:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788263370.287836:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ff3bd5bf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000400:00000100:1.0:1788263370.287840:0:3619:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875129709796608 offset 0 length 224: 4 00000100:00080000:2.0:1788263370.287843:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 374 00000100:00080000:2.0:1788263370.287848:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788263370.287852:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ff3bd5bf000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263370.287866:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff398742d80 x1875129709796992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788263370.287912:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709797120:0@lo:400:kworker.0 00000100:00080000:2.0:1788263370.287931:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788263370.287935:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788263370.287936:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ff3851c6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788263370.287940:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 374 00000100:00080000:2.0:1788263370.287943:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788263370.287947:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ff3851c6800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263370.287960:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff398741500 x1875129709797376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788263370.288006:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709797504:0@lo:400:kworker.0 00000100:00100000:2.0:1788263370.288044:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263370.288070:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263370.288077:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709797632:0@lo:400:kworker.0 00000100:00100000:1.0:1788263370.288097:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263370.288113:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263370.288123:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263370.288130:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709797248:0@lo:400:kworker.0 00000100:00100000:2.0:1788263370.288151:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709796736:0@lo:38:kworker.0 00000100:00100000:1.0:1788263370.288157:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263370.288194:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263370.288205:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709797504 00000100:00100000:1.0:1788263370.288212:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709797504 00000100:00100000:2.0:1788263370.288220:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875129709796864:0@lo:38:kworker.0 00000100:00100000:1.0:1788263370.288258:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709797120 00000100:00100000:1.0:1788263370.288262:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709797120 00000100:00100000:2.0:1788263370.288264:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263370.288287:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709796864 00000100:00100000:2.0:1788263370.288291:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875129709796992:0@lo:38:kworker.0 00000100:00100000:1.0:1788263370.288291:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709796864 00000100:00100000:1.0:1788263370.288308:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1788263370.288317:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875129709797504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263370.288324:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263370.288338:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875129709797376:0@lo:38:kworker.0 00000100:00100000:2.0:1788263370.288374:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263370.288381:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875129709797504:12345-0@lo:400:kworker.0 Request processed in 64us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263370.288388:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1788263370.288406:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709797632 00000100:00100000:1.0:1788263370.288408:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709796992 00000100:00100000:2.0:1788263370.288412:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709797632 00000100:00100000:1.0:1788263370.288414:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709796992 00000100:00100000:1.0:1788263370.288427:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709797376 00000100:00100000:1.0:1788263370.288429:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709797376 00000100:00100000:1.0:1788263370.288448:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1788263370.288455:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709797120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263370.288456:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709797248 00000100:00100000:2.0:1788263370.288469:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709797248 00000100:00100000:2.0:1788263370.288507:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788263370.288511:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709797120:12345-0@lo:400:kworker.0 Request processed in 55us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263370.288519:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398743100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709797632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263370.288529:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1788263370.288545:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788263370.288549:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875129709796864:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788263370.288564:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398743100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709797632:12345-0@lo:400:kworker.0 Request processed in 48us (452us total) trans 0 rc 0/0 00010000:00020000:1.0:1788263370.288568:0:6492:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788263370.288576:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788263370.288615:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788263370.288625:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709797248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263370.288631:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875129709796864:12345-0@lo:38:kworker.0 Request processed in 78us (367us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788263370.288637:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788263370.288651:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788263370.288656:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875129709796992:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788263370.288666:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709797248:12345-0@lo:400:kworker.0 Request processed in 43us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263370.288672:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788263370.288692:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709796736 00000100:00100000:2.0:1788263370.288695:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709796736 00000100:00100000:2.0:1788263370.288714:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788263370.288718:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875129709796736:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788263370.288729:0:6496:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788263370.288756:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875129709796736:12345-0@lo:38:kworker.0 Request processed in 36us (563us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788263370.288762:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788263370.288780:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788263370.288784:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875129709797376:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788263370.288793:0:6491:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788263370.288816:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875129709797376:12345-0@lo:38:kworker.0 Request processed in 31us (443us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788263370.288822:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:2.0:1788263370.288861:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3ad8e1000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788263370.288875:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788263370.288882:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709796736:0@lo:38:kworker.0 00010000:00020000:1.0:1788263370.288882:0:6492:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1788263370.288900:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3c041a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788263370.288904:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788263370.288909:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875129709796864:0@lo:38:kworker.0 00000100:00100000:1.0:1788263370.288926:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875129709796992:12345-0@lo:38:kworker.0 Request processed in 257us (594us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788263370.288934:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:2.0:1788263370.288936:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3bd5bf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788263370.288942:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788263370.288945:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875129709796992:0@lo:38:kworker.0 00000100:00080000:2.0:1788263370.288956:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3851c6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788263370.288959:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788263370.288964:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875129709797376:0@lo:38:kworker.0 00000100:00080000:1.0:1788263370.288965:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788263370.288972:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788263370.288976:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788263370.289011:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709797248:0@lo:400:kworker.0 00010000:00080000:1.0:1788263370.289022:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9ff398741c00 x1875129709797120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263370.289031:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709797120:0@lo:400:kworker.0 00000100:00100000:1.0:1788263370.289057:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709797632:0@lo:400:kworker.0 00010000:00080000:1.0:1788263370.289067:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9ff398741180 x1875129709797504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263370.289076:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709797504:0@lo:400:kworker.0 00010000:00010000:1.0:1788263370.545293:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263370.801294:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709797760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788263370.801370:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263370.801663:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709797760 00000100:00100000:2.0:1788263370.801743:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709797760 00000100:00100000:2.0:1788263370.801872:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788263370.801883:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709797760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788263370.801924:0:8408:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788263370.805107:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709797760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3216us (3726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263370.805122:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788263370.815413:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709797760:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788263371.311781:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709797888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788263371.311847:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263371.311975:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709797888 00000100:00100000:2.0:1788263371.311983:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709797888 00000100:00100000:2.0:1788263371.312033:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788263371.312042:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709797888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788263371.312072:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788263371.318020:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709797888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5969us (6162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263371.318043:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788263371.318165:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709797888:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788263371.574836:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788263372.026472:0:15277:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788263372.048116:0:15277:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788263372.048173:0:15277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f40b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f412 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263372.048187:0:15277:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f40b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f412 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263372.048194:0:15277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f40b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f412 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263372.048200:0:15277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f40b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f412 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263372.048219:0:15277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788263372.048223:0:15277:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1788263372.048246:0:9492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263372.048253:0:9492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f40b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f412 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263372.048260:0:9492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17f000 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:1.0:1788263372.048263:0:9492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f40b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f412 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263372.048289:0:9492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f40b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b1103cba666f412 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263372.048296:0:9492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f40b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b1103cba666f412 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263372.048301:0:9492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788263372.048304:0:9492:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788263372.048306:0:9492:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788263372.048340:0:9492:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f40b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666f412 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263372.048346:0:9492:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263372.048370:0:9492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f40b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666f412 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263372.048377:0:9492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17f000/0x4b1103cba666f40b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666f412 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263372.048387:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263372.048389:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263372.048391:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263372.048408:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709798016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788263372.048468:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263372.048552:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709798016 00000100:00100000:1.0:1788263372.048558:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709798016 00000100:00100000:1.0:1788263372.048630:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788263372.048637:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3618:x1875129709798016:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788263372.048643:0:6477:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788263372 with bad export cookie 5409108800653684392 00000100:00080000:3.0:1788263372.054437:0:15277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788263372.054446:0:15277:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788263372.054454:0:15277:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788263372.054460:0:15277:0:(import.c:65:import_set_state_nolock()) ffff9ff3c041a000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788263372.054465:0:15277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788263372.054467:0:15277:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788263372.054470:0:15277:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788263372.056437:0:15277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f419 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f420 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.056456:0:15277:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f419 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f420 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.056481:0:15277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f419 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f420 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.056574:0:15277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f419 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f420 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.056625:0:15277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263372.056632:0:15277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f2c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f2c9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.056640:0:15277:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f2c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f2c9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.056647:0:15277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f2c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f2c9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.056654:0:15277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f2c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f2c9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.056666:0:15277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788263372.056672:0:15277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764c00/0x4b1103cba666f65e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f665 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.056678:0:15277:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764c00/0x4b1103cba666f65e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f665 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.056684:0:15277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764c00/0x4b1103cba666f65e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f665 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.056700:0:15277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764c00/0x4b1103cba666f65e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f665 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.056712:0:15277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788263372.056718:0:15277:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eec400/0x4b1103cba666efab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666efb2 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.056725:0:15277:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eec400/0x4b1103cba666efab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666efb2 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.056731:0:15277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eec400/0x4b1103cba666efab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666efb2 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.056737:0:15277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9ff398eec400/0x4b1103cba666efab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666efb2 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.056744:0:15277:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788263372.056747:0:15277:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1788263372.056779:0:15277:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1788263372.056783:0:15277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1788263372.056787:0:15277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788263372.056793:0:15277:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788263372.056800:0:15277:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9ff3bf62d000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788263372.056805:0:15277:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9ff281e05800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788263372.056810:0:15277:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9ff3b002b370) has exports, disconnecting them 00000020:00080000:3.0:1788263372.056815:0:15277:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9ff3bf62d000), last request at 1788263370 00000020:00000080:3.0:1788263372.056822:0:15277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f28a 00000100:00080000:3.0:1788263372.056838:0:15277:0:(import.c:65:import_set_state_nolock()) ffff9ff3bf62b000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788263372.056893:0:15277:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ff3bf62d000): rc 0 00000020:00000080:3.0:1788263372.056896:0:15277:0:(genops.c:885:class_export_put()) final put ffff9ff3bf62d000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1788263372.056918:0:15277:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9ff281e05800), last request at 1788263370 00000020:00000080:3.0:1788263372.056921:0:15277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f164 00000100:00080000:3.0:1788263372.056928:0:15277:0:(import.c:65:import_set_state_nolock()) ffff9ff281e04000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788263372.056934:0:15277:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ff281e05800): rc 0 00000020:00000080:3.0:1788263372.056936:0:15277:0:(genops.c:885:class_export_put()) final put ffff9ff281e05800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1788263372.056942:0:15277:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffad45c14d3ae0 00000100:00080000:3.0:1788263372.056958:0:15277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788263372.056967:0:15277:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9ff28414bb80 x1875129709794560/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788263379 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263372.056981:0:15277:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1788263372.061277:0:15277:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788263372.061288:0:15277:0:(import.c:65:import_set_state_nolock()) ffff9ff3ad8e1000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000020:00000080:3.0:1788263372.061356:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3bf62d000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788263372.061418:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff281e05800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788263372.061442:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff3bf62b000 for lustre-MDT0001 00000020:00000080:3.0:1788263372.061446:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff281e04000 for lustre-MDT0001 00010000:00010000:3.0:1788263372.061458:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788263372.061465:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f419 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f420 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.061476:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9600 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:3.0:1788263372.061480:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f419 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f420 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.061490:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b1103cba666f420 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263372.061516:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b1103cba666f420 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263372.061522:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788263372.061524:0:6480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1788263372.061527:0:6480:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1788263372.061563:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f419 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666f420 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.061569:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263372.061608:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f419 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666f420 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.061616:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9600/0x4b1103cba666f419 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666f420 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.061628:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788263372.061631:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f2c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f2c9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.061637:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9a00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:3.0:1788263372.061640:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f2c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f2c9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.061646:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f2c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b1103cba666f2c9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263372.061651:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f2c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b1103cba666f2c9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263372.061665:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788263372.061668:0:6480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788263372.061670:0:6480:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788263372.061684:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f2c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666f2c9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.061690:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263372.061701:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f2c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666f2c9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.061707:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9a00/0x4b1103cba666f2c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666f2c9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.061718:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788263372.061722:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764c00/0x4b1103cba666f65e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f665 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.061728:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae764c00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:3.0:1788263372.061731:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764c00/0x4b1103cba666f65e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f665 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.061737:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764c00/0x4b1103cba666f65e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b1103cba666f665 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263372.061743:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764c00/0x4b1103cba666f65e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b1103cba666f665 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263372.061748:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788263372.061750:0:6480:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788263372.061752:0:6480:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788263372.061771:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764c00/0x4b1103cba666f65e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666f665 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.061777:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263372.061783:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764c00/0x4b1103cba666f65e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666f665 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.061789:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764c00/0x4b1103cba666f65e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666f665 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.061799:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263372.061803:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff398eec400/0x4b1103cba666efab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666efb2 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.061809:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eec400 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:3.0:1788263372.061811:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eec400/0x4b1103cba666efab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666efb2 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.061818:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff398eec400/0x4b1103cba666efab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b1103cba666efb2 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263372.061825:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eec400/0x4b1103cba666efab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b1103cba666efb2 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263372.061830:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788263372.061832:0:6480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788263372.061834:0:6480:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788263372.061844:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff398eec400/0x4b1103cba666efab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666efb2 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.061850:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263372.061856:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff398eec400/0x4b1103cba666efab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666efb2 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.061868:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff398eec400/0x4b1103cba666efab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b1103cba666efb2 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263372.061879:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263372.061881:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263372.061882:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263372.061889:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263372.061917:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709798272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788263372.061984:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263372.062027:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788263372.062034:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709798400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788263372.062055:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788263372.062078:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263372.062664:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709798272 00000100:00100000:3.0:1788263372.062673:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709798272 00000100:00100000:3.0:1788263372.062706:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709798400 00000100:00100000:3.0:1788263372.062709:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709798400 00000100:00100000:2.0:1788263372.063082:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788263372.063090:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3c0457450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3620:x1875129709798272:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788263372.063107:0:6476:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788263372 with bad export cookie 5409108800653684392 00000100:00100000:2.0:1788263372.063276:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3c0457450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3620:x1875129709798272:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (1291us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788263372.063284:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788263372.063320:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.126@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788263372.063324:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9ff3a0ec6800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788263372.063328:0:3620:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1788263372.064327:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788263372.064335:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283989c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3620:x1875129709798400:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788263372.064342:0:6478:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788263372 with bad export cookie 5409108800653684392 00000100:00100000:3.0:1788263372.064394:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283989c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3620:x1875129709798400:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (2337us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788263372.064400:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788263372.066262:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28414bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709794560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788263372.071096:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3618:x1875129709798016:12345-0@lo:103:ldlm_bl.0 Request processed in 22450us (22620us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788263372.071112:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788263372.073385:0:15277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788263372.073391:0:15277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:3.0:1788263372.073409:0:15277:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788263372.073485:0:15277:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788263372.073521:0:15277:0:(import.c:65:import_set_state_nolock()) ffff9ff387647000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788263372.073537:0:15277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788263372.073540:0:15277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1788263372.073548:0:15277:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788263372.073626:0:15277:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788263372.073635:0:15277:0:(import.c:65:import_set_state_nolock()) ffff9ff3bf665000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788263372.073660:0:15277:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9ff3b002b370) has no exports 00000100:00100000:3.0:1788263372.073704:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709798656:0@lo:9:umount.0 00000100:00100000:3.0:1788263372.073766:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263372.073800:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709798784:0@lo:9:umount.0 00000100:00100000:3.0:1788263372.073823:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263372.073878:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709798656 00000100:00100000:3.0:1788263372.073885:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709798656 00000100:00100000:3.0:1788263372.073945:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709798784 00000100:00100000:3.0:1788263372.073948:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709798784 00000100:00100000:3.0:1788263372.073972:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788263372.073981:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283989500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1875129709798656:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788263372.074005:0:14442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f1b1 00000100:00080000:3.0:1788263372.074012:0:14442:0:(import.c:65:import_set_state_nolock()) ffff9ff3af759000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788263372.074050:0:14442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788263372.074189:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283989500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3617:x1875129709798656:12345-0@lo:9:umount.0 Request processed in 208us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263372.074197:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788263372.074213:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788263372.074219:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1875129709798784:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788263372.074229:0:14442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f301 00000100:00080000:3.0:1788263372.074235:0:14442:0:(import.c:65:import_set_state_nolock()) ffff9ff3bc674800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788263372.074263:0:14442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788263372.074352:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3617:x1875129709798784:12345-0@lo:9:umount.0 Request processed in 133us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263372.074359:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:3.0:1788263372.074377:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263372.074383:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788263372.074408:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff387647000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788263372.074417:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788263372.074419:0:3617:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788263372.074422:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709798656:0@lo:9:umount.0 00000100:00080000:3.0:1788263372.074433:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3bf665000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788263372.074439:0:3617:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788263372.074441:0:3617:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788263372.074443:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709798784:0@lo:9:umount.0 00000100:00080000:2.0:1788263372.094340:0:3620:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.126@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788263372.094347:0:3620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788263372.094357:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ff398740e00 x1875129709796608/t0(0) o400->MGC192.168.203.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788263386 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263372.094371:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ff2833e2680 x1875129709798016/t0(0) o103->MGC192.168.203.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788263388 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263372.094382:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ff28398aa00 x1875129709798272/t0(0) o103->MGC192.168.203.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788263388 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263372.094391:0:3620:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ff283988a80 x1875129709798400/t0(0) o103->MGC192.168.203.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788263388 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788263372.094399:0:3620:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788263372.094401:0:3620:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788263372.094402:0:3620:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788263372.094465:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:0:1875129709798144:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788263372.094492:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788263372.094497:0:6487:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263372.094517:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398740e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:15f48257-b19e-4792-92d2-a48eb49d0ad1:3619:1875129709796608:0@lo:400:kworker.0 00000100:00100000:0.0:1788263372.096371:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:0:1875129709798528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263372.096393:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:15f48257-b19e-4792-92d2-a48eb49d0ad1:3618:1875129709798016:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788263372.097716:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9ff3a0ec6800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788263372.097727:0:3620:0:(import.c:510:import_select_connection()) MGC192.168.203.126@tcp: connect to NID 0@lo last attempt 114 00000100:00080000:2.0:1788263372.097736:0:3620:0:(import.c:624:import_select_connection()) MGC192.168.203.126@tcp: import ffff9ff3a0ec6800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788263372.098035:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff28398bb80 x1875129709798912/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788263372.098091:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709798400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788263372.098107:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:15f48257-b19e-4792-92d2-a48eb49d0ad1:3620:1875129709798272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263372.098338:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:15f48257-b19e-4792-92d2-a48eb49d0ad1:3617:1875129709798912:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1788263372.098383:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875129709798912 offset 0 length 520: 4 00000020:00080000:0.0:1788263372.115513:0:15277:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9ff3b002b370) has no exports 00000020:01000000:2.0:1788263372.179453:0:15277:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ff2830e0600 - data ffff9ff3b8a681b0/ffff9ff282141400 00000020:01000000:2.0:1788263372.179711:0:15277:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ff3b39d41e0 - data ffff9ff3b892b438/ffff9ff3ae22d800 00000001:00000004:2.0:1788263372.197778:0:15277:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1788263372.267023:0:15277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788263372.267031:0:15277:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788263372.267040:0:15277:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788263372.273168:0:15277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788263372.273175:0:15277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:1.0:1788263372.273194:0:15277:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788263372.273196:0:15277:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788263372.274686:0:8605:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788263372.274693:0:8605:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:2.0:1788263372.274706:0:8605:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788263372.275519:0:15277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788263372.275525:0:15277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:1.0:1788263372.275813:0:15277:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788263372.275817:0:15277:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788263372.280058:0:9883:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788263372.280065:0:9883:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1788263372.280080:0:9883:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788263372.281971:0:15277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666efce 00000020:00000080:1.0:1788263372.281982:0:15277:0:(genops.c:885:class_export_put()) final put ffff9ff3ad8e7000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788263372.282756:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3ad8e7000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788263372.284500:0:15277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666efe3 00000020:00000080:1.0:1788263372.284513:0:15277:0:(genops.c:885:class_export_put()) final put ffff9ff3ad8e6000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788263372.284521:0:15277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1788263372.284526:0:15277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788263372.284534:0:15277:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788263372.284538:0:15277:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9ff3b00299b8) has no exports 00000020:00000080:2.0:1788263372.284731:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3ad8e6000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:1.0:1788263372.284873:0:15277:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788263372.284881:0:15277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f2ec 00000020:00000080:1.0:1788263372.284886:0:15277:0:(genops.c:885:class_export_put()) final put ffff9ff3bf667000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788263372.284908:0:15277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788263372.284912:0:15277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788263372.284919:0:15277:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788263372.284922:0:15277:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9ff3bc6b3370) has no exports 00000020:00000080:1.0:1788263372.284927:0:15277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f2e5 00000020:00000080:1.0:1788263372.284931:0:15277:0:(genops.c:885:class_export_put()) final put ffff9ff3bf663000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788263372.284974:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3bf667000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788263372.284982:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3bf663000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788263372.285517:0:15277:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788263372.285521:0:15277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788263372.285526:0:15277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1788263372.285531:0:15277:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788263372.285533:0:15277:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788263372.285573:0:15277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788263372.285697:0:15277:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788263372.285704:0:15277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f1aa 00000020:00000080:1.0:1788263372.285710:0:15277:0:(genops.c:885:class_export_put()) final put ffff9ff281fab000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788263372.285714:0:15277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788263372.285718:0:15277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788263372.285722:0:15277:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788263372.285725:0:15277:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9ff3b0050000) has no exports 00000020:00000080:1.0:1788263372.285730:0:15277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f1a3 00000020:00000080:1.0:1788263372.285733:0:15277:0:(genops.c:885:class_export_put()) final put ffff9ff387643000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788263372.286697:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff3bf665000 for lustre-OST0001-osc-MDT0001 00010000:01000000:1.0:1788263372.286705:0:15277:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000020:00000080:2.0:1788263372.286707:0:8:0:(genops.c:885:class_export_put()) final put ffff9ff3bf666800/lustre-MDT0001-mdtlov_UUID 00000100:00080000:1.0:1788263372.286708:0:15277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000020:00000080:2.0:1788263372.286709:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3bf666800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000100:00100000:1.0:1788263372.286711:0:15277:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:1.0:1788263372.286715:0:15277:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788263372.286717:0:15277:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:01000000:2.0:1788263372.286718:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788263372.286794:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff281fab000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788263372.286799:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff387643000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788263372.286803:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff387647000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788263372.286820:0:15277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788263372.286827:0:15277:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788263372.286831:0:15277:0:(genops.c:885:class_export_put()) final put ffff9ff281e01800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788263372.286833:0:15277:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff281e01800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788263372.286837:0:15277:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788263372.286896:0:15277:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788263372.286912:0:15277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f006 00000020:00000080:1.0:1788263372.286917:0:15277:0:(genops.c:885:class_export_put()) final put ffff9ff3bd2dd000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788263372.286973:0:15277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788263372.286977:0:15277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788263372.286982:0:15277:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788263372.286986:0:15277:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9ff3ad8eb370) has no exports 00000020:00000080:1.0:1788263372.287000:0:15277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666efff 00000020:00000080:1.0:1788263372.287003:0:15277:0:(genops.c:885:class_export_put()) final put ffff9ff3ad8e0000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788263372.289996:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3bd2dd000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788263372.290015:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3ad8e0000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788263372.291148:0:15277:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788263372.293937:0:15277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788263372.293942:0:15277:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788263372.293950:0:15277:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788263372.294009:0:15277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788263372.294021:0:15277:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788263372.294066:0:15277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788263372.294070:0:15277:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788263372.294075:0:15277:0:(genops.c:885:class_export_put()) final put ffff9ff3bc646800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788263372.294079:0:15277:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3bc646800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788263372.294086:0:15277:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788263372.294382:0:15277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666efea 00000020:00000080:0.0:1788263372.294391:0:15277:0:(genops.c:885:class_export_put()) final put ffff9ff3ad8e1800/lustre-MDD0001_UUID 00000020:01000000:0.0:1788263372.294396:0:15277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788263372.294400:0:15277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788263372.294406:0:15277:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788263372.294409:0:15277:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9ff3ad8e99b8) has no exports 00000020:00000080:0.0:1788263372.294436:0:15277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788263372.294440:0:15277:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788263372.294445:0:15277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666eff1 00000020:00000080:0.0:1788263372.294449:0:15277:0:(genops.c:885:class_export_put()) final put ffff9ff3ad8e4800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788263372.294457:0:15277:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ff38769d000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788263372.294460:0:15277:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ff38769d000 2 00000020:01000004:0.0:1788263372.294463:0:15277:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ff38769d000 from lustre-MDT0001 00000020:00000080:0.0:1788263372.294480:0:15277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788263372.294483:0:15277:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788263372.294486:0:15277:0:(genops.c:885:class_export_put()) final put ffff9ff3ad8e2000/lustre-MDT0001_UUID 00000020:00000080:0.0:1788263372.294488:0:15277:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3ad8e2000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788263372.294495:0:15277:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788263372.294526:0:15277:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788263372.294530:0:15277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788263372.294533:0:15277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788263372.294536:0:15277:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788263372.294543:0:15277:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9ff387642000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788263372.294548:0:15277:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9ff3b3a64d28) has exports, disconnecting them 00000020:00080000:0.0:1788263372.294553:0:15277:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9ff387642000), last request at 1788263123 00000020:00000080:0.0:1788263372.294557:0:15277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f045 00000020:00080000:0.0:1788263372.294574:0:15277:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ff387642000): rc 0 00000020:00000080:0.0:1788263372.294594:0:15277:0:(genops.c:885:class_export_put()) final put ffff9ff387642000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788263372.295425:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff3ad8e1000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788263372.295436:0:36:0:(genops.c:885:class_export_put()) final put ffff9ff3ad8e0800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788263372.295439:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3ad8e0800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1788263372.295445:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788263372.295546:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3ad8e1800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1788263372.295550:0:36:0:(genops.c:885:class_export_put()) final put ffff9ff3ad8e6800/lustre-MDD0001_UUID 00000020:00000080:2.0:1788263372.295561:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3ad8e6800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1788263372.295566:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1788263372.295758:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3ad8e4800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788263372.295762:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff387642000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1788263372.330383:0:15277:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1788263372.330392:0:15277:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788263372.330397:0:15277:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788263372.330415:0:15277:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788263372.330670:0:15277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788263372.330679:0:15277:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1788263372.330687:0:15277:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ff38769d000 1 00000020:00000080:0.0:1788263372.330698:0:15277:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666ef81 00000020:00000080:0.0:1788263372.330706:0:15277:0:(genops.c:885:class_export_put()) final put ffff9ff38769f800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1788263372.330712:0:15277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1788263372.330717:0:15277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788263372.330721:0:15277:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788263372.330725:0:15277:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9ff3b002cd28) has no exports 00000020:00000080:2.0:1788263372.330763:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff3c041a000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788263372.330773:0:36:0:(genops.c:885:class_export_put()) final put ffff9ff3c041c800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1788263372.330777:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3c041c800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1788263372.330791:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1788263372.330861:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff38769f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788263372.441820:0:15277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788263372.441835:0:15277:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1788263372.441841:0:15277:0:(genops.c:885:class_export_put()) final put ffff9ff38769f000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788263372.441845:0:15277:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff38769f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1788263372.441852:0:15277:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1788263372.442211:0:15277:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ff38769a000 00000020:01000000:2.0:1788263372.442289:0:15277:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788263372.442295:0:15277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788263372.442300:0:15277:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788263372.442303:0:15277:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9ff3b00519b8) has no exports 00000100:00100000:0.0:1788263372.442493:0:6491:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9ff3a0eec400:6491] 0 exiting: rc = 1 00000100:00100000:0.0:1788263372.442731:0:6493:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9ff3a0eede00:6493] 2 exiting: rc = 0 00000100:00100000:0.0:1788263372.442812:0:8884:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9ff282243600:8884] 3 exiting: rc = 0 00000100:00100000:3.0:1788263372.442927:0:10388:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9ff3ae578a00:10388] 4 exiting: rc = 0 00000100:00100000:3.0:1788263372.443161:0:6492:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9ff3b0059e00:6492] 1 exiting: rc = 0 00000100:00100000:0.0:1788263372.443259:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443268:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443275:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443281:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443286:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443292:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443297:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443303:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443309:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443315:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443320:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443326:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443331:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443336:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443341:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443347:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443352:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443357:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443362:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443367:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443373:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443387:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443393:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443399:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443404:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443410:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443415:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443421:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443427:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443432:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443437:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443443:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443449:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443454:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443460:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443466:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443472:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443478:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443483:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443488:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443493:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443499:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443505:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443510:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443516:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443520:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443526:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443531:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443554:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443562:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443567:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443573:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443608:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443614:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443619:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443624:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443640:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443644:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443649:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443654:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443659:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443664:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443668:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.443674:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.445947:0:6494:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9ff3b0f87000:6494] 0 exiting: rc = 1 00000100:00100000:3.0:1788263372.446050:0:6495:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9ff3b3a5ce00:6495] 1 exiting: rc = 0 00000100:00100000:0.0:1788263372.446665:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446674:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446679:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446686:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446692:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446698:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446705:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446710:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446717:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446724:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446730:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446737:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446744:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446749:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446755:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446761:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446766:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446771:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446776:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446781:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446786:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446791:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446796:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446801:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446806:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446811:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446816:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446833:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446838:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446843:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446849:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446854:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446859:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446865:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446872:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446876:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446882:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446887:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446892:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.446898:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.447649:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.447655:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.447661:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.447667:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.447672:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.447677:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.447683:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.447689:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.447694:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.447698:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.447703:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.447708:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.447713:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.447718:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.447724:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.447729:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.447734:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.447739:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.447744:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.447749:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.447754:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.447759:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.447771:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.447776:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.448608:0:13780:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9ff2833ba600:13780] 2 exiting: rc = 0 00000100:00100000:2.0:1788263372.449193:0:6497:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9ff3b3a5c000:6497] 1 exiting: rc = 0 00000100:00100000:1.0:1788263372.449743:0:6496:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9ff3b3a5de00:6496] 0 exiting: rc = 1 00000100:00100000:0.0:1788263372.450376:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450397:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450406:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450412:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450418:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450425:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450432:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450438:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450446:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450452:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450459:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450465:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450472:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450490:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450498:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450504:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450510:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450516:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450523:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450528:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450535:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450541:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450547:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450552:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450557:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450972:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450982:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450988:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.450995:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451001:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451006:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451013:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451019:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451035:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451041:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451047:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451053:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451071:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451077:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451083:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451089:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451096:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451101:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451107:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451114:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451121:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451127:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451133:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451139:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451157:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451163:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451169:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451175:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451182:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451187:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451193:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451199:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451205:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451211:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451217:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451223:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451241:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451247:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263372.451260:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263372.458107:0:6498:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9ff3b3a5d000:6498] 0 exiting: rc = 1 00000100:00100000:2.0:1788263372.458316:0:6499:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9ff3b3a5c600:6499] 1 exiting: rc = 0 00000100:00100000:3.0:1788263372.458410:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458417:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458422:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458427:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458442:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458448:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458453:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458459:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458464:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458468:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458473:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458478:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458483:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458488:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458493:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458498:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458504:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458509:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458514:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458519:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458524:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458529:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458534:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458540:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458544:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458549:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458554:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458559:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458563:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458568:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458573:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458605:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458611:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458617:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458622:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458628:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458633:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458638:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458643:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458654:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458659:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458664:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458669:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458674:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458679:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458684:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458689:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458693:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458698:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458703:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458708:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458713:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458718:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458722:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458727:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458731:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458735:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458739:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458744:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458749:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458754:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458759:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458764:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.458769:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459174:0:6501:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9ff3b3a5d200:6501] 1 exiting: rc = 0 00000100:00100000:1.0:1788263372.459368:0:6500:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9ff3b3a5d800:6500] 0 exiting: rc = 1 00000100:00100000:2.0:1788263372.459543:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459549:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459554:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459559:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459565:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459571:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459576:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459607:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459623:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459627:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459631:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459636:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459641:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459646:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459651:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459656:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459660:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459665:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459670:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459675:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459680:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459685:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459689:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459694:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459700:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459704:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459709:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459714:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459719:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459724:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459729:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459734:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459739:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459744:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459750:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459755:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459759:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459763:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459768:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459773:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459777:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459781:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459785:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459796:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459801:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459806:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459810:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459815:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459820:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459825:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459829:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459833:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459838:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459842:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459846:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459851:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459855:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459859:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459864:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459868:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459872:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459876:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459880:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.459884:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263372.460282:0:6503:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9ff3b3a5da00:6503] 1 exiting: rc = 0 00000100:00100000:1.0:1788263372.460448:0:6502:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9ff3b3a5c400:6502] 0 exiting: rc = 1 00000100:00100000:2.0:1788263372.460515:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460522:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460527:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460532:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460537:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460542:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460547:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460553:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460558:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460563:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460568:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460573:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460632:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460639:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460652:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460657:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460662:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460668:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460673:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460678:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460683:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460687:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460692:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460697:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460702:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460707:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460711:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460716:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460721:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460726:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460731:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460736:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460740:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460745:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460750:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460754:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460759:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460763:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460767:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460772:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460777:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460781:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460786:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460791:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460796:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460800:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460805:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460809:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460813:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460825:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460830:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460834:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460839:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460844:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460849:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460855:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460859:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460864:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460868:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460873:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460878:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460883:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460888:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.460893:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263372.461550:0:6504:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9ff3b3a5c200:6504] 0 exiting: rc = 1 00000100:00100000:2.0:1788263372.461825:0:6506:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9ff3c0445c00:6506] 2 exiting: rc = 0 00000100:00100000:3.0:1788263372.462084:0:6505:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9ff3c0444600:6505] 1 exiting: rc = 0 00000100:00100000:2.0:1788263372.462309:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462316:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462322:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462327:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462333:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462350:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462357:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462363:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462368:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462373:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462378:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462384:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462389:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462395:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462400:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462406:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462411:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462416:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462422:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462436:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462442:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462448:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462453:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462458:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462464:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462469:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462475:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462480:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462486:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462504:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462510:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462515:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462520:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462525:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462531:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462536:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462541:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462547:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462553:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462560:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462565:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462571:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462972:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462982:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462988:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.462993:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.463000:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.463005:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.463010:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.463016:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.463020:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.463025:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.463031:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.463051:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.463064:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.463070:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.463075:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.463081:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.463086:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.463092:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.463097:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.463103:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.463109:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263372.463113:0:15277:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788263372.467570:0:15277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788263372.467783:0:15277:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788263372.467789:0:15277:0:(genops.c:885:class_export_put()) final put ffff9ff3851c0800/MDS_uuid 00000020:00000080:2.0:1788263372.467794:0:15277:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3851c0800/MDS_uuid for MDS 00000020:01000000:2.0:1788263372.467799:0:15277:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788263372.467986:0:15277:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1788263372.595670:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263373.626636:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263374.639821:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788263375.408462:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 15f48257-b19e-4792-92d2-a48eb49d0ad1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788263375.408473:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 15f48257-b19e-4792-92d2-a48eb49d0ad1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788263375.408476:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788263375.408479:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788263375.408489:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ff3bd5bf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788263375.408508:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 379 00000100:00080000:3.0:1788263375.408513:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788263375.408519:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ff3bd5bf000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788263375.408556:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff28398aa00 x1875129709799040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788263375.408631:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788263375.408635:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788263375.408636:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ff3851c6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788263375.408640:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 379 00000100:00080000:3.0:1788263375.408642:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788263375.408645:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ff3851c6800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:1.0:1788263375.408645:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875129709799040:0@lo:38:kworker.0 00000100:00100000:3.0:1788263375.408656:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff28398b480 x1875129709799296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788263375.408697:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788263375.408709:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709799168:0@lo:400:kworker.0 00000400:00000100:1.0:1788263375.408709:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875129709799040 offset 0 length 520: 4 00000400:00000100:3.0:1788263375.408736:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875129709799168 offset 0 length 224: 4 00000100:00100000:1.0:1788263375.408755:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875129709799296:0@lo:38:kworker.0 00000100:00100000:3.0:1788263375.408758:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875129709799424:0@lo:400:kworker.0 00000400:00000100:1.0:1788263375.408771:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875129709799296 offset 0 length 520: 4 00000400:00000100:3.0:1788263375.408778:0:3620:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875129709799424 offset 0 length 224: 4 00010000:00010000:3.0:1788263375.664333:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788263376.254073:0:15478:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788263376.275123:0:15478:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788263376.275244:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8a00/0x4b1103cba666f3e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f3e8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263376.275273:0:15478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8a00/0x4b1103cba666f3e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f3e8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263376.275291:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8a00/0x4b1103cba666f3e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f3e8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263376.275299:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8a00/0x4b1103cba666f3e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f3e8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263376.275320:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788263376.275326:0:15478:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788263376.275351:0:15478:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788263376.275362:0:15478:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ff28398aa00 x1875129709799040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788263395 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788263376.275433:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263376.275440:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8a00/0x4b1103cba666f3e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f3e8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263376.275448:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e8a00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:2.0:1788263376.275452:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8a00/0x4b1103cba666f3e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f3e8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263376.275461:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8a00/0x4b1103cba666f3e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b1103cba666f3e8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263376.275468:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8a00/0x4b1103cba666f3e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b1103cba666f3e8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263376.275474:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788263376.275477:0:6479:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788263376.275486:0:6479:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788263376.275499:0:6479:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ff3a0ec6800 00010000:00010000:2.0:1788263376.275503:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8a00/0x4b1103cba666f3e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b1103cba666f3e8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263376.275510:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8a00/0x4b1103cba666f3e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b1103cba666f3e8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263376.275522:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263376.275523:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263376.275526:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263376.277784:0:15478:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788263376.278482:0:15478:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788263376.278490:0:15478:0:(import.c:65:import_set_state_nolock()) ffff9ff3bd5bf000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788263376.278497:0:15478:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788263376.278507:0:15478:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ff28398aa00 x1875129709799040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788263395 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263376.278518:0:15478:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788263376.278522:0:15478:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:1.0:1788263376.280001:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875129709799040:0@lo:38:kworker.0 00000100:00080000:2.0:1788263376.282501:0:15478:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788263376.282518:0:15478:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ff283988a80 x1875129709799168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263391 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263376.282549:0:15478:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788263376.282556:0:15478:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788263376.282661:0:15478:0:(import.c:65:import_set_state_nolock()) ffff9ff281faf800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788263376.282834:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709799168:0@lo:400:kworker.0 00000100:00100000:1.0:1788263376.283225:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1875129709799552:0@lo:39:umount.0 00000400:00000100:1.0:1788263376.283273:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875129709799552 offset 0 length 224: 4 00010000:00010000:0.0:1788263376.688320:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788263377.456041:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 15f48257-b19e-4792-92d2-a48eb49d0ad1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788263377.456051:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 15f48257-b19e-4792-92d2-a48eb49d0ad1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788263377.456053:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788263377.456056:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788263377.456143:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5472300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875129709799680:0@lo:400:kworker.0 00000400:00000100:0.0:1788263377.456198:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875129709799680 offset 0 length 224: 4 00010000:00010000:3.0:1788263377.712274:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788263377.972281:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788263377.972290:0:9482:0:(genops.c:885:class_export_put()) final put ffff9ff3bc673800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788263377.972377:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3bc673800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788263377.972437:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff3bc674800 for lustre-OST0001 00000001:00100000:3.0:1788263377.981290:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788263377.981300:0:8398:0:(genops.c:885:class_export_put()) final put ffff9ff3af75d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788263377.985318:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3af75d000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788263377.985388:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff3af759000 for lustre-OST0000 00010000:00010000:2.0:1788263378.735731:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263379.759811:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788263380.463740:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 15f48257-b19e-4792-92d2-a48eb49d0ad1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788263380.463753:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 15f48257-b19e-4792-92d2-a48eb49d0ad1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788263380.463756:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788263380.463760:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788263380.463900:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709799808:0@lo:400:kworker.0 00000400:00000100:3.0:1788263380.463964:0:3618:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875129709799808 offset 0 length 224: 4 00010000:00010000:3.0:1788263380.783993:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263381.807783:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263382.447713:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263372/real 1788263372] req@ffff9ff28398bb80 x1875129709798912/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788263382 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263382.447749:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ff28398bb80 x1875129709798912/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788263382 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788263382.447768:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3a0ec6800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788263382.447794:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788263382.447798:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:15f48257-b19e-4792-92d2-a48eb49d0ad1:3617:1875129709798912:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1788263382.447854:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 15f48257-b19e-4792-92d2-a48eb49d0ad1->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788263382.447861:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788263382.447863:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ff3a0ec6800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788263382.447869:0:36:0:(import.c:510:import_select_connection()) MGC192.168.203.126@tcp: connect to NID 0@lo last attempt 381 00000100:00080000:3.0:1788263382.447874:0:36:0:(import.c:589:import_select_connection()) MGC192.168.203.126@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788263382.447881:0:36:0:(import.c:624:import_select_connection()) MGC192.168.203.126@tcp: import ffff9ff3a0ec6800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788263382.447912:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff283988a80 x1875129709799936/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788263382.447942:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788263382.447946:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788263382.448049:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:15f48257-b19e-4792-92d2-a48eb49d0ad1:3617:1875129709799936:0@lo:250:kworker.0 00000400:00000100:1.0:1788263382.448096:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875129709799936 offset 0 length 520: 4 00000100:00100000:2.0:1788263382.448174:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709800064:0@lo:400:kworker.0 00000400:00000100:2.0:1788263382.448207:0:3619:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875129709800064 offset 0 length 224: 4 00010000:00010000:0.0:1788263382.831870:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263383.856870:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263384.879800:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263385.903819:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263386.547945:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263376/real 1788263376] req@ffff9ff3b5471c00 x1875129709799552/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788263386 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263386.547978:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ff3b5471c00 x1875129709799552/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788263386 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788263386.547998:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff281faf800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788263386.548014:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1875129709799552:0@lo:39:umount.0 00000100:00080000:2.0:1788263386.548181:0:15478:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788263386.548201:0:15478:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788263386.548206:0:15478:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788263386.549170:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f3ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f3f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263386.549185:0:15478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f3ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f3f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263386.549193:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f3ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f3f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263386.549199:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f3ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f3f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263386.549224:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263386.549231:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765400/0x4b1103cba666f650 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f657 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263386.549238:0:15478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765400/0x4b1103cba666f650 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f657 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263386.549244:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765400/0x4b1103cba666f650 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f657 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263386.549249:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765400/0x4b1103cba666f650 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f657 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263386.549267:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788263386.549271:0:15478:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788263386.549295:0:15478:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788263386.549299:0:15478:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788263386.549311:0:15478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788263386.549318:0:15478:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788263386.549322:0:15478:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9ff3b0053370) has no exports 00000020:00080000:2.0:1788263386.549348:0:15478:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9ff3b0053370) has no exports 00010000:00010000:0.0:1788263386.549493:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788263386.549501:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f3ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f3f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263386.549510:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bd17ec00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:0.0:1788263386.549514:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f3ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f3f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263386.549523:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f3ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b1103cba666f3f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263386.549531:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f3ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b1103cba666f3f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263386.549538:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788263386.549540:0:6479:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788263386.549543:0:6479:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788263386.549557:0:6479:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ff3a0ec6800 00010000:00010000:0.0:1788263386.549561:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f3ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b1103cba666f3f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263386.549614:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3bd17ec00/0x4b1103cba666f3ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b1103cba666f3f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263386.549628:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263386.549632:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765400/0x4b1103cba666f650 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f657 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263386.549649:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765400 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:0.0:1788263386.549653:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765400/0x4b1103cba666f650 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f657 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263386.549661:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765400/0x4b1103cba666f650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b1103cba666f657 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263386.549667:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765400/0x4b1103cba666f650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b1103cba666f657 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263386.549672:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788263386.549675:0:6479:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788263386.549677:0:6479:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788263386.549682:0:6479:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ff3a0ec6800 00010000:00010000:0.0:1788263386.549686:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765400/0x4b1103cba666f650 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b1103cba666f657 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263386.549692:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3ae765400/0x4b1103cba666f650 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b1103cba666f657 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263386.549700:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263386.549701:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263386.549708:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263386.550131:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788263386.553942:0:15478:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ff282e37120 - data ffff9ff2818211b0/ffff9ff282332c00 00000020:01000000:2.0:1788263386.554093:0:15478:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ff3c06e09c0 - data ffff9ff3b88a1360/ffff9ff2817fb800 00100000:10000000:2.0:1788263386.563419:0:15478:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788263386.575945:0:15478:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f11e 00000020:00000080:0.0:1788263386.575956:0:15478:0:(genops.c:885:class_export_put()) final put ffff9ff387609000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788263386.575975:0:15478:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ff3ae569800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788263386.575979:0:15478:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ff3ae569800 2 00000020:01000004:0.0:1788263386.575982:0:15478:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ff3ae569800 from lustre-OST0000 00000020:00000080:0.0:1788263386.576004:0:15478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788263386.576013:0:15478:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788263386.576016:0:15478:0:(genops.c:885:class_export_put()) final put ffff9ff3ae4cf800/lustre-OST0000_UUID 00000020:00000080:0.0:1788263386.576018:0:15478:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3ae4cf800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788263386.576024:0:15478:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:1.0:1788263386.576074:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff387609000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:0.0:1788263386.576090:0:15478:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788263386.576095:0:15478:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788263386.576099:0:15478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788263386.576104:0:15478:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788263386.576110:0:15478:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9ff3bd5bd800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788263386.576116:0:15478:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9ff3ad8ecd28) has exports, disconnecting them 00000020:00080000:0.0:1788263386.576121:0:15478:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9ff3bd5bd800), last request at 1788263142 00000020:00000080:0.0:1788263386.576124:0:15478:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f148 00000020:00080000:0.0:1788263386.576134:0:15478:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ff3bd5bd800): rc 0 00000020:00000080:0.0:1788263386.576139:0:15478:0:(genops.c:885:class_export_put()) final put ffff9ff3bd5bd800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788263386.576191:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3bd5bd800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788263386.578065:0:15478:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788263386.578072:0:15478:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788263386.578076:0:15478:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788263386.578083:0:15478:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788263386.578269:0:15478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788263386.578277:0:15478:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1788263386.578284:0:15478:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788263386.578289:0:15478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788263386.578294:0:15478:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788263386.578300:0:15478:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9ff281fa8000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788263386.578306:0:15478:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9ff281fa3370) has exports, disconnecting them 00000020:00080000:1.0:1788263386.578311:0:15478:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9ff281fa8000), last request at 1788263142 00000020:00000080:1.0:1788263386.578314:0:15478:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f15d 00000020:00080000:1.0:1788263386.578329:0:15478:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ff281fa8000): rc 0 00000020:00000080:1.0:1788263386.578334:0:15478:0:(genops.c:885:class_export_put()) final put ffff9ff281fa8000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788263386.578617:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff3bd5bf000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788263386.578625:0:37:0:(genops.c:885:class_export_put()) final put ffff9ff3bd5b9800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788263386.578628:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3bd5b9800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788263386.578638:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788263386.578702:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff281fa8000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788263386.660641:0:15478:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788263386.660650:0:15478:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788263386.660654:0:15478:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788263386.660661:0:15478:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788263386.660702:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff281faf800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788263386.660895:0:15478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788263386.660904:0:15478:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788263386.660928:0:15478:0:(genops.c:885:class_export_put()) final put ffff9ff3bd5be000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788263386.660932:0:15478:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3bd5be000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788263386.660948:0:15478:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788263386.661008:0:15478:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ff3ae569800 1 00000020:00000080:3.0:1788263386.661014:0:15478:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f0e6 00000020:00000080:3.0:1788263386.661019:0:15478:0:(genops.c:885:class_export_put()) final put ffff9ff3ae4cd800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788263386.661028:0:15478:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788263386.661035:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3ae4cd800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788263386.661184:0:15478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788263386.661190:0:15478:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788263386.661194:0:15478:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9ff3ad8e8000) has no exports 00000020:00000080:2.0:1788263386.686759:0:15478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788263386.686772:0:15478:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788263386.686778:0:15478:0:(genops.c:885:class_export_put()) final put ffff9ff3ae56b000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788263386.686783:0:15478:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3ae56b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788263386.686794:0:15478:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788263386.686922:0:15478:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ff3ae56d000 00000020:02000400:2.0:1788263386.686968:0:15478:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788263386.933602:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788263387.696542:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 15f48257-b19e-4792-92d2-a48eb49d0ad1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788263387.696552:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 15f48257-b19e-4792-92d2-a48eb49d0ad1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788263387.696555:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788263387.696559:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788263387.696668:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788263387.696695:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875129709800192:0@lo:400:kworker.0 00000400:00000100:3.0:1788263387.696775:0:3621:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875129709800192 offset 0 length 224: 4 00010000:00010000:0.0:1788263387.954974:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263388.981750:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263389.999884:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788263390.107394:0:15680:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788263390.139265:0:15680:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788263390.139352:0:15680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8600/0x4b1103cba666f3b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f3be expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263390.139367:0:15680:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8600/0x4b1103cba666f3b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f3be expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263390.139393:0:15680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8600/0x4b1103cba666f3b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f3be expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263390.139400:0:15680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8600/0x4b1103cba666f3b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f3be expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263390.139421:0:15680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788263390.139427:0:15680:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1788263390.139433:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263390.139442:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8600/0x4b1103cba666f3b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f3be expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263390.139450:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e8600 already unused, calling callback (ffffffffc12d0c20) 00000100:00080000:0.0:1788263390.139452:0:15680:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:00010000:1.0:1788263390.139454:0:6479:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8600/0x4b1103cba666f3b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f3be expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263390.139463:0:6479:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8600/0x4b1103cba666f3b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b1103cba666f3be expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263390.139466:0:15680:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ff28398b480 x1875129709799296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788263395 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:00010000:1.0:1788263390.139477:0:6479:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8600/0x4b1103cba666f3b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b1103cba666f3be expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263390.139485:0:6479:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788263390.139488:0:6479:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788263390.139490:0:6479:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1788263390.139493:0:15680:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788263390.139500:0:15680:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1788263390.139504:0:6479:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ff3a0ec6800 00000100:00080000:0.0:1788263390.139508:0:15680:0:(import.c:65:import_set_state_nolock()) ffff9ff3851c6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:1.0:1788263390.139509:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8600/0x4b1103cba666f3b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b1103cba666f3be expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788263390.139518:0:15680:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:1.0:1788263390.139519:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3829e8600/0x4b1103cba666f3b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b1103cba666f3be expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263390.139526:0:15680:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ff28398b480 x1875129709799296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788263395 ref 1 fl Interpret:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788263390.139534:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263390.139536:0:15680:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00010000:00010000:1.0:1788263390.139538:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263390.139542:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263390.141473:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875129709799296:0@lo:38:kworker.0 00000100:00100000:0.0:1788263390.141532:0:15680:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788263390.142881:0:15680:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788263390.142893:0:15680:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ff283988000 x1875129709799424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263391 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263390.142919:0:15680:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ff3b5472300 x1875129709799680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263393 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263390.142941:0:15680:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ff283327480 x1875129709799808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263396 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263390.142956:0:15680:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ff283988380 x1875129709800064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263398 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263390.142983:0:15680:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ff28398ad80 x1875129709800192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263403 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263390.143119:0:15680:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1788263390.143159:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709799808:0@lo:400:kworker.0 00000100:00100000:3.0:1788263390.143227:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875129709799424:0@lo:400:kworker.0 00000100:00080000:0.0:1788263390.143258:0:15680:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788263390.143280:0:15680:0:(import.c:65:import_set_state_nolock()) ffff9ff3a052f800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788263390.143343:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1875129709800320:0@lo:39:umount.0 00000100:00100000:1.0:1788263390.143349:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875129709800192:0@lo:400:kworker.0 00000100:00100000:1.0:1788263390.143360:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5472300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875129709799680:0@lo:400:kworker.0 00000400:00000100:3.0:1788263390.143393:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875129709800320 offset 0 length 224: 4 00000100:00100000:2.0:1788263390.143819:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709800064:0@lo:400:kworker.0 00010000:00010000:0.0:1788263391.025367:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263392.049898:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788263392.816614:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 15f48257-b19e-4792-92d2-a48eb49d0ad1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788263392.816625:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 15f48257-b19e-4792-92d2-a48eb49d0ad1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788263393.071819:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263394.095836:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263395.123307:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263396.145449:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263397.167794:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263397.295761:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263382/real 1788263382] req@ffff9ff283988a80 x1875129709799936/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788263397 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263397.295881:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ff283988a80 x1875129709799936/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788263397 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788263397.295903:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3a0ec6800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788263397.295928:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788263397.295932:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:15f48257-b19e-4792-92d2-a48eb49d0ad1:3617:1875129709799936:0@lo:250:kworker.0 00000100:00080000:0.0:1788263397.296020:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 15f48257-b19e-4792-92d2-a48eb49d0ad1->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788263397.296025:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788263397.296028:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ff3a0ec6800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788263397.296034:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.126@tcp: connect to NID 0@lo last attempt 391 00000100:00080000:0.0:1788263397.296038:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.126@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788263397.296044:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.126@tcp: import ffff9ff3a0ec6800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:0.0:1788263397.296082:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff283325c00 x1875129709800448/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788263397.296220:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:15f48257-b19e-4792-92d2-a48eb49d0ad1:3617:1875129709800448:0@lo:250:kworker.0 00000400:00000100:3.0:1788263397.296267:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875129709800448 offset 0 length 520: 4 00010000:00010000:0.0:1788263398.191895:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263399.220766:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263400.239780:0:9492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263400.367770:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263390/real 1788263390] req@ffff9ff283327480 x1875129709800320/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788263400 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263400.367803:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ff283327480 x1875129709800320/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788263400 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788263400.367823:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3a052f800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788263400.367916:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1875129709800320:0@lo:39:umount.0 00000100:00080000:0.0:1788263400.377133:0:15680:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788263400.377141:0:15680:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788263400.377149:0:15680:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788263400.379038:0:15680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9000/0x4b1103cba666f3c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f3cc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263400.379074:0:15680:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9000/0x4b1103cba666f3c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f3cc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263400.379082:0:15680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9000/0x4b1103cba666f3c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f3cc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263400.379089:0:15680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9000/0x4b1103cba666f3c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f3cc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263400.379177:0:15680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263400.379185:0:15680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eed000/0x4b1103cba666f642 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba666f649 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263400.379191:0:15680:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eed000/0x4b1103cba666f642 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba666f649 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263400.379196:0:15680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff398eed000/0x4b1103cba666f642 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f649 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263400.379201:0:15680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9ff398eed000/0x4b1103cba666f642 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b1103cba666f649 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263400.379230:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788263400.379246:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9000/0x4b1103cba666f3c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f3cc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263400.379253:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9000 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:1.0:1788263400.379257:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9000/0x4b1103cba666f3c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f3cc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263400.379265:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9000/0x4b1103cba666f3c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b1103cba666f3cc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263400.379272:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9000/0x4b1103cba666f3c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b1103cba666f3cc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263400.379278:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788263400.379280:0:6480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1788263400.379291:0:6480:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ff3a0ec6800 00010000:00010000:1.0:1788263400.379294:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9000/0x4b1103cba666f3c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b1103cba666f3cc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263400.379299:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3829e9000/0x4b1103cba666f3c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b1103cba666f3cc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263400.379313:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263400.379323:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff398eed000/0x4b1103cba666f642 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f649 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263400.379328:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eed000 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:1.0:1788263400.379331:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eed000/0x4b1103cba666f642 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b1103cba666f649 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263400.379336:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff398eed000/0x4b1103cba666f642 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b1103cba666f649 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263400.379341:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eed000/0x4b1103cba666f642 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b1103cba666f649 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263400.379347:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788263400.379348:0:6480:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788263400.379353:0:6480:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ff3a0ec6800 00010000:00010000:1.0:1788263400.379356:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff398eed000/0x4b1103cba666f642 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b1103cba666f649 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263400.380052:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263400.380055:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263400.380057:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263400.380232:0:15680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788263400.380238:0:15680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff398eed000/0x4b1103cba666f642 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b1103cba666f649 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263400.380255:0:15680:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1788263400.380262:0:15680:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1788263400.380267:0:15680:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788263400.380304:0:15680:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788263400.380307:0:15680:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788263400.380313:0:15680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788263400.380318:0:15680:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788263400.380322:0:15680:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9ff281fa4d28) has no exports 00000020:00080000:0.0:1788263400.380343:0:15680:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9ff281fa4d28) has no exports 00010000:00010000:1.0:1788263400.380437:0:6479:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788263400.385455:0:15680:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ff3b39ef1e0 - data ffff9ff3b8b1b510/ffff9ff3b54b0c00 00000020:01000000:3.0:1788263400.386247:0:15680:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ff398ca4720 - data ffff9ff2818b8438/ffff9ff3b5410000 00100000:10000000:3.0:1788263400.400335:0:15680:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788263400.416078:0:15680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f244 00000020:00000080:3.0:1788263400.416090:0:15680:0:(genops.c:885:class_export_put()) final put ffff9ff3bd5bb000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788263400.416113:0:15680:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ff281faf000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788263400.416117:0:15680:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ff281faf000 2 00000020:01000004:3.0:1788263400.416121:0:15680:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ff281faf000 from lustre-OST0001 00000020:00000080:3.0:1788263400.416145:0:15680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788263400.416156:0:15680:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788263400.416159:0:15680:0:(genops.c:885:class_export_put()) final put ffff9ff3bd5bb800/lustre-OST0001_UUID 00000020:00000080:3.0:1788263400.416161:0:15680:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3bd5bb800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788263400.416179:0:15680:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788263400.416296:0:15680:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 15f48257-b19e-4792-92d2-a48eb49d0ad1->MGS 00010000:00010000:3.0:1788263400.416311:0:15680:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff398eec800/0x4b1103cba666ef9d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b1103cba666efa4 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263400.416323:0:15680:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff398eec800/0x4b1103cba666ef9d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b1103cba666efa4 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263400.416330:0:15680:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788263400.416332:0:15680:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788263400.416336:0:15680:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788263400.416348:0:15680:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ff3a0ec6800 00010000:00010000:3.0:1788263400.416352:0:15680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff398eec800/0x4b1103cba666ef9d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b1103cba666efa4 expref: -99 pid: 7420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263400.416368:0:15680:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d600/0x4b1103cba666f45f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b1103cba666f466 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263400.416374:0:15680:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d600/0x4b1103cba666f45f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b1103cba666f466 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263400.416379:0:15680:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788263400.416381:0:15680:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788263400.416383:0:15680:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788263400.416392:0:15680:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ff3a0ec6800 00010000:00010000:3.0:1788263400.416395:0:15680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff282f5d600/0x4b1103cba666f45f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b1103cba666f466 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788263400.416409:0:15680:0:(import.c:65:import_set_state_nolock()) ffff9ff3a0ec6800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788263400.416413:0:15680:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788263400.416415:0:15680:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788263400.416423:0:15680:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788263400.416427:0:15680:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788263400.416438:0:15680:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ff283325c00 x1875129709800448/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788263417 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788263400.416506:0:15680:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788263400.416510:0:15680:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000020:00000080:0.0:1788263400.416663:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3bd5bb000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1788263400.417119:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:15f48257-b19e-4792-92d2-a48eb49d0ad1:3617:1875129709800448:0@lo:250:kworker.0 10000000:01000000:3.0:1788263400.417256:0:15680:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788263400.417265:0:15680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666ee9a 00000020:00000080:3.0:1788263400.417271:0:15680:0:(genops.c:885:class_export_put()) final put ffff9ff3851c1800/15f48257-b19e-4792-92d2-a48eb49d0ad1 00000020:01000000:3.0:1788263400.417286:0:15680:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.126@tcp (flags='') 00000020:00000080:3.0:1788263400.417290:0:15680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788263400.417296:0:15680:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.126@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788263400.417299:0:15680:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9ff3b0028000) has no exports 10000000:01000000:0.0:1788263400.417351:0:6489:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:0.0:1788263400.417403:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3851c1800/15f48257-b19e-4792-92d2-a48eb49d0ad1 for MGC192.168.203.126@tcp 10000000:01000000:3.0:1788263400.417445:0:15680:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.126@tcp: client import never connected 00000100:00080000:3.0:1788263400.417448:0:15680:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788263400.417450:0:15680:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788263400.417452:0:15680:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788263400.417454:0:15680:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788263400.417485:0:15680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788263400.417490:0:15680:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.126@tcp (uuid 15f48257-b19e-4792-92d2-a48eb49d0ad1) 00000020:01000000:3.0:1788263400.417495:0:15680:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788263400.417498:0:15680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788263400.417502:0:15680:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788263400.417506:0:15680:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9ff3bd5bc800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788263400.417511:0:15680:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9ff3bc6b19b8) has exports, disconnecting them 00000020:00080000:3.0:1788263400.417516:0:15680:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9ff3bd5bc800), last request at 1788263164 00000020:00000080:3.0:1788263400.417519:0:15680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f26e 00000020:00080000:3.0:1788263400.417531:0:15680:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ff3bd5bc800): rc 0 00000020:00000080:3.0:1788263400.417534:0:15680:0:(genops.c:885:class_export_put()) final put ffff9ff3bd5bc800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788263400.417759:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3bd5bc800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788263400.419455:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff3a0ec6800 for MGC192.168.203.126@tcp 00000020:00000080:0.0:1788263400.419466:0:37:0:(genops.c:885:class_export_put()) final put ffff9ff3a0ec5800/15f48257-b19e-4792-92d2-a48eb49d0ad1 00000020:00000080:0.0:1788263400.419469:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3a0ec5800/15f48257-b19e-4792-92d2-a48eb49d0ad1 for MGC192.168.203.126@tcp 00000020:01000000:0.0:1788263400.419478:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.126@tcp (15f48257-b19e-4792-92d2-a48eb49d0ad1) 00010000:01000000:0.0:1788263400.419994:0:15680:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788263400.419999:0:15680:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788263400.420003:0:15680:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788263400.420007:0:15680:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788263400.420252:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff3851c6800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788263400.420843:0:15680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788263400.420857:0:15680:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788263400.420862:0:15680:0:(genops.c:885:class_export_put()) final put ffff9ff3bf62e000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788263400.420865:0:15680:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3bf62e000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788263400.420874:0:15680:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1788263400.420937:0:15680:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788263400.420942:0:15680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788263400.420947:0:15680:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788263400.420955:0:15680:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9ff3bf62e800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788263400.420961:0:15680:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9ff281fa19b8) has exports, disconnecting them 00000020:00080000:1.0:1788263400.420965:0:15680:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9ff3bf62e800), last request at 1788263164 00000020:00000080:1.0:1788263400.420970:0:15680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f283 00000020:00080000:1.0:1788263400.420983:0:15680:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ff3bf62e800): rc 0 00000020:00000080:1.0:1788263400.420987:0:15680:0:(genops.c:885:class_export_put()) final put ffff9ff3bf62e800/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1788263400.421045:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3bf62e800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1788263400.421661:0:15680:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788263400.421665:0:15680:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788263400.421669:0:15680:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788263400.421673:0:15680:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788263400.421691:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ff3a052f800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1788263400.421742:0:9492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788263400.423999:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788263400.425660:0:6479:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1788263400.427671:0:6475:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9ff398e74200:6475] 1 exiting: rc = 0 00000100:00100000:0.0:1788263400.429937:0:6474:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9ff398e74000:6474] 0 exiting: rc = 1 00000100:00100000:0.0:1788263400.430032:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.430312:0:6477:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9ff398ef0000:6477] 1 exiting: rc = 0 00000100:00100000:0.0:1788263400.430377:0:6476:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9ff398ef1400:6476] 0 exiting: rc = 1 00000100:00100000:0.0:1788263400.430434:0:6478:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9ff398ef0800:6478] 2 exiting: rc = 0 00000100:00100000:1.0:1788263400.433767:0:9493:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9ff282242600:9493] 3 exiting: rc = 0 00000100:00100000:0.0:1788263400.434202:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434210:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434216:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434222:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434227:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434233:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434239:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434244:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434250:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434256:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434262:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434268:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434273:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434278:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434285:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434290:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434296:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434302:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434307:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434314:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434321:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434326:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434331:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434337:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434343:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434348:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434353:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434358:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434364:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434382:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434387:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434393:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434398:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434403:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434408:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434426:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434432:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434437:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434442:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434447:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434453:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434458:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434464:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434469:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434474:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434479:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434484:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434490:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434495:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434500:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434504:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434509:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434514:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434519:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434524:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434529:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434534:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.434539:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.436793:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.436811:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.436816:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.436820:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.436826:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.436831:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788263400.441222:0:15680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788263400.441233:0:15680:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1788263400.441238:0:15680:0:(genops.c:885:class_export_put()) final put ffff9ff3bd5ba000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1788263400.441243:0:15680:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3bd5ba000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1788263400.441255:0:15680:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1788263400.441305:0:15680:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ff281faf000 1 00000020:00000080:0.0:1788263400.441311:0:15680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b1103cba666f213 00000020:00000080:0.0:1788263400.441317:0:15680:0:(genops.c:885:class_export_put()) final put ffff9ff3bc670000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788263400.441330:0:15680:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788263400.441340:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3bc670000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788263400.441350:0:15680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788263400.441355:0:15680:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788263400.441358:0:15680:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9ff281fa0000) has no exports 00000020:00000080:0.0:1788263400.511863:0:15680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788263400.511878:0:15680:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788263400.511884:0:15680:0:(genops.c:885:class_export_put()) final put ffff9ff281fad800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788263400.511889:0:15680:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff281fad800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788263400.511895:0:15680:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788263400.512227:0:15680:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ff281fa8800 00000020:01000000:0.0:1788263400.512248:0:15680:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788263400.512251:0:15680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788263400.512256:0:15680:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788263400.512259:0:15680:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9ff3bc6b4d28) has no exports 00000020:00000080:0.0:1788263400.512283:0:15680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788263400.512290:0:15680:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788263400.512293:0:15680:0:(genops.c:885:class_export_put()) final put ffff9ff3ae4cc000/OSS_uuid 00000020:00000080:0.0:1788263400.512295:0:15680:0:(genops.c:844:class_export_destroy()) destroying export ffff9ff3ae4cc000/OSS_uuid for OSS 00000020:01000000:0.0:1788263400.512298:0:15680:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1788263400.512349:0:6487:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788263400.512494:0:14442:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9ff28232e600:14442] 4 exiting: rc = 0 00000100:00100000:3.0:1788263400.512560:0:9885:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9ff282c3ac00:9885] 3 exiting: rc = 0 00000100:00100000:3.0:1788263400.512658:0:8405:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9ff3ae48e400:8405] 1 exiting: rc = 0 00000100:00100000:1.0:1788263400.512866:0:8404:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9ff3ae48e000:8404] 0 exiting: rc = 1 00000100:00100000:1.0:1788263400.512915:0:8406:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9ff3ae48ea00:8406] 2 exiting: rc = 0 00000100:00100000:0.0:1788263400.514837:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.514850:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.514856:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.514865:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.514886:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.514894:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.514899:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.514904:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.514910:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.514919:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.514926:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.514932:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.514937:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.514943:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.514951:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.514957:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.514964:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.514968:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.514973:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.514978:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.514983:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.514987:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.514992:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.514997:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515001:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515006:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515010:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515014:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515019:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515023:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515028:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515033:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515037:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515042:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515046:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515051:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515055:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515060:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515064:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515076:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515081:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515086:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515091:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515096:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515102:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515106:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515111:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515116:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515121:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515126:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515131:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515136:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515140:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515145:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515150:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515155:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515160:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515165:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515169:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515174:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515178:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515183:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515188:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.515193:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.520390:0:8407:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9ff3ae505800:8407] 0 exiting: rc = 1 00000100:00100000:1.0:1788263400.520614:0:11809:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9ff3c048da00:11809] 2 exiting: rc = 0 00000100:00100000:3.0:1788263400.520803:0:8408:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9ff3ae503e00:8408] 1 exiting: rc = 0 00000100:00100000:1.0:1788263400.522334:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.522495:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.522507:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.522512:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.522517:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.522523:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.522533:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.522568:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.522574:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.522923:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.522930:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.522935:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.522941:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.523401:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.523408:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.523413:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.523418:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.523423:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.523437:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.523442:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.523446:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.523452:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.523456:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.523461:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.523466:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.523472:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.523486:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.523495:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.523501:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.523507:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.523512:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.523518:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.523523:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.523528:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.523533:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524233:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524246:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524251:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524261:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524266:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524271:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524276:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524280:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524284:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524291:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524296:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524301:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524309:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524314:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524319:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524327:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524333:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524337:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524347:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524351:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524356:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524360:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524365:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524370:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524377:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524383:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524387:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524392:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.524396:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.526408:0:8411:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9ff3ae485800:8411] 2 exiting: rc = 0 00000100:00100000:2.0:1788263400.526603:0:8409:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9ff3ae484c00:8409] 0 exiting: rc = 1 00000100:00100000:2.0:1788263400.526793:0:8410:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9ff3ae484e00:8410] 1 exiting: rc = 0 00000100:00100000:1.0:1788263400.527433:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527440:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527446:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527451:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527457:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527463:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527467:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527472:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527478:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527557:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527563:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527569:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527575:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527602:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527607:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527765:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527772:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527778:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527783:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527801:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527807:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527811:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527816:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527821:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527836:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527841:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527847:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527852:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527857:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527863:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527870:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527875:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527880:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527886:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527891:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527896:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527901:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527907:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527912:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527918:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527923:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527928:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527933:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527953:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527961:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527966:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527971:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527977:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527982:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527987:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527992:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.527998:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.528004:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.528009:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.528015:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.528021:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.528027:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.528032:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.528038:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.528052:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.528057:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.528062:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.528068:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.528081:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263400.532813:0:8413:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9ff3ae485e00:8413] 1 exiting: rc = 0 00000100:00100000:3.0:1788263400.532980:0:8412:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9ff3ae484a00:8412] 0 exiting: rc = 1 00000100:00100000:2.0:1788263400.533090:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533099:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533104:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533110:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533115:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533120:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533125:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533130:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533135:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533140:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533146:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533151:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533168:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533174:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533179:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533184:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533190:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533194:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533199:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533204:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533208:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533213:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533217:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533222:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533226:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533231:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533236:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533241:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533246:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533251:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533257:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533262:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533266:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533271:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533275:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533280:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533285:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533290:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533296:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533301:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533306:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533310:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533315:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533320:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533324:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533329:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533334:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533347:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533353:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533358:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533363:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533368:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533373:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533378:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533383:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533388:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533393:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533398:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533403:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533408:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533413:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533418:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533423:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263400.533434:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263400.535160:0:8414:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9ff3ae484400:8414] 0 exiting: rc = 1 00000100:00100000:0.0:1788263400.535359:0:8415:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9ff3ae485c00:8415] 1 exiting: rc = 0 00000100:00100000:1.0:1788263400.535454:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535470:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535510:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535518:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535524:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535529:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535535:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535542:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535548:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535554:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535561:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535567:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535572:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535798:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535822:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535829:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535834:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535840:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535848:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535854:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535860:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535867:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535872:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535877:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535882:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535888:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535909:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535917:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535923:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535928:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535946:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535953:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535960:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535967:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535974:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535980:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535985:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.535991:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.536012:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.536021:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.536028:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.536034:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.536040:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.536047:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.536053:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.536059:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.536065:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.536072:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.536078:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.536083:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.536107:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.536114:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.536121:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.536127:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.536134:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.536141:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.536148:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.536154:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.536159:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.536166:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.536172:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.536177:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.536184:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263400.536200:0:15680:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788263400.544012:0:15680:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788263418.009507:0:16445:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788263426.156251:0:17044:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788263426.156257:0:17044:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788263426.156258:0:17044:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788263426.156438:0:17044:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ff28389c800 00000020:01000004:2.0:1788263426.156452:0:17044:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788263426.156459:0:17044:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788263426.156473:0:17044:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9ff281fa0000) 00000020:00000080:2.0:1788263426.156486:0:17044:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788263426.205136:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788263426.206028:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788263426.207592:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1788263426.207864:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788263426.208754:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788263426.209126:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788263426.209880:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788263426.210253:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1788263426.210895:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1788263426.211281:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1788263426.212115:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1788263426.213626:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788263426.214878:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1788263426.215859:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788263426.218368:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1788263426.224888:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788263426.226434:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788263426.227304:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788263426.227745:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788263426.228230:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788263426.228490:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788263426.229046:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788263426.229679:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788263426.230028:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788263426.230267:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1788263426.230547:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788263426.232117:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788263426.232615:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1788263426.232990:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788263426.233221:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1788263426.233442:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788263426.233875:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788263426.234104:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788263426.234304:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788263426.234551:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1788263426.235428:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788263426.235878:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788263426.236804:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1788263426.237146:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1788263426.237462:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1788263426.237866:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1788263426.238124:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788263426.238345:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1788263426.238710:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788263426.239070:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788263426.239340:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1788263426.239809:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1788263426.243606:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788263426.244056:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788263426.244277:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1788263426.244715:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1788263426.244918:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788263426.245182:0:17044:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:1.0:1788263426.245990:0:17044:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788263426.246195:0:17044:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788263426.246203:0:17044:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788263426.246216:0:17044:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b1103cba6670457 00000020:01000004:1.0:1788263426.246222:0:17044:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788263426.246227:0:17044:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788263426.246232:0:17044:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ff28389c800 from MGS 00000020:01000004:1.0:1788263426.246235:0:17044:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788263426.246245:0:17044:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9ff3af7e4d28) 00000020:00000080:1.0:1788263426.246254:0:17044:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788263426.246308:0:17044:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ff28389c800 from MGS, refs=2 00080000:01000000:1.0:1788263426.246312:0:17044:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788263426.246327:0:17044:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b1103cba6670465 00000100:00100000:1.0:1788263426.246416:0:17044:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788263426.246552:0:17044:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788263426.246558:0:17044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788263426.247261:0:17044:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788263426.247268:0:17044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788263426.248222:0:17044:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788263426.248449:0:17044:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788263426.248454:0:17044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788263426.249476:0:17044:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788263426.249485:0:17044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788263426.249852:0:17044:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788263426.249859:0:17044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788263426.250825:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263426.250831:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263426.250833:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263426.251187:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263426.251190:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263426.251192:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263426.251999:0:17044:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788263426.256071:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788263426.257114:0:17044:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788263426.261309:0:17056:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788263426.261386:0:17044:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788263426.261440:0:17044:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788263426.262247:0:17044:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788263426.262606:0:17044:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788263426.262771:0:17044:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788263426.262778:0:17044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788263426.266494:0:17044:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788263426.266506:0:17044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788263426.269281:0:17044:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788263426.269292:0:17044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788263426.270168:0:17044:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788263426.270191:0:17044:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.126@tcp' 00000020:01000004:1.0:1788263426.270193:0:17044:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788263426.270222:0:17044:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.126@tcp (typ=mgc) 00000020:00000080:1.0:1788263426.270233:0:17044:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.126@tcp (ffff9ff3af7e19b8) 00000020:00000080:1.0:1788263426.270246:0:17044:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788263426.270317:0:17044:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ff3a0df8000@MGC192.168.203.126@tcp: add connection 192.168.203.126@tcp at head 00010000:00010000:1.0:1788263426.270729:0:17044:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.126@tcp-0 is initialized 00000040:01000000:1.0:1788263426.270736:0:17044:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788263426.271126:0:17062:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788263426.271189:0:17044:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.126@tcp (uuid 8fb36e90-c209-4884-91f2-1155be4ad295) 00000020:00000080:3.0:1788263426.271204:0:17044:0:(genops.c:1385:class_connect()) connect: client 8fb36e90-c209-4884-91f2-1155be4ad295, cookie 0x4b1103cba6670473 00000100:00080000:3.0:1788263426.271212:0:17044:0:(import.c:510:import_select_connection()) MGC192.168.203.126@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788263426.271217:0:17044:0:(import.c:624:import_select_connection()) MGC192.168.203.126@tcp: import ffff9ff3a0df8000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788263426.271246:0:17044:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff283988a80 x1875129709800576/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788263426.271272:0:17044:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8fb36e90-c209-4884-91f2-1155be4ad295->MGS 00000020:01000004:3.0:1788263426.271290:0:17044:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788263426.271294:0:17044:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788263426.271305:0:17044:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9ff2832299b8) 00000020:00000080:3.0:1788263426.271313:0:17044:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788263426.271446:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8fb36e90-c209-4884-91f2-1155be4ad295:3617:1875129709800576:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788263426.271509:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788263426.271807:0:17061:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1788263426.272653:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709800576 00000100:00100000:2.0:1788263426.272663:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709800576 00000100:00100000:2.0:1788263426.272700:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788263426.272708:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3617:x1875129709800576:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788263426.272731:0:17059:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 8fb36e90-c209-4884-91f2-1155be4ad295@0@lo t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:2.0:1788263426.272754:0:17059:0:(genops.c:1385:class_connect()) connect: client 8fb36e90-c209-4884-91f2-1155be4ad295, cookie 0x4b1103cba6670481 00000100:00080000:2.0:1788263426.272867:0:17059:0:(import.c:65:import_set_state_nolock()) ffff9ff386a6e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263426.272936:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+5:3617:x1875129709800576:12345-0@lo:250:mount.lustre.0 Request processed in 227us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263426.272944:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263426.273224:0:3617:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.126@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788263426.273234:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.126@tcp: connect to target with instance 0 00000100:00080000:1.0:1788263426.273241:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.126@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788263426.273245:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788263426.273248:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3a0df8000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788263426.273257:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788263426.273273:0:3617:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788263426.273279:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8fb36e90-c209-4884-91f2-1155be4ad295:3617:1875129709800576:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788263426.285941:0:17044:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788263426.286176:0:17044:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788263426.286183:0:17044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788263426.288162:0:17044:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788263426.288171:0:17044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788263426.293902:0:17044:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788263426.293914:0:17044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788263426.294830:0:17044:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788263426.295014:0:17044:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788263426.295021:0:17044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788263426.296135:0:17044:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788263426.296143:0:17044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788263426.330659:0:17044:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788263426.330872:0:17044:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788263426.330879:0:17044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788263426.332702:0:17044:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788263426.332726:0:17044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788263426.333416:0:17044:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788263426.333739:0:17044:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788263426.333751:0:17044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788263426.334203:0:17044:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788263426.334209:0:17044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788263426.334814:0:17044:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788263426.334964:0:17044:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788263426.334968:0:17044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788263426.335460:0:17044:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788263426.335466:0:17044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788263426.338918:0:17044:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788263426.339119:0:17044:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788263426.339125:0:17044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788263426.340797:0:17044:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788263426.340809:0:17044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788263426.358563:0:17044:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788263426.358874:0:17044:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788263426.358880:0:17044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788263426.360384:0:17044:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788263426.360394:0:17044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788263426.361115:0:17044:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788263426.361122:0:17044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788263426.362147:0:17044:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788263426.362175:0:17044:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788263426.362181:0:17044:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.126@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788263426.362280:0:17044:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788263426.362311:0:17044:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.126@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788263426.362316:0:17044:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788263426.362317:0:17044:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788263426.362319:0:17044:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263426.362320:0:17044:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263426.362326:0:17044:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263426.362327:0:17044:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263426.362329:0:17044:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788263426.362330:0:17044:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788263426.362332:0:17044:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263426.362333:0:17044:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788263426.362336:0:17044:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788263426.362338:0:17044:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788263426.362339:0:17044:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788263426.362340:0:17044:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263426.362341:0:17044:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263426.362342:0:17044:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263426.362343:0:17044:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263426.362344:0:17044:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788263426.362345:0:17044:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788263426.362346:0:17044:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263426.362347:0:17044:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788263426.362374:0:17044:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788263426.362393:0:17044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5470a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709800704:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788263426.362458:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263426.362553:0:17044:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28222bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263426.362763:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709800704 00000100:00100000:0.0:1788263426.362771:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709800704 00000100:00100000:0.0:1788263426.362854:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788263426.362864:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+5:17044:x1875129709800704:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788263426.362915:0:17060:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788263426.362917:0:17060:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788263426.362920:0:17060:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788263426.363156:0:17081:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788263426.363563:0:17060:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1788263426.364889:0:17082:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788263426.364895:0:17082:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1788263426.364898:0:17082:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788263426.364901:0:17082:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788263426.365285:0:17082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788263426.365543:0:17060:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788263426.365553:0:17060:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788263426.367309:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+5:17044:x1875129709800704:12345-0@lo:253:mount.lustre.0 Request processed in 4438us (4843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263426.367323:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788263426.367452:0:17044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5470a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709800704:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788263426.367466:0:17044:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788263426.367469:0:17044:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788263426.367470:0:17044:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788263426.367471:0:17044:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263426.367473:0:17044:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263426.367474:0:17044:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263426.367475:0:17044:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263426.367477:0:17044:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788263426.367478:0:17044:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788263426.367480:0:17044:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263426.367481:0:17044:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788263426.367499:0:17044:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ff28389c800 from lustre-MDT0000 10000000:01000000:2.0:1788263426.367539:0:17044:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788263426.367542:0:17044:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788263426.367546:0:17044:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ff3af7e19b8 10000000:01000000:2.0:1788263426.367559:0:17044:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788263426.367568:0:17044:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ff3af7e19b8 from 1 10000000:01000000:2.0:1788263426.367571:0:17044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788263426.367712:0:17044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0600/0x4b1103cba6670488 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263426.367723:0:17044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0600/0x4b1103cba6670488 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263426.367732:0:17044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0600/0x4b1103cba6670488 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263426.367751:0:17044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5470a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709800832:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788263426.367785:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263426.367859:0:17044:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28222b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263426.367906:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709800832 00000100:00100000:3.0:1788263426.367912:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709800832 00000100:00100000:3.0:1788263426.367981:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788263426.367989:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+5:17044:x1875129709800832:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788263426.368002:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263426.368015:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff38150e400/0x4b1103cba667048f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba6670488 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263426.368048:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff38150e400/0x4b1103cba667048f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba6670488 expref: 6 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263426.368059:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff38150e400/0x4b1103cba667048f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670488 expref: 6 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263426.368067:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150e400, rc 0) 00000100:00100000:3.0:1788263426.368098:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+6:17044:x1875129709800832:12345-0@lo:101:mount.lustre.0 Request processed in 110us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263426.368103:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788263426.368160:0:17044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5470a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709800832:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788263426.368173:0:17044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0600/0x4b1103cba6670488 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667048f expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263426.368183:0:17044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0600/0x4b1103cba6670488 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba667048f expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263426.368239:0:17044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5470a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709800960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263426.368264:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263426.368284:0:17044:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28222b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263426.368336:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709800960 00000100:00100000:0.0:1788263426.368341:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709800960 00000100:00100000:0.0:1788263426.368377:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788263426.368384:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+6:17044:x1875129709800960:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263426.368462:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+6:17044:x1875129709800960:12345-0@lo:501:mount.lustre.0 Request processed in 78us (197us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788263426.368470:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788263426.368619:0:17044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5470a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709800960:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788263426.368644:0:17044:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788263426.368658:0:17044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0600/0x4b1103cba6670488 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667048f expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263426.368675:0:17044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0600/0x4b1103cba6670488 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667048f expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263426.368684:0:17044:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ff28389c800 10000000:01000000:2.0:1788263426.368688:0:17044:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788263426.368692:0:17044:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ff28389c800 10000000:01000000:2.0:1788263426.368695:0:17044:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788263426.368697:0:17044:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ff28389c800 from 1 10000000:01000000:2.0:1788263426.368700:0:17044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788263426.368716:0:17044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1c00/0x4b1103cba6670496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263426.368724:0:17044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1c00/0x4b1103cba6670496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263426.368731:0:17044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1c00/0x4b1103cba6670496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263426.368743:0:17044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5470a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709801088:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788263426.368769:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263426.368797:0:17044:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28222b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263426.368895:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709801088 00000100:00100000:0.0:1788263426.368904:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709801088 00000100:00100000:0.0:1788263426.368933:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788263426.368940:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+6:17044:x1875129709801088:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788263426.368947:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263426.368957:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff283b68a00/0x4b1103cba667049d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba6670496 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263426.368971:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff283b68a00/0x4b1103cba667049d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba6670496 expref: 7 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263426.368980:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff283b68a00/0x4b1103cba667049d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670496 expref: 7 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263426.368987:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b68a00, rc 0) 00000100:00100000:0.0:1788263426.369014:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+7:17044:x1875129709801088:12345-0@lo:101:mount.lustre.0 Request processed in 75us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263426.369020:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788263426.369098:0:17044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5470a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709801088:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788263426.369108:0:17044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1c00/0x4b1103cba6670496 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667049d expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263426.369115:0:17044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1c00/0x4b1103cba6670496 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba667049d expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263426.369136:0:17044:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788263426.369179:0:17044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1c00/0x4b1103cba6670496 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667049d expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263426.369188:0:17044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1c00/0x4b1103cba6670496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667049d expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263426.369195:0:17044:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788263426.369198:0:17044:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788263426.369201:0:17044:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ff28389c800 10000000:01000000:2.0:1788263426.369204:0:17044:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788263426.369206:0:17044:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788263426.369208:0:17044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788263426.369221:0:17044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0200/0x4b1103cba66704a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263426.369227:0:17044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0200/0x4b1103cba66704a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263426.369234:0:17044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0200/0x4b1103cba66704a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263426.369246:0:17044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5470a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709801216:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788263426.369269:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263426.369287:0:17044:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28222b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263426.369332:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709801216 00000100:00100000:0.0:1788263426.369335:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709801216 00000100:00100000:0.0:1788263426.369360:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788263426.369459:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+7:17044:x1875129709801216:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788263426.369466:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263426.369474:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff283b69800/0x4b1103cba66704ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba66704a4 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263426.369487:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff283b69800/0x4b1103cba66704ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba66704a4 expref: 8 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263426.369495:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff283b69800/0x4b1103cba66704ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba66704a4 expref: 8 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263426.369507:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b69800, rc 0) 00000100:00100000:0.0:1788263426.369546:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+8:17044:x1875129709801216:12345-0@lo:101:mount.lustre.0 Request processed in 181us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263426.369552:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788263426.369621:0:17044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5470a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709801216:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788263426.369631:0:17044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0200/0x4b1103cba66704a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66704ab expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263426.369643:0:17044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0200/0x4b1103cba66704a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba66704ab expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263426.369682:0:17044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5470a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709801344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263426.369704:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263426.369724:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709801344 00000100:00100000:2.0:1788263426.369727:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709801344 00000100:00100000:2.0:1788263426.369755:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788263426.369761:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+8:17044:x1875129709801344:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263426.369856:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+9:17044:x1875129709801344:12345-0@lo:501:mount.lustre.0 Request processed in 95us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263426.369862:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788263426.369899:0:17044:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28222b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263426.369910:0:17044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5470a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709801344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263426.369932:0:17044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5470a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709801472:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788263426.369964:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263426.369980:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709801472 00000100:00100000:2.0:1788263426.369983:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709801472 00000100:00100000:2.0:1788263426.369999:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788263426.370004:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+9:17044:x1875129709801472:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788263426.370479:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+9:17044:x1875129709801472:12345-0@lo:503:mount.lustre.0 Request processed in 474us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263426.370487:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788263426.370519:0:17044:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28222b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263426.370547:0:17044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5470a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709801472:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788263426.371358:0:17083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283326d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fb36e90-c209-4884-91f2-1155be4ad295:17083:1875129709801600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263426.371784:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263426.371855:0:17083:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2820d0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788263426.371895:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709801600 00000100:00100000:2.0:1788263426.371902:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709801600 00000100:00100000:2.0:1788263426.371980:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788263426.371988:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+9:17083:x1875129709801600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263426.372650:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+9:17083:x1875129709801600:12345-0@lo:502:llog_process_th.0 Request processed in 661us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263426.372658:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788263426.372748:0:17083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283326d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fb36e90-c209-4884-91f2-1155be4ad295:17083:1875129709801600:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788263426.372778:0:17083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263426.372789:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263426.372791:0:17083:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788263426.372795:0:17083:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788263426.372798:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788263426.372813:0:17083:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9ff3b0053370) 00000020:00000080:0.0:1788263426.372829:0:17083:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788263426.372835:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788263426.372922:0:17083:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788263426.372931:0:17083:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b1103cba66704b9 00000020:00000080:0.0:1788263426.373116:0:17083:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788263426.373121:0:17083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263426.373124:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263426.373126:0:17083:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788263426.373128:0:17083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263426.373131:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263426.373132:0:17083:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788263426.373136:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788263426.373142:0:17083:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9ff3b0054d28) 00000020:00000080:0.0:1788263426.373151:0:17083:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788263426.373160:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788263426.373162:0:17083:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788263426.373164:0:17083:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788263426.373170:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788263426.373209:0:17083:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ff28389c800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788263426.373221:0:17083:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9ff3b00519b8) 00000020:00000080:0.0:1788263426.373229:0:17083:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788263426.373283:0:17083:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788263426.373288:0:17083:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b1103cba66704ce 00000020:00000080:0.0:1788263426.373382:0:17083:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788263426.373389:0:17083:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788263426.373393:0:17083:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4b1103cba66704d5 00080000:01000000:0.0:1788263426.373398:0:17083:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788263426.373401:0:17083:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b1103cba66704dc 00010000:00010000:1.0:1788263426.455061:0:17083:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788263426.456356:0:17083:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:1.0:1788263426.456778:0:17083:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788263426.457511:0:17083:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9ff3af7e3370) 00000020:00000080:1.0:1788263426.457538:0:17083:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788263426.457661:0:17083:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788263426.457669:0:17083:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b1103cba66704ea 00000020:00000080:2.0:1788263426.460925:0:17083:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788263426.463662:0:17083:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4b1103cba66704f1 00000020:00000080:1.0:1788263426.464822:0:17083:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788263426.464835:0:17083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263426.464842:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263426.464844:0:17083:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788263426.464848:0:17083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788263426.464851:0:17083:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1788263426.464852:0:17083:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788263426.464854:0:17083:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788263426.464855:0:17083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788263426.464858:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263426.464863:0:17083:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788263426.464867:0:17083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788263426.464871:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263426.464872:0:17083:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788263426.464885:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788263426.464947:0:17083:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788263426.464970:0:17083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263426.464973:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263426.464975:0:17083:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788263426.464979:0:17083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788263426.464982:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263426.464996:0:17083:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788263426.465001:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788263426.465006:0:17083:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:00000080:1.0:1788263426.465040:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788263426.465056:0:17083:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9ff3af7e0000) 00000020:00000080:1.0:1788263426.465077:0:17083:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788263426.465082:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788263426.465157:0:17083:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788263426.465163:0:17083:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788263426.465169:0:17083:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b1103cba66704ff 00010000:00080000:1.0:1788263426.465204:0:17083:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ff3bc672800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.126@tcp at head 00010000:00010000:1.0:1788263426.466829:0:17083:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1788263426.468954:0:17083:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788263426.469141:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788263426.469255:0:17083:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788263426.469277:0:17083:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b1103cba6670506 00000100:00080000:2.0:1788263426.469288:0:17083:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788263426.469294:0:17083:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ff3bc672800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263426.469326:0:17083:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff3b5470a80 x1875129709801728/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788263426.469403:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709801728:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788263426.469486:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263426.469768:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709801728 00000100:00100000:3.0:1788263426.469782:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709801728 00000100:00100000:3.0:1788263426.469825:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788263426.469831:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875129709801728:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788263426.469846:0:17070:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1788263426.470840:0:17083:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788263426.470958:0:17083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263426.470963:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263426.470966:0:17083:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788263426.470969:0:17083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788263426.470972:0:17083:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1788263426.470974:0:17083:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788263426.470975:0:17083:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788263426.470976:0:17083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788263426.470979:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263426.470980:0:17083:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788263426.470983:0:17083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788263426.470997:0:17083:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788263426.471002:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263426.471003:0:17083:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788263426.471007:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788263426.471011:0:17083:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:01000000:2.0:1788263426.471035:0:17083:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788263426.471037:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788263426.471052:0:17083:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ff281fa19b8) 00000020:00000080:2.0:1788263426.471068:0:17083:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788263426.471073:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788263426.471155:0:17083:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788263426.471163:0:17083:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788263426.471170:0:17083:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b1103cba6670514 00010000:00080000:2.0:1788263426.471199:0:17083:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ff3af7da000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.126@tcp at head 00010000:00010000:2.0:1788263426.471428:0:17083:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788263426.472637:0:17083:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788263426.472933:0:17083:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788263426.476455:0:17083:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788263426.476812:0:17083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788263426.481019:0:17083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788263426.481941:0:17089:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788263426.481946:0:17089:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788263426.482919:0:17083:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788263426.482932:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788263426.482967:0:17083:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788263426.482989:0:17083:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b1103cba667051b 00000100:00080000:0.0:1788263426.482999:0:17083:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788263426.483005:0:17083:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ff3af7da000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:0.0:1788263426.483038:0:17083:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff283326d80 x1875129709801856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788263426.487499:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709801856:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788263426.487622:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875129709801856 offset 0 length 520: 4 00000100:00080000:1.0:1788263426.490201:0:17083:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788263426.490794:0:17083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263426.490803:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263426.490805:0:17083:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788263426.490810:0:17083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788263426.490812:0:17083:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1788263426.490814:0:17083:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788263426.490815:0:17083:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788263426.490817:0:17083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788263426.490820:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263426.490821:0:17083:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788263426.490824:0:17083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788263426.490829:0:17083:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788263426.490833:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263426.490835:0:17083:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788263426.490838:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788263426.490842:0:17083:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:01000000:1.0:1788263426.490866:0:17083:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788263426.490869:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788263426.490889:0:17083:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ff3b3a64d28) 00000020:00000080:1.0:1788263426.490909:0:17083:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1788263426.490915:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788263426.490993:0:17083:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788263426.491000:0:17083:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788263426.491007:0:17083:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b1103cba6670529 00010000:00080000:1.0:1788263426.491037:0:17083:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ff3843fb800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.126@tcp at head 00010000:00010000:1.0:1788263426.491283:0:17083:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788263426.491354:0:17083:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788263426.491370:0:17083:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788263426.493867:0:17083:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788263426.494723:0:17083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788263426.494876:0:17083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788263426.495719:0:17091:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788263426.495724:0:17091:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:3.0:1788263426.499312:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875129709801728:12345-0@lo:38:llog_process_th.0 Request processed in 29470us (29817us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788263426.499325:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788263426.499376:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3bc672800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788263426.499381:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788263426.499384:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709801728:0@lo:38:llog_process_th.0 00000020:00000080:2.0:1788263426.499596:0:17083:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788263426.499613:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788263426.499702:0:17083:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788263426.499725:0:17083:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b1103cba6670530 00000100:00080000:2.0:1788263426.499745:0:17083:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788263426.499751:0:17083:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ff3843fb800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263426.499793:0:17083:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff3b5471180 x1875129709801984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788263426.499814:0:17083:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788263426.499881:0:17083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263426.499886:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263426.499888:0:17083:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788263426.499893:0:17083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263426.499896:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263426.499904:0:17083:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788263426.499910:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788263426.499912:0:17083:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788263426.499915:0:17083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263426.499918:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263426.499919:0:17083:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788263426.499923:0:17083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263426.499926:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263426.499928:0:17083:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788263426.499932:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788263426.499942:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709801984:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788263426.499976:0:17083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5473480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fb36e90-c209-4884-91f2-1155be4ad295:17083:1875129709802112:0@lo:502:llog_process_th.0 00000400:00000100:3.0:1788263426.499984:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875129709801984 offset 0 length 520: 4 00000100:00100000:2.0:1788263426.500029:0:17083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263426.500055:0:17083:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2831a1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788263426.500699:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709802112 00000100:00100000:0.0:1788263426.500707:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709802112 00000100:00100000:0.0:1788263426.500745:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788263426.500754:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+9:17083:x1875129709802112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263426.500898:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+9:17083:x1875129709802112:12345-0@lo:502:llog_process_th.0 Request processed in 144us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263426.500911:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788263426.501009:0:17083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5473480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fb36e90-c209-4884-91f2-1155be4ad295:17083:1875129709802112:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788263426.501035:0:17083:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263426.501041:0:17083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263426.501043:0:17083:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788263426.501047:0:17083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788263426.501161:0:17044:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788263426.501256:0:17044:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788263426.501277:0:17044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0200/0x4b1103cba66704a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66704ab expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263426.501294:0:17044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0200/0x4b1103cba66704a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66704ab expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263426.501302:0:17044:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ff28389c800 from 1 10000000:01000000:0.0:1788263426.501305:0:17044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788263426.501335:0:17044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670537 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263426.501344:0:17044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670537 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263426.501353:0:17044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670537 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263426.501397:0:17044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283324a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709802240:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788263426.501431:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263426.501461:0:17044:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39019b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263426.501505:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709802240 00000100:00100000:2.0:1788263426.501510:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709802240 00000100:00100000:2.0:1788263426.501550:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788263426.501558:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+9:17044:x1875129709802240:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788263426.501567:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263426.501717:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3bf6d1400/0x4b1103cba667053e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba6670537 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263426.501744:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3bf6d1400/0x4b1103cba667053e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba6670537 expref: 10 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263426.501755:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3bf6d1400/0x4b1103cba667053e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670537 expref: 10 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263426.501776:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d1400, rc 0) 00000100:00100000:2.0:1788263426.501838:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+10:17044:x1875129709802240:12345-0@lo:101:mount.lustre.0 Request processed in 280us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263426.501842:0:17044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283324a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709802240:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788263426.501845:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788263426.501855:0:17044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670537 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667053e expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263426.501864:0:17044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670537 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba667053e expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263426.502419:0:17044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283324a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709802368:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788263426.502453:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263426.502489:0:17044:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39019b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263426.502547:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709802368 00000100:00100000:2.0:1788263426.502552:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709802368 00000100:00100000:2.0:1788263426.502665:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788263426.502675:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+10:17044:x1875129709802368:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788263426.502689:0:17060:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788263426.502695:0:17060:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788263426.502759:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+10:17044:x1875129709802368:12345-0@lo:256:mount.lustre.0 Request processed in 86us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263426.502766:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788263426.502830:0:17044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283324a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709802368:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788263426.503392:0:17044:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788263426.503413:0:17044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670537 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667053e expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263426.503423:0:17044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667053e expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263426.503432:0:17044:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff28389c800 from 1 10000000:01000000:0.0:1788263426.503434:0:17044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788263426.503458:0:17044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba6670545 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263426.503464:0:17044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba6670545 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263426.503472:0:17044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba6670545 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263426.503486:0:17044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283324a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709802496:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788263426.503517:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263426.503766:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709802496 00000100:00100000:3.0:1788263426.503773:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709802496 00000100:00100000:0.0:1788263426.503787:0:17044:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39019b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263426.503805:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788263426.503813:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+10:17044:x1875129709802496:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788263426.503824:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263426.503837:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff38150f600/0x4b1103cba667054c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba6670545 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263426.503857:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff38150f600/0x4b1103cba667054c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba6670545 expref: 11 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263426.503867:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff38150f600/0x4b1103cba667054c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670545 expref: 11 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263426.503877:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150f600, rc 0) 00000100:00100000:3.0:1788263426.503926:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+11:17044:x1875129709802496:12345-0@lo:101:mount.lustre.0 Request processed in 113us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263426.503933:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788263426.504152:0:17044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283324a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709802496:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788263426.504196:0:17044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba6670545 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667054c expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263426.504204:0:17044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba6670545 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba667054c expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263426.504323:0:17044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283324a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709802624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263426.504349:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263426.504410:0:17044:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39019b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263426.504447:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709802624 00000100:00100000:1.0:1788263426.504453:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709802624 00000100:00100000:1.0:1788263426.504486:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788263426.504494:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+11:17044:x1875129709802624:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788263426.504893:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+11:17044:x1875129709802624:12345-0@lo:501:mount.lustre.0 Request processed in 398us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263426.504901:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788263426.504930:0:17044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283324a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709802624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263426.504958:0:17044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283324a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709802752:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788263426.505002:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263426.505024:0:17044:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39019b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263426.505038:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709802752 00000100:00100000:3.0:1788263426.505043:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709802752 00000100:00100000:3.0:1788263426.505100:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788263426.505108:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+11:17044:x1875129709802752:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788263426.505186:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+11:17044:x1875129709802752:12345-0@lo:503:mount.lustre.0 Request processed in 79us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263426.505192:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788263426.505272:0:17044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283324a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709802752:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788263426.505898:0:17093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283324a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fb36e90-c209-4884-91f2-1155be4ad295:17093:1875129709802880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263426.505936:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263426.506005:0:17093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39019bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788263426.506036:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709802880 00000100:00100000:1.0:1788263426.506042:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709802880 00000100:00100000:1.0:1788263426.506080:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788263426.506092:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+11:17093:x1875129709802880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263426.506708:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+11:17093:x1875129709802880:12345-0@lo:502:llog_process_th.0 Request processed in 492us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263426.506716:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788263426.506888:0:17093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283324a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fb36e90-c209-4884-91f2-1155be4ad295:17093:1875129709802880:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788263426.506935:0:17093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263426.506945:0:17093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263426.506948:0:17093:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788263426.506955:0:17093:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ff28389c800 00000020:00000080:0.0:1788263426.506957:0:17093:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788263426.506965:0:17093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263426.506967:0:17093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263426.506968:0:17093:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788263426.506978:0:17093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263426.506981:0:17093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263426.506982:0:17093:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788263426.506984:0:17093:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ff28389c800 00000020:00000080:0.0:1788263426.506986:0:17093:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788263426.507049:0:17093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263426.507054:0:17093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263426.507055:0:17093:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788263426.507058:0:17093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263426.507060:0:17093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263426.507061:0:17093:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788263426.507064:0:17093:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ff28389c800 00000020:00000080:0.0:1788263426.507066:0:17093:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788263426.507083:0:17093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263426.507086:0:17093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263426.507087:0:17093:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788263426.507089:0:17093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263426.507092:0:17093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263426.507093:0:17093:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788263426.507096:0:17093:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ff28389c800 00000020:00000080:0.0:1788263426.507098:0:17093:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788263426.507135:0:17093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283324a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fb36e90-c209-4884-91f2-1155be4ad295:17093:1875129709803008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263426.507174:0:17093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263426.507330:0:17093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39019bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788263426.507432:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709803008 00000100:00100000:3.0:1788263426.507438:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709803008 00000100:00100000:3.0:1788263426.507514:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788263426.507523:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+11:17093:x1875129709803008:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263426.507738:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+11:17093:x1875129709803008:12345-0@lo:502:llog_process_th.0 Request processed in 215us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263426.507745:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788263426.507824:0:17093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283324a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fb36e90-c209-4884-91f2-1155be4ad295:17093:1875129709803008:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788263426.507846:0:17093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263426.507851:0:17093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263426.507852:0:17093:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788263426.507856:0:17093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788263426.508882:0:17044:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788263426.508907:0:17044:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788263426.508930:0:17044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba6670545 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667054c expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263426.508942:0:17044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba6670545 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667054c expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263426.508995:0:17044:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788263426.509001:0:17044:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ff28389c800 10000000:01000000:3.0:1788263426.509003:0:17044:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ff28389c800 10000000:01000000:3.0:1788263426.509012:0:17044:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788263426.509018:0:17044:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ff28389c800 from 1 10000000:01000000:3.0:1788263426.509020:0:17044:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788263426.509052:0:17044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff38150f000/0x4b1103cba6670553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263426.509060:0:17044:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff38150f000/0x4b1103cba6670553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263426.509069:0:17044:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff38150f000/0x4b1103cba6670553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263426.509089:0:17044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709803136:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788263426.509159:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263426.509330:0:17044:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a275e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263426.509727:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709803136 00000100:00100000:0.0:1788263426.509735:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709803136 00000100:00100000:0.0:1788263426.509816:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788263426.509826:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+11:17044:x1875129709803136:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788263426.509836:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263426.509849:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff283b69e00/0x4b1103cba667055a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba6670553 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263426.509885:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff283b69e00/0x4b1103cba667055a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba6670553 expref: 12 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263426.509898:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff283b69e00/0x4b1103cba667055a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670553 expref: 12 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263426.509907:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b69e00, rc 0) 00000100:00100000:0.0:1788263426.509968:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+12:17044:x1875129709803136:12345-0@lo:101:mount.lustre.0 Request processed in 144us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263426.509975:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788263426.510057:0:17044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709803136:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788263426.510071:0:17044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff38150f000/0x4b1103cba6670553 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667055a expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263426.510081:0:17044:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff38150f000/0x4b1103cba6670553 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba667055a expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263426.510138:0:17044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709803264:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788263426.510178:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263426.510376:0:17044:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a275e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263426.510448:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709803264 00000100:00100000:1.0:1788263426.510453:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709803264 00000100:00100000:1.0:1788263426.510476:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788263426.510482:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+12:17044:x1875129709803264:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788263426.510627:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+12:17044:x1875129709803264:12345-0@lo:501:mount.lustre.0 Request processed in 144us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263426.510646:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788263426.512852:0:17044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709803264:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788263426.512914:0:17044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709803392:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788263426.512986:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263426.513042:0:17044:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a275e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263426.513119:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709803392 00000100:00100000:1.0:1788263426.513125:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709803392 00000100:00100000:1.0:1788263426.513179:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788263426.513189:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+12:17044:x1875129709803392:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788263426.513313:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+12:17044:x1875129709803392:12345-0@lo:503:mount.lustre.0 Request processed in 125us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263426.513320:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788263426.513488:0:17044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709803392:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788263426.518032:0:17097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fb36e90-c209-4884-91f2-1155be4ad295:17097:1875129709803520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263426.518112:0:17097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263426.518197:0:17097:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a9671300 going to sleep for 11 seconds 00000100:00100000:3.0:1788263426.518238:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709803520 00000100:00100000:3.0:1788263426.518246:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709803520 00000100:00100000:3.0:1788263426.518321:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788263426.518333:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+12:17097:x1875129709803520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263426.518469:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+12:17097:x1875129709803520:12345-0@lo:502:llog_process_th.0 Request processed in 139us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263426.518477:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788263426.518811:0:17097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fb36e90-c209-4884-91f2-1155be4ad295:17097:1875129709803520:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788263426.518870:0:17097:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788263426.518884:0:17097:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9ff28322b370) 00000020:00000080:3.0:1788263426.518905:0:17097:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1788263426.518992:0:17097:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ff28389c800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788263426.518996:0:17097:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ff28389c800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788263426.518999:0:17097:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ff28389c800 4 00010000:00080000:3.0:1788263426.519026:0:17097:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ff281e03800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.126@tcp at head 00010000:00010000:3.0:1788263426.521822:0:17097:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1788263426.522025:0:17097:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788263426.522069:0:17097:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788263426.522083:0:17097:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4b1103cba6670568 00000100:00080000:3.0:1788263426.522094:0:17097:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788263426.522100:0:17097:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ff281e03800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788263426.522133:0:17097:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff283988000 x1875129709803648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788263426.522198:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875129709803648:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788263426.522272:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788263426.522332:0:17097:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788263426.523754:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709803648 00000100:00100000:0.0:1788263426.523764:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709803648 00000100:00100000:0.0:1788263426.523798:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788263426.523805:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875129709803648:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788263426.523883:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875129709803648:12345-0@lo:38:llog_process_th.0 Request processed in 77us (1611us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788263426.523890:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788263426.523930:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788263426.523936:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff281e03800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788263426.523940:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788263426.523944:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875129709803648:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788263426.526370:0:17097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fb36e90-c209-4884-91f2-1155be4ad295:17097:1875129709803776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263426.527829:0:17097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263426.527876:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709803776 00000100:00100000:3.0:1788263426.527880:0:17097:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a0d8ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263426.527885:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709803776 00000100:00100000:0.0:1788263426.527930:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788263426.527940:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+12:17097:x1875129709803776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263426.528068:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+12:17097:x1875129709803776:12345-0@lo:502:llog_process_th.0 Request processed in 128us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263426.528081:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788263426.529265:0:17097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fb36e90-c209-4884-91f2-1155be4ad295:17097:1875129709803776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263426.529331:0:17097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fb36e90-c209-4884-91f2-1155be4ad295:17097:1875129709803904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263426.529383:0:17097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263426.529421:0:17097:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff398e9e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788263426.529437:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709803904 00000100:00100000:3.0:1788263426.529442:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709803904 00000100:00100000:3.0:1788263426.529483:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788263426.529492:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+12:17097:x1875129709803904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263426.529611:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+12:17097:x1875129709803904:12345-0@lo:502:llog_process_th.0 Request processed in 120us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263426.529619:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788263426.529655:0:17097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fb36e90-c209-4884-91f2-1155be4ad295:17097:1875129709803904:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788263426.529675:0:17097:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788263426.529901:0:17044:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788263426.529922:0:17044:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788263426.529938:0:17044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff38150f000/0x4b1103cba6670553 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667055a expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263426.529949:0:17044:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff38150f000/0x4b1103cba6670553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667055a expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788263426.529992:0:17044:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788263426.529994:0:17044:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788263426.529995:0:17044:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263426.529996:0:17044:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263426.530002:0:17044:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263426.530003:0:17044:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263426.530004:0:17044:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788263426.530005:0:17044:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788263426.530006:0:17044:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263426.530008:0:17044:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788263426.530011:0:17044:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788263426.530013:0:17044:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788263426.530014:0:17044:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788263426.530015:0:17044:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263426.530016:0:17044:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263426.530017:0:17044:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263426.530018:0:17044:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263426.530018:0:17044:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788263426.530019:0:17044:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788263426.530020:0:17044:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263426.530021:0:17044:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788263426.530034:0:17044:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788263426.530043:0:17044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709804032:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788263426.530074:0:17044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263426.530095:0:17044:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff398e9e540 going to sleep for 11 seconds 00000100:00100000:1.0:1788263426.530166:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709804032 00000100:00100000:1.0:1788263426.530171:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709804032 00000100:00100000:1.0:1788263426.530205:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788263426.530213:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+12:17044:x1875129709804032:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788263426.530234:0:17059:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788263426.530247:0:17059:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788263426.535487:0:17059:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788263426.535506:0:17059:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788263426.535949:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+12:17044:x1875129709804032:12345-0@lo:253:mount.lustre.0 Request processed in 5732us (5869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263426.535961:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:3.0:1788263426.536414:0:17081:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788263426.536420:0:17081:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788263426.536439:0:17081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ff38150fa00/0x4b1103cba667056f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263426.536454:0:17081:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff3bf6d1400/0x4b1103cba667053e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670537 expref: 11 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263426.536463:0:17081:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ff38150fa00/0x4b1103cba667056f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263426.536500:0:17081:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff3bf6d1400/0x4b1103cba667053e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba6670537 expref: 11 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263426.536516:0:17081:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ff3bf6d1400/0x4b1103cba667053e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba6670537 expref: 11 pid: 17059 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263426.536551:0:17081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17081:1875129709804160:0@lo:104: 00000100:00100000:3.0:1788263426.536736:0:17081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263426.536778:0:17081:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff398e9eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788263426.536816:0:17044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17044:1875129709804032:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788263426.536827:0:17044:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788263426.536830:0:17044:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788263426.536832:0:17044:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788263426.536833:0:17044:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263426.536834:0:17044:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263426.536836:0:17044:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263426.536837:0:17044:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263426.536839:0:17044:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788263426.536840:0:17044:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788263426.536842:0:17044:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263426.536844:0:17044:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788263426.536856:0:17044:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788263426.536943:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709804160 00000100:00100000:1.0:1788263426.536950:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709804160 00000100:00100000:1.0:1788263426.536992:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263426.537001:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283989f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fb36e90-c209-4884-91f2-1155be4ad295+3:17081:x1875129709804160:12345-0@lo:104: 00010000:00010000:1.0:1788263426.537085:0:17048:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba667053e expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263426.537176:0:17048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788263426.537183:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283989f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fb36e90-c209-4884-91f2-1155be4ad295+3:17081:x1875129709804160:12345-0@lo:104: Request processed in 184us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263426.537189:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263426.537234:0:17081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17081:1875129709804160:0@lo:104: 00010000:00010000:1.0:1788263426.537266:0:17081:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ff38150fa00/0x4b1103cba667056f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263426.537284:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263426.537289:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba667053e expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263426.537297:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b68c00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:1.0:1788263426.537301:0:17054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba667053e expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263426.537309:0:17054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba667053e expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263426.537317:0:17054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba667053e expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263426.537323:0:17054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788263426.537351:0:17054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670537 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba667053e expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263426.537374:0:17054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263426.537405:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670537 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba667053e expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263426.537412:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670537 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba667053e expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263426.537426:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263426.537428:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263426.537429:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263426.537480:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fb36e90-c209-4884-91f2-1155be4ad295:3621:1875129709804288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788263426.537509:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263426.537570:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709804288 00000100:00100000:1.0:1788263426.537574:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709804288 00010000:00010000:1.0:1788263426.537647:0:17050:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff3bf6d1400/0x4b1103cba667053e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba6670537 expref: 12 pid: 17059 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263426.537670:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263426.537676:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fb36e90-c209-4884-91f2-1155be4ad295+12:3621:x1875129709804288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788263426.537687:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263426.537692:0:17050:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff3bf6d1400/0x4b1103cba667053e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba6670537 expref: 12 pid: 17059 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263426.537702:0:17050:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff3bf6d1400/0x4b1103cba667053e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba6670537 expref: 12 pid: 17059 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263426.537716:0:17050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3bf6d1400/0x4b1103cba667053e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba6670537 expref: 12 pid: 17059 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263426.537868:0:17050:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ff38150fa00/0x4b1103cba667056f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263426.537878:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff38150fa00/0x4b1103cba667056f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788263426.537925:0:17050:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001505980s 00010000:00010000:1.0:1788263426.537930:0:17050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff38150fa00/0x4b1103cba667056f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263426.537937:0:17050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff38150fa00/0x4b1103cba667056f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263426.537945:0:17050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ff38150fa00/0x4b1103cba667056f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263426.537951:0:17050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ff38150fa00/0x4b1103cba667056f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263426.537957:0:17050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150fa00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:1.0:1788263426.537962:0:17050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ff38150fa00/0x4b1103cba667056f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263426.537984:0:17050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ff38150fa00/0x4b1103cba667056f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263426.538025:0:17050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ff38150fa00/0x4b1103cba667056f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263426.538035:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263426.538109:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fb36e90-c209-4884-91f2-1155be4ad295+11:3621:x1875129709804288:12345-0@lo:103:ldlm_bl.0 Request processed in 423us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263426.538118:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788263426.538165:0:17081:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ff38150fa00/0x4b1103cba667056f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263426.538173:0:17081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ff38150fa00/0x4b1103cba667056f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263426.538194:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff38150fa00/0x4b1103cba667056f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263426.538263:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fb36e90-c209-4884-91f2-1155be4ad295:3621:1875129709804288:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788263426.551425:0:17044:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788263426.552001:0:17044:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788263426.553466:0:17105:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788263426.553471:0:17105:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788263426.558564:0:17106:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788263426.558803:0:17044:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1788263426.559251:0:17106:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1788263426.559328:0:17107:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9ff2833e1180 x1875129709804416/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263426.559341:0:17107:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3813590c0 going to sleep for 0 seconds 00000040:01000000:3.0:1788263426.559909:0:17044:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788263426.559972:0:17044:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788263426.560711:0:17044:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788263426.560720:0:17044:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788263426.560765:0:17044:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788263426.563302:0:17044:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788263426.564716:0:17044:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788263426.564768:0:17044:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788263426.565378:0:17106:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788263426.565431:0:17106:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1788263426.566242:0:17044:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:3.0:1788263426.567337:0:17044:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1788263426.573828:0:17044:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788263426.576154:0:17044:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788263426.576194:0:17044:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffad45c1923988 00100000:10000000:3.0:1788263426.576211:0:17044:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788263426.578855:0:17044:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788263426.578873:0:17044:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.126@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788263426.578894:0:17044:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1788263426.578915:0:17044:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788263426.580809:0:17044:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788263426.581035:0:17044:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788263427.311738:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263427.567702:0:17107:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3813590c0 going to sleep for 0 seconds 00000040:00080000:0.0:1788263427.568895:0:17101:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788263427.568902:0:17101:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788263427.572812:0:17101:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:0.0:1788263427.572824:0:17101:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:1.0:1788263427.695669:0:17062:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788263427.695677:0:17062:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ff28389c800 from 7 10000000:01000000:1.0:1788263427.695682:0:17062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788263427.695731:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff381680200/0x4b1103cba6670576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263427.695743:0:17062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff381680200/0x4b1103cba6670576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263427.695754:0:17062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff381680200/0x4b1103cba6670576 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263427.695780:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709804544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788263427.695966:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263427.696093:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3861bb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263427.702336:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709804544 00000100:00100000:3.0:1788263427.702350:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709804544 00000100:00100000:2.0:1788263427.702531:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788263427.702542:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+11:17062:x1875129709804544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263427.702560:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263427.702603:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3bf6d1800/0x4b1103cba667057d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba6670576 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263427.702635:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3bf6d1800/0x4b1103cba667057d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba6670576 expref: 12 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263427.702646:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3bf6d1800/0x4b1103cba667057d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670576 expref: 12 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263427.702668:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d1800, rc 0) 00000100:00100000:2.0:1788263427.702756:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+12:17062:x1875129709804544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 217us (6790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263427.702764:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788263427.703132:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709804544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263427.703150:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff381680200/0x4b1103cba6670576 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667057d expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263427.703161:0:17062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff381680200/0x4b1103cba6670576 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba667057d expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263427.703306:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709804672:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788263427.703347:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263427.703475:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae57a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788263427.704684:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709804672 00000100:00100000:1.0:1788263427.704698:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709804672 00000100:00100000:1.0:1788263427.705167:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788263427.705179:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+12:17062:x1875129709804672:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788263427.705201:0:17059:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788263427.705230:0:17059:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788263427.705234:0:17059:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788263427.705355:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+12:17062:x1875129709804672:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 179us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263427.705363:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788263427.705414:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709804672:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788263427.705463:0:17062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788263427.705473:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff381680200/0x4b1103cba6670576 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667057d expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263427.705485:0:17062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff381680200/0x4b1103cba6670576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667057d expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263428.338399:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788263428.591685:0:17101:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788263428.591692:0:17101:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788263428.591782:0:17101:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788263428.591813:0:17101:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788263428.591954:0:17101:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000100:00100000:1.0:1788263428.592046:0:17107:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3813590c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788263429.359693:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263429.617938:0:17107:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3813590c0 going to sleep for 0 seconds 00000001:02000400:1.0:1788263430.237350:0:17350:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788263430.389746:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263430.639875:0:17107:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3813590c0 going to sleep for 0 seconds 00000020:00000004:2.0:1788263430.907291:0:17402:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788263430.907463:0:17402:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788263431.412658:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263431.663654:0:17107:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3813590c0 going to sleep for 0 seconds 00000020:00000004:1.0:1788263431.701819:0:17452:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788263431.702011:0:17452:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:3.0:1788263431.729177:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788263431.729184:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788263431.729187:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ff3bc672800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788263431.729195:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 435 00000100:00080000:3.0:1788263431.729202:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788263431.729208:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ff3bc672800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788263431.729231:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff28398a680 x1875129709804928/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788263431.729244:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788263431.729247:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788263431.729251:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788263431.729254:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788263431.729257:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788263431.729259:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788263431.729261:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ff281e03800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788263431.729266:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ff281e03800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788263431.729280:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff283988000 x1875129709805056/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788263431.729360:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fb36e90-c209-4884-91f2-1155be4ad295:3618:1875129709804800:0@lo:400:kworker.0 00000100:00100000:3.0:1788263431.729431:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263431.729550:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709804800 00000100:00100000:3.0:1788263431.729559:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709804800 00000100:00100000:3.0:1788263431.729631:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788263431.729649:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+12:3618:x1875129709804800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263431.729702:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+12:3618:x1875129709804800:12345-0@lo:400:kworker.0 Request processed in 56us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263431.729710:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788263431.729760:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fb36e90-c209-4884-91f2-1155be4ad295:3618:1875129709804800:0@lo:400:kworker.0 00000100:00100000:2.0:1788263431.732034:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709804928:0@lo:38:kworker.0 00000100:00100000:2.0:1788263431.732101:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263431.732141:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875129709805056:0@lo:38:kworker.0 00000100:00100000:2.0:1788263431.732169:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263431.732340:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709804928 00000100:00100000:3.0:1788263431.732348:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709804928 00000100:00100000:3.0:1788263431.732387:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788263431.732396:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875129709804928:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788263431.732414:0:17071:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788263431.733282:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709805056 00000100:00100000:0.0:1788263431.733289:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709805056 00000100:00100000:0.0:1788263431.733365:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788263431.733372:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875129709805056:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788263431.733395:0:17067:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:0.0:1788263431.733429:0:17067:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4b1103cba6670584 00000004:00100000:0.0:1788263431.733445:0:17067:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788263431.735173:0:17067:0:(import.c:65:import_set_state_nolock()) ffff9ff28334b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263431.735277:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875129709805056:12345-0@lo:38:kworker.0 Request processed in 1903us (3105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263431.735288:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788263431.736461:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ff283988000 x1875129709805056/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788263441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788263431.736502:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788263431.736510:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788263431.736515:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788263431.736518:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff281e03800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788263431.736525:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875129709805056:0@lo:38:kworker.0 00000100:00100000:2.0:1788263431.749753:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875129709804928:12345-0@lo:38:kworker.0 Request processed in 17348us (17642us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788263431.749773:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788263431.750321:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3bc672800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788263431.750329:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788263431.750343:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709804928:0@lo:38:kworker.0 00010000:00010000:1.0:1788263432.432351:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263432.687720:0:17107:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3813590c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788263433.456704:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263433.716423:0:17107:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3813590c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788263434.485671:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263434.736785:0:17107:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3813590c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788263435.503756:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263435.760669:0:17107:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3813590c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788263436.528729:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263436.788801:0:17107:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3813590c0 going to sleep for 0 seconds 00000100:00080000:2.0:1788263436.854288:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788263436.854355:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788263436.854359:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ff3bc672800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788263436.854368:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 440 00000100:00080000:2.0:1788263436.854382:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788263436.854388:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ff3bc672800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263436.854410:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff3b5473100 x1875129709805312/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788263436.854433:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788263436.854436:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788263436.854439:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788263436.854442:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788263436.854496:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709805440:0@lo:400:kworker.0 00000100:00100000:3.0:1788263436.855063:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fb36e90-c209-4884-91f2-1155be4ad295:3619:1875129709805184:0@lo:400:kworker.0 00000100:00100000:3.0:1788263436.855121:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263436.855189:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709805184 00000100:00100000:3.0:1788263436.855196:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709805184 00000100:00100000:3.0:1788263436.855239:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788263436.855248:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+12:3619:x1875129709805184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263436.855417:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263436.855948:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+12:3619:x1875129709805184:12345-0@lo:400:kworker.0 Request processed in 699us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263436.855957:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788263436.856013:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fb36e90-c209-4884-91f2-1155be4ad295:3619:1875129709805184:0@lo:400:kworker.0 00000100:00100000:0.0:1788263436.856091:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263426/real 1788263426] req@ffff9ff3b5471180 x1875129709801984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263436 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263436.856107:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ff3b5471180 x1875129709801984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263436 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263436.856153:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263426/real 1788263426] req@ffff9ff283326d80 x1875129709801856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263436 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263436.856166:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ff283326d80 x1875129709801856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263436 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263436.856179:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709805312:0@lo:38:kworker.0 00000100:00100000:0.0:1788263436.856224:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788263436.856253:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3843fb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788263436.856268:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788263436.856271:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709801984:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788263436.856276:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3af7da000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788263436.856281:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788263436.856284:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709801856:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788263436.857438:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709805440 00000100:00100000:0.0:1788263436.857449:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709805440 00000100:00100000:0.0:1788263436.857500:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788263436.857508:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709805440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263436.857635:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709805312 00000100:00100000:3.0:1788263436.857640:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709805312 00000100:00100000:3.0:1788263436.857662:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788263436.857667:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875129709805312:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788263436.857686:0:17070:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788263436.858419:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709805440:12345-0@lo:400:kworker.0 Request processed in 908us (2999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263436.858428:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788263436.858496:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ff3b5472d80 x1875129709805440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263436.858510:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709805440:0@lo:400:kworker.0 00000100:00080000:0.0:1788263436.859357:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788263436.859364:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788263436.859367:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ff3af7da000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788263436.859372:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 435 00000100:00080000:0.0:1788263436.859377:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788263436.859382:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ff3af7da000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:0.0:1788263436.859411:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff283326d80 x1875129709805568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788263436.859432:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788263436.859435:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788263436.859436:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ff3843fb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788263436.859439:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 435 00000100:00080000:0.0:1788263436.859442:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788263436.859445:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ff3843fb800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:0.0:1788263436.859466:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff283324e00 x1875129709805696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788263436.859494:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709805568:0@lo:8:kworker.0 00000400:00000100:0.0:1788263436.860636:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875129709805568 offset 0 length 520: 4 00000100:00100000:0.0:1788263436.860686:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709805696:0@lo:8:kworker.0 00000400:00000100:0.0:1788263436.860715:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875129709805696 offset 0 length 520: 4 00000100:00100000:3.0:1788263436.896867:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875129709805312:12345-0@lo:38:kworker.0 Request processed in 39188us (40632us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788263436.896880:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788263436.899521:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3bc672800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788263436.899549:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788263436.899555:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709805312:0@lo:38:kworker.0 00000020:01000004:1.0:1788263437.441197:0:17797:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788263437.441201:0:17797:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788263437.441202:0:17797:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788263437.441424:0:17797:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ff283349800 00000020:01000004:1.0:1788263437.441440:0:17797:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1788263437.441468:0:17797:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788263437.441482:0:17797:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9ff3b3a619b8) 00000020:00000080:1.0:1788263437.441501:0:17797:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788263437.497172:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788263437.498376:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1788263437.500703:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788263437.500927:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1788263437.501098:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788263437.501847:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788263437.502043:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788263437.502694:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1788263437.502971:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1788263437.503220:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788263437.503506:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788263437.503736:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788263437.503916:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788263437.504115:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788263437.506259:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788263437.506572:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788263437.507107:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788263437.507276:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1788263437.507556:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1788263437.507746:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788263437.508083:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788263437.508277:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1788263437.508678:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788263437.508880:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788263437.509068:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1788263437.509263:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788263437.509526:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788263437.509750:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788263437.509955:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788263437.510324:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1788263437.510597:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1788263437.510766:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788263437.510929:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1788263437.511109:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788263437.511334:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788263437.511565:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1788263437.511864:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788263437.512026:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1788263437.512236:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788263437.512488:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788263437.512696:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788263437.512863:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788263437.513059:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788263437.513265:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788263437.513653:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1788263437.513869:0:17797:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00080000:01000000:0.0:1788263437.514972:0:17797:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788263437.515177:0:17797:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788263437.515187:0:17797:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788263437.515198:0:17797:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b1103cba6670592 00000020:01000004:0.0:1788263437.515205:0:17797:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788263437.515224:0:17797:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.126@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788263437.515230:0:17797:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788263437.515236:0:17797:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788263437.515261:0:17797:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788263437.515265:0:17797:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.126@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788263437.518979:0:17797:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788263437.519017:0:17797:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.126@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1788263437.519022:0:17797:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788263437.519023:0:17797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788263437.519025:0:17797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788263437.519026:0:17797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788263437.519027:0:17797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788263437.519028:0:17797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788263437.519030:0:17797:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788263437.519032:0:17797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788263437.519033:0:17797:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788263437.519036:0:17797:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1788263437.519039:0:17797:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788263437.519045:0:17797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788263437.519046:0:17797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788263437.519047:0:17797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788263437.519048:0:17797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788263437.519049:0:17797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788263437.519050:0:17797:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788263437.519051:0:17797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788263437.519052:0:17797:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788263437.519078:0:17797:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788263437.519096:0:17797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709805824:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788263437.519159:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263437.519602:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709805824 00000100:00100000:3.0:1788263437.519610:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709805824 00000100:00100000:0.0:1788263437.519794:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a9617900 going to sleep for 11 seconds 00000100:00100000:3.0:1788263437.519893:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788263437.519903:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+12:17797:x1875129709805824:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788263437.519931:0:17058:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788263437.519934:0:17058:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1788263437.519941:0:17058:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788263437.520304:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+12:17797:x1875129709805824:12345-0@lo:253:mount.lustre.0 Request processed in 401us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263437.520312:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788263437.520381:0:17797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709805824:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788263437.520392:0:17797:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788263437.520404:0:17797:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788263437.520407:0:17797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788263437.520408:0:17797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788263437.520409:0:17797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788263437.520409:0:17797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788263437.520410:0:17797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788263437.520412:0:17797:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788263437.520413:0:17797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788263437.520414:0:17797:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788263437.520430:0:17797:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ff283349800 from lustre-MDT0001 10000000:01000000:0.0:1788263437.520464:0:17797:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788263437.520467:0:17797:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788263437.520473:0:17797:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ff3af7e19b8 local copy 00010000:00010000:0.0:1788263437.520482:0:17797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0600/0x4b1103cba6670488 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667048f expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263437.520604:0:17797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709805952:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263437.520643:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263437.521126:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a9617e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788263437.521178:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709805952 00000100:00100000:1.0:1788263437.521184:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709805952 00000100:00100000:1.0:1788263437.521209:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788263437.521216:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+12:17797:x1875129709805952:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788263437.521412:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+12:17797:x1875129709805952:12345-0@lo:501:mount.lustre.0 Request processed in 195us (767us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788263437.521418:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788263437.521754:0:17797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709805952:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788263437.521777:0:17797:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788263437.521795:0:17797:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788263437.521801:0:17797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0600/0x4b1103cba6670488 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667048f expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263437.521810:0:17797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0600/0x4b1103cba6670488 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667048f expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263437.521833:0:17797:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ff283349800 10000000:01000000:0.0:1788263437.521837:0:17797:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788263437.521841:0:17797:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ff3af7e19b8 10000000:01000000:0.0:1788263437.521843:0:17797:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788263437.521846:0:17797:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9ff3af7e19b8 from 1 10000000:01000000:0.0:1788263437.521849:0:17797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788263437.521869:0:17797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff283b68800/0x4b1103cba6670599 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263437.521876:0:17797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff283b68800/0x4b1103cba6670599 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263437.521883:0:17797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff283b68800/0x4b1103cba6670599 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263437.521896:0:17797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709806080:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788263437.521923:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263437.521981:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a9617e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788263437.522025:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709806080 00000100:00100000:2.0:1788263437.522030:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709806080 00000100:00100000:1.0:1788263437.522076:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788263437.522085:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+12:17797:x1875129709806080:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788263437.522102:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263437.522114:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff381680a00/0x4b1103cba66705a0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba6670599 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263437.522134:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff381680a00/0x4b1103cba66705a0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba6670599 expref: 13 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263437.522145:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff381680a00/0x4b1103cba66705a0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670599 expref: 13 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263437.522153:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381680a00, rc 0) 00000100:00100000:1.0:1788263437.522188:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+13:17797:x1875129709806080:12345-0@lo:101:mount.lustre.0 Request processed in 105us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263437.522193:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788263437.522266:0:17797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709806080:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788263437.522278:0:17797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff283b68800/0x4b1103cba6670599 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66705a0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263437.522301:0:17797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff283b68800/0x4b1103cba6670599 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba66705a0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263437.522315:0:17797:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788263437.522362:0:17797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff283b68800/0x4b1103cba6670599 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66705a0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263437.522368:0:17797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff283b68800/0x4b1103cba6670599 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66705a0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263437.522375:0:17797:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ff283349800 10000000:01000000:0.0:1788263437.522378:0:17797:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788263437.522381:0:17797:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ff283349800 from 1 10000000:01000000:0.0:1788263437.522383:0:17797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788263437.522402:0:17797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff283b69a00/0x4b1103cba66705a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263437.522409:0:17797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff283b69a00/0x4b1103cba66705a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263437.522415:0:17797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff283b69a00/0x4b1103cba66705a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263437.522426:0:17797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709806208:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788263437.522457:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263437.522477:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a9617e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788263437.522861:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709806208 00000100:00100000:1.0:1788263437.522867:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709806208 00000100:00100000:1.0:1788263437.522904:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788263437.522912:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+13:17797:x1875129709806208:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788263437.522920:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263437.522929:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff381681600/0x4b1103cba66705ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba66705a7 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263437.522945:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff381681600/0x4b1103cba66705ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba66705a7 expref: 14 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263437.522955:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff381681600/0x4b1103cba66705ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba66705a7 expref: 14 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263437.522962:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381681600, rc 0) 00000100:00100000:1.0:1788263437.523001:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+14:17797:x1875129709806208:12345-0@lo:101:mount.lustre.0 Request processed in 91us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263437.523007:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788263437.523083:0:17797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709806208:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788263437.523096:0:17797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff283b69a00/0x4b1103cba66705a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66705ae expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263437.523110:0:17797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff283b69a00/0x4b1103cba66705a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba66705ae expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263437.523123:0:17797:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788263437.523489:0:17797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff283b69a00/0x4b1103cba66705a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66705ae expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263437.523497:0:17797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff283b69a00/0x4b1103cba66705a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66705ae expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263437.523505:0:17797:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788263437.523509:0:17797:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788263437.523524:0:17797:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ff283349800 10000000:01000000:0.0:1788263437.523527:0:17797:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788263437.523530:0:17797:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788263437.523532:0:17797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788263437.523552:0:17797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff283b68e00/0x4b1103cba66705b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263437.523560:0:17797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff283b68e00/0x4b1103cba66705b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263437.523567:0:17797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff283b68e00/0x4b1103cba66705b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263437.523608:0:17797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709806336:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788263437.523860:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263437.523891:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a9617e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788263437.523943:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709806336 00000100:00100000:1.0:1788263437.523947:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709806336 00000100:00100000:1.0:1788263437.523982:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788263437.523988:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+14:17797:x1875129709806336:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788263437.523996:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263437.524005:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff381681400/0x4b1103cba66705bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba66705b5 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263437.524021:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff381681400/0x4b1103cba66705bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba66705b5 expref: 15 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263437.524030:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff381681400/0x4b1103cba66705bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba66705b5 expref: 15 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263437.524037:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381681400, rc 0) 00000100:00100000:1.0:1788263437.524072:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+15:17797:x1875129709806336:12345-0@lo:101:mount.lustre.0 Request processed in 83us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263437.524077:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788263437.524141:0:17797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709806336:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788263437.524152:0:17797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff283b68e00/0x4b1103cba66705b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66705bc expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263437.524159:0:17797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff283b68e00/0x4b1103cba66705b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba66705bc expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788263437.525908:0:17797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:0.0:1788263437.526813:0:17797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788263437.533408:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788263437.533474:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1788263437.533489:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1788263437.533499:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1788263437.533509:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1788263437.533707:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1788263437.533725:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1788263437.533738:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1788263437.533753:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1788263437.533768:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1788263437.533781:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1788263437.533794:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1788263437.533805:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1788263437.533816:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1788263437.533826:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1788263437.533836:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1788263437.533847:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1788263437.533858:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1788263437.533869:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1788263437.533881:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1788263437.533895:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1788263437.533907:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788263437.533918:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788263437.533960:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1788263437.533966:0:17797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1788263437.534078:0:17797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709806464:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263437.534144:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263437.534237:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ad888cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263437.534279:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709806464 00000100:00100000:1.0:1788263437.534345:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709806464 00000100:00100000:1.0:1788263437.534425:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788263437.534434:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+15:17797:x1875129709806464:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788263437.534820:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+15:17797:x1875129709806464:12345-0@lo:501:mount.lustre.0 Request processed in 386us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263437.534828:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788263437.534947:0:17797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709806464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263437.534983:0:17797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5472a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709806592:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788263437.535064:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263437.535093:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3853e2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788263437.535150:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709806592 00000100:00100000:3.0:1788263437.535155:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709806592 00000100:00100000:3.0:1788263437.535221:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788263437.535230:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+15:17797:x1875129709806592:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788263437.536199:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+15:17797:x1875129709806592:12345-0@lo:503:mount.lustre.0 Request processed in 966us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263437.536208:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788263437.536359:0:17797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5472a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709806592:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788263437.537176:0:17797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788263437.537267:0:17797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5472a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709806720:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788263437.537415:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263437.537510:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3853e2540 going to sleep for 11 seconds 00000100:00100000:1.0:1788263437.537816:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709806720 00000100:00100000:1.0:1788263437.537822:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709806720 00000100:00100000:1.0:1788263437.537885:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788263437.537893:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+15:17797:x1875129709806720:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788263437.538507:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+15:17797:x1875129709806720:12345-0@lo:502:mount.lustre.0 Request processed in 612us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263437.538523:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788263437.538624:0:17797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5472a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709806720:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788263437.538828:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788263437.538858:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:2.0:1788263437.538869:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:2.0:1788263437.538879:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:2.0:1788263437.538891:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:2.0:1788263437.538902:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:2.0:1788263437.538928:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:2.0:1788263437.538943:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:2.0:1788263437.538954:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:2.0:1788263437.538967:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:2.0:1788263437.538980:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:2.0:1788263437.538992:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:2.0:1788263437.539004:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:2.0:1788263437.539017:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:2.0:1788263437.539029:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:2.0:1788263437.539040:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:2.0:1788263437.539053:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:2.0:1788263437.539065:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:2.0:1788263437.539078:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:2.0:1788263437.539089:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:2.0:1788263437.539100:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:2.0:1788263437.539110:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:2.0:1788263437.539133:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:2.0:1788263437.539147:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:2.0:1788263437.539158:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:2.0:1788263437.539169:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:2.0:1788263437.539182:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:2.0:1788263437.539195:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:2.0:1788263437.539209:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1788263437.539223:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1788263437.539235:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1788263437.539247:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1788263437.539260:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:2.0:1788263437.539271:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:2.0:1788263437.539308:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1788263437.539326:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1788263437.539338:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1788263437.539350:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1788263437.539380:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1788263437.539393:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1788263437.539405:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1788263437.539417:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1788263437.539429:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1788263437.539441:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1788263437.539486:0:17797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5472a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709806848:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788263437.539539:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263437.543780:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3853e2540 going to sleep for 11 seconds 00000100:00100000:0.0:1788263437.543910:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709806848 00000100:00100000:0.0:1788263437.543920:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709806848 00000100:00100000:0.0:1788263437.543969:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788263437.543977:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+15:17797:x1875129709806848:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788263437.544121:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+15:17797:x1875129709806848:12345-0@lo:502:mount.lustre.0 Request processed in 144us (4582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263437.544128:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788263437.544272:0:17797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5472a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709806848:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788263437.544410:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1788263437.544423:0:17797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1788263437.545359:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788263437.545375:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263437.545378:0:17801:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788263437.545383:0:17801:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788263437.545386:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788263437.545399:0:17801:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9ff3b3a60000) 00000020:00000080:1.0:1788263437.545420:0:17801:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1788263437.545425:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788263437.545750:0:17801:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788263437.545758:0:17801:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b1103cba66705ca 00000020:00000080:1.0:1788263437.545947:0:17801:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788263437.545953:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263437.545957:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263437.545958:0:17801:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788263437.545960:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788263437.545964:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263437.545965:0:17801:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788263437.545968:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788263437.545975:0:17801:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9ff3b3a63370) 00000020:00000080:1.0:1788263437.545985:0:17801:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788263437.545989:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788263437.545990:0:17801:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788263437.545993:0:17801:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788263437.546016:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788263437.546239:0:17801:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ff283349800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788263437.546260:0:17801:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9ff3aec2b370) 00000020:00000080:1.0:1788263437.546272:0:17801:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788263437.546408:0:17801:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788263437.546417:0:17801:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b1103cba66705df 00000020:00000080:1.0:1788263437.546795:0:17801:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788263437.546804:0:17801:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788263437.546810:0:17801:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x4b1103cba66705e6 00080000:01000000:1.0:1788263437.546816:0:17801:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788263437.546822:0:17801:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b1103cba66705ed 00010000:00010000:0.0:1788263437.551870:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263437.620897:0:17801:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1788263437.621368:0:17801:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:0.0:1788263437.621785:0:17801:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788263437.622934:0:17801:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788263437.622946:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263437.622953:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263437.622955:0:17801:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788263437.622958:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788263437.622963:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263437.622964:0:17801:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788263437.622967:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788263437.622972:0:17801:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:00000080:1.0:1788263437.622999:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788263437.623014:0:17801:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9ff3aec28000) 00000020:00000080:1.0:1788263437.623045:0:17801:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788263437.623051:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788263437.623110:0:17801:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788263437.623117:0:17801:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788263437.623122:0:17801:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b1103cba66705fb 00010000:00080000:1.0:1788263437.623153:0:17801:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ff283370800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.126@tcp at head 00010000:00010000:1.0:1788263437.626999:0:17801:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1788263437.633954:0:17801:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788263437.633971:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788263437.634017:0:17801:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788263437.634040:0:17801:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b1103cba6670602 00000100:00080000:0.0:1788263437.634049:0:17801:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788263437.634056:0:17801:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ff283370800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:0.0:1788263437.634093:0:17801:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff283326300 x1875129709806976/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788263437.634162:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709806976:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788263437.634231:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788263437.635420:0:17801:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1788263437.635528:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263437.635533:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263437.635535:0:17801:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788263437.635547:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788263437.635550:0:17801:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788263437.635552:0:17801:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788263437.635553:0:17801:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788263437.635555:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788263437.635558:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263437.635559:0:17801:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788263437.635561:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263437.635566:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263437.635568:0:17801:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788263437.635571:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788263437.635759:0:17801:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788263437.635777:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263437.635780:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263437.635782:0:17801:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788263437.635784:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788263437.635786:0:17801:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1788263437.635787:0:17801:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788263437.635789:0:17801:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788263437.635790:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788263437.635792:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263437.635794:0:17801:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788263437.635796:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788263437.635799:0:17801:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788263437.635802:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263437.635803:0:17801:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788263437.635805:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788263437.635809:0:17801:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:01000000:0.0:1788263437.635832:0:17801:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788263437.635834:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788263437.635849:0:17801:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9ff3b0050000) 00000020:00000080:0.0:1788263437.635864:0:17801:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788263437.635869:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788263437.635933:0:17801:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788263437.635940:0:17801:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788263437.635946:0:17801:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b1103cba6670610 00010000:00080000:0.0:1788263437.635977:0:17801:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ff39ab18800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.126@tcp at head 00010000:00010000:0.0:1788263437.636204:0:17801:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:0.0:1788263437.638347:0:17801:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788263437.638724:0:17801:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1788263437.638952:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788263437.638959:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788263437.638962:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ff3bc672800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788263437.638970:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 445 00000100:00080000:1.0:1788263437.638982:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788263437.638988:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ff3bc672800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:1.0:1788263437.639034:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff2833e0e00 x1875129709807104/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:00080000:0.0:1788263437.640297:0:17801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788263437.640558:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709807104:0@lo:38:kworker.0 00000100:00100000:2.0:1788263437.640783:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263437.640846:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709806976 00000100:00100000:2.0:1788263437.640853:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709806976 00000100:00100000:2.0:1788263437.640873:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709807104 00000100:00100000:2.0:1788263437.640875:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709807104 00000100:00100000:2.0:1788263437.640885:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788263437.640892:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875129709806976:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788263437.640914:0:17071:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:2.0:1788263437.640946:0:17071:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b1103cba6670617 00000004:00100000:2.0:1788263437.640966:0:17071:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788263437.640972:0:17071:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:0.0:1788263437.641121:0:17801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788263437.641232:0:17801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00080000:1.0:1788263437.641496:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788263437.641501:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788263437.641505:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788263437.641508:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788263437.641569:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263437.641598:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709807232:0@lo:400:kworker.0 00000100:00100000:1.0:1788263437.641814:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263437.641888:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709807232 00000100:00100000:0.0:1788263437.641894:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709807232 00000100:00100000:0.0:1788263437.641938:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788263437.641947:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709807232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263437.642001:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709807232:12345-0@lo:400:kworker.0 Request processed in 56us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263437.642008:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788263437.642177:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ff2833e2680 x1875129709807232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263437.642189:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709807232:0@lo:400:kworker.0 00000040:00080000:3.0:1788263437.642902:0:17806:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788263437.642917:0:17806:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00080000:2.0:1788263437.645019:0:17071:0:(import.c:65:import_set_state_nolock()) ffff9ff283a0f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263437.645117:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1875129709806976:12345-0@lo:38:llog_process_th.0 Request processed in 4222us (10884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263437.645128:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788263437.645152:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788263437.645158:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875129709807104:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788263437.645197:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875129709807104:12345-0@lo:38:kworker.0 Request processed in 38us (4415us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788263437.645202:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788263437.645380:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788263437.645388:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3bc672800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788263437.645392:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788263437.645396:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709807104:0@lo:38:kworker.0 00000100:00100000:3.0:1788263437.645413:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788263437.645419:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788263437.645426:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788263437.645431:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788263437.645434:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff283370800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788263437.645459:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709806976:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788263437.645856:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5470380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709807360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788263437.645902:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263437.646067:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709807360 00000100:00100000:2.0:1788263437.646074:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709807360 00000100:00100000:2.0:1788263437.646120:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788263437.646127:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28398a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1875129709807360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788263437.646150:0:17070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788263437.646274:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28398a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1875129709807360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 148us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263437.646281:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:00000080:0.0:1788263437.649128:0:17801:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788263437.649143:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788263437.649193:0:17801:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788263437.649216:0:17801:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b1103cba667061e 00000100:00080000:0.0:1788263437.649226:0:17801:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788263437.649231:0:17801:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ff39ab18800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:0.0:1788263437.649265:0:17801:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff283324700 x1875129709807488/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788263437.649456:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709807488:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788263437.649519:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875129709807488 offset 0 length 520: 4 00000100:00080000:0.0:1788263437.649574:0:17801:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788263437.649827:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263437.649832:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263437.649833:0:17801:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788263437.649846:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788263437.649848:0:17801:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1788263437.649850:0:17801:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788263437.649852:0:17801:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788263437.649854:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788263437.649856:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263437.649858:0:17801:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788263437.649860:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788263437.649865:0:17801:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788263437.649869:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263437.649870:0:17801:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788263437.649874:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788263437.649878:0:17801:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:01000000:0.0:1788263437.649899:0:17801:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788263437.649902:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788263437.649915:0:17801:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9ff3b0028000) 00000020:00000080:0.0:1788263437.649932:0:17801:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1788263437.649937:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788263437.650016:0:17801:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1788263437.650023:0:17801:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788263437.650028:0:17801:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b1103cba667062c 00010000:00080000:0.0:1788263437.650055:0:17801:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ff3bc483800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.126@tcp at head 00010000:00010000:0.0:1788263437.650251:0:17801:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788263437.650330:0:17801:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788263437.650344:0:17801:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1788263437.651088:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5470380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709807360:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788263437.652701:0:17801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788263437.652909:0:17801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788263437.653109:0:17801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00080000:2.0:1788263437.653939:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788263437.653947:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788263437.653950:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788263437.653952:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788263437.654185:0:17808:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788263437.654190:0:17808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788263437.656466:0:17801:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788263437.656480:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788263437.657205:0:17801:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788263437.657969:0:17801:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b1103cba6670633 00000100:00080000:2.0:1788263437.657981:0:17801:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788263437.657987:0:17801:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ff3bc483800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263437.658026:0:17801:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff3b5471880 x1875129709807616/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788263437.658089:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709807616:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788263437.658145:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875129709807616 offset 0 length 520: 4 00000100:00080000:2.0:1788263437.658201:0:17801:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788263437.658299:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263437.658305:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263437.658307:0:17801:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788263437.658310:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263437.658313:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263437.658314:0:17801:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788263437.658317:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788263437.658319:0:17801:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788263437.658321:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263437.658323:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263437.658324:0:17801:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788263437.658326:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263437.658329:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263437.658330:0:17801:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788263437.658334:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788263437.658366:0:17801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263437.658369:0:17801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263437.658370:0:17801:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788263437.658374:0:17801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:2.0:1788263437.658523:0:17797:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788263437.658561:0:17797:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788263437.658600:0:17797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff283b68e00/0x4b1103cba66705b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66705bc expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263437.658611:0:17797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff283b68e00/0x4b1103cba66705b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66705bc expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263437.658633:0:17797:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ff283349800 from 1 10000000:01000000:2.0:1788263437.658635:0:17797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788263437.658660:0:17797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba667063a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263437.658667:0:17797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba667063a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263437.658678:0:17797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba667063a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263437.658694:0:17797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5473b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709807744:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788263437.658750:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263437.658767:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3853e2180 going to sleep for 11 seconds 00000100:00080000:1.0:1788263437.659209:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788263437.659226:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788263437.659229:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788263437.659232:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788263437.659519:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709807744 00000100:00100000:0.0:1788263437.659527:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709807744 00000100:00100000:0.0:1788263437.659626:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788263437.659636:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+15:17797:x1875129709807744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788263437.659649:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263437.659664:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff283b68400/0x4b1103cba6670641 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba667063a expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263437.659688:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff283b68400/0x4b1103cba6670641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba667063a expref: 16 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263437.659759:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff283b68400/0x4b1103cba6670641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba667063a expref: 16 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263437.659768:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b68400, rc 0) 00000100:00100000:0.0:1788263437.659818:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+16:17797:x1875129709807744:12345-0@lo:101:mount.lustre.0 Request processed in 184us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263437.659825:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788263437.660037:0:17797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5473b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709807744:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788263437.660053:0:17797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba667063a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670641 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263437.660061:0:17797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba667063a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba6670641 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263437.661125:0:17797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5473b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709807872:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788263437.661182:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263437.661337:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3853e2180 going to sleep for 11 seconds 00000100:00100000:1.0:1788263437.661948:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709807872 00000100:00100000:1.0:1788263437.661956:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709807872 00000100:00100000:1.0:1788263437.662046:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788263437.662056:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+16:17797:x1875129709807872:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788263437.662087:0:17058:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788263437.662104:0:17058:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788263437.662107:0:17058:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788263437.662382:0:17797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5473b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709807872:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788263437.663207:0:17797:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788263437.663361:0:17797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba667063a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670641 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263437.663371:0:17797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba667063a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670641 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263437.663380:0:17797:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff283349800 from 1 10000000:01000000:2.0:1788263437.663382:0:17797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788263437.663478:0:17797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0e00/0x4b1103cba6670648 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263437.663486:0:17797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0e00/0x4b1103cba6670648 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263437.663494:0:17797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0e00/0x4b1103cba6670648 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263437.663514:0:17797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5473b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709808000:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788263437.663562:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263437.663710:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+16:17797:x1875129709807872:12345-0@lo:256:mount.lustre.0 Request processed in 161us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263437.663719:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788263437.663922:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3853e2180 going to sleep for 11 seconds 00000100:00100000:1.0:1788263437.664011:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709808000 00000100:00100000:1.0:1788263437.664018:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709808000 00000100:00100000:1.0:1788263437.664046:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788263437.664054:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+16:17797:x1875129709808000:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788263437.664066:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263437.664079:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff381680000/0x4b1103cba667064f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba6670648 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263437.664099:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff381680000/0x4b1103cba667064f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba6670648 expref: 17 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263437.664109:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff381680000/0x4b1103cba667064f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670648 expref: 17 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263437.664117:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381680000, rc 0) 00000100:00100000:1.0:1788263437.664162:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+17:17797:x1875129709808000:12345-0@lo:101:mount.lustre.0 Request processed in 109us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263437.664167:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788263437.664351:0:17797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5473b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709808000:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788263437.664370:0:17797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0e00/0x4b1103cba6670648 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667064f expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263437.664378:0:17797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0e00/0x4b1103cba6670648 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba667064f expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788263437.664612:0:17797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788263437.664652:0:17797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5473b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709808128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263437.664696:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263437.664863:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3853e2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263437.664985:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709808128 00000100:00100000:0.0:1788263437.664991:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709808128 00000100:00100000:1.0:1788263437.665030:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788263437.665040:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+17:17797:x1875129709808128:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788263437.665137:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+17:17797:x1875129709808128:12345-0@lo:501:mount.lustre.0 Request processed in 98us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263437.665152:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788263437.665231:0:17797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5473b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709808128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263437.665271:0:17797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5473b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709808256:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788263437.665310:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263437.665330:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3853e2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263437.665614:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709808256 00000100:00100000:1.0:1788263437.665619:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709808256 00000100:00100000:1.0:1788263437.665639:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788263437.665644:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+17:17797:x1875129709808256:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788263437.665880:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+17:17797:x1875129709808256:12345-0@lo:503:mount.lustre.0 Request processed in 234us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263437.665888:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788263437.665975:0:17797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5473b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709808256:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788263437.666338:0:17797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788263437.666545:0:17797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5473b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709808384:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788263437.666625:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263437.666650:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3853e2180 going to sleep for 11 seconds 00000100:00100000:1.0:1788263437.666824:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709808384 00000100:00100000:1.0:1788263437.666830:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709808384 00000100:00100000:1.0:1788263437.666856:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788263437.666863:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+17:17797:x1875129709808384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788263437.666958:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+17:17797:x1875129709808384:12345-0@lo:502:mount.lustre.0 Request processed in 95us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263437.666965:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788263437.667049:0:17797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5473b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709808384:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788263437.667238:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788263437.667333:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:2.0:1788263437.667349:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:2.0:1788263437.667360:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:2.0:1788263437.667372:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:2.0:1788263437.667383:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:2.0:1788263437.667490:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:2.0:1788263437.667508:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:2.0:1788263437.667522:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788263437.667534:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:2.0:1788263437.667545:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:2.0:1788263437.667571:0:17797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5473b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709808512:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788263437.667652:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263437.667673:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3853e2180 going to sleep for 11 seconds 00000100:00100000:1.0:1788263437.667852:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709808512 00000100:00100000:1.0:1788263437.667858:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709808512 00000100:00100000:1.0:1788263437.667882:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788263437.667889:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+17:17797:x1875129709808512:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788263437.667974:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+17:17797:x1875129709808512:12345-0@lo:502:mount.lustre.0 Request processed in 86us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263437.667980:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788263437.668174:0:17797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5473b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709808512:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788263437.668391:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:2.0:1788263437.668476:0:17797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788263437.669072:0:17810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263437.669081:0:17810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263437.669083:0:17810:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788263437.669091:0:17810:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ff283349800 00000020:00000080:0.0:1788263437.669093:0:17810:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788263437.669100:0:17810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263437.669103:0:17810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263437.669105:0:17810:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788263437.669107:0:17810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263437.669109:0:17810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263437.669110:0:17810:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788263437.669114:0:17810:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ff283349800 00000020:00000080:0.0:1788263437.669116:0:17810:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788263437.669259:0:17810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263437.669264:0:17810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263437.669265:0:17810:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788263437.669268:0:17810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263437.669271:0:17810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263437.669272:0:17810:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788263437.669276:0:17810:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ff283349800 00000020:00000080:0.0:1788263437.669278:0:17810:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788263437.671681:0:17810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263437.675694:0:17810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263437.675710:0:17810:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788263437.675721:0:17810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263437.675727:0:17810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263437.675728:0:17810:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788263437.675733:0:17810:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ff283349800 00000020:00000080:0.0:1788263437.675735:0:17810:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788263437.675800:0:17810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263437.675803:0:17810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263437.675805:0:17810:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788263437.675807:0:17810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1788263437.676052:0:17797:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788263437.676086:0:17797:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788263437.676106:0:17797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0e00/0x4b1103cba6670648 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667064f expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263437.676129:0:17797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0e00/0x4b1103cba6670648 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667064f expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263437.676190:0:17797:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788263437.676193:0:17797:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ff283349800 10000000:01000000:1.0:1788263437.676196:0:17797:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ff283349800 10000000:01000000:1.0:1788263437.676199:0:17797:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788263437.676204:0:17797:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ff283349800 from 1 10000000:01000000:1.0:1788263437.676206:0:17797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788263437.676252:0:17797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff381680e00/0x4b1103cba6670656 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263437.676261:0:17797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff381680e00/0x4b1103cba6670656 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263437.676272:0:17797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff381680e00/0x4b1103cba6670656 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263437.676297:0:17797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709808640:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788263437.676361:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263437.676405:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384e23300 going to sleep for 11 seconds 00000100:00100000:0.0:1788263437.676541:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709808640 00000100:00100000:0.0:1788263437.676548:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709808640 00000100:00100000:0.0:1788263437.676618:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788263437.676628:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+17:17797:x1875129709808640:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788263437.676641:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263437.676653:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff283b69400/0x4b1103cba667065d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba6670656 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263437.676675:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff283b69400/0x4b1103cba667065d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba6670656 expref: 18 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263437.676686:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff283b69400/0x4b1103cba667065d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670656 expref: 18 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263437.676711:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b69400, rc 0) 00000100:00100000:0.0:1788263437.676753:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+18:17797:x1875129709808640:12345-0@lo:101:mount.lustre.0 Request processed in 126us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263437.676760:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788263437.676900:0:17797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709808640:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788263437.676914:0:17797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff381680e00/0x4b1103cba6670656 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667065d expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263437.676922:0:17797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff381680e00/0x4b1103cba6670656 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba667065d expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788263437.680782:0:17797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788263437.681070:0:17797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788263437.681278:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788263437.681486:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1788263437.681503:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1788263437.681516:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1788263437.681527:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1788263437.681541:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1788263437.681554:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1788263437.681568:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1788263437.681607:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1788263437.681623:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1788263437.681637:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1788263437.681649:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1788263437.681662:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1788263437.681675:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1788263437.681688:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1788263437.682434:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1788263437.682470:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1788263437.682488:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1788263437.682503:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1788263437.682516:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1788263437.682530:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1788263437.682546:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1788263437.682560:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1788263437.682572:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1788263437.682622:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1788263437.682638:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1788263437.682651:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1788263437.682663:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1788263437.682686:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1788263437.682691:0:17797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788263437.683390:0:17797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709808768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263437.683466:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263437.683505:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3901d9600 going to sleep for 11 seconds 00000100:00100000:1.0:1788263437.684128:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709808768 00000100:00100000:1.0:1788263437.684135:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709808768 00000100:00100000:1.0:1788263437.684185:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788263437.684195:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+18:17797:x1875129709808768:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788263437.684542:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+18:17797:x1875129709808768:12345-0@lo:501:mount.lustre.0 Request processed in 347us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263437.684550:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788263437.690960:0:17797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709808768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788263437.691022:0:17797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709808896:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788263437.691097:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263437.691143:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384e23c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263437.691198:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709808896 00000100:00100000:0.0:1788263437.691205:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709808896 00000100:00100000:0.0:1788263437.691401:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788263437.691412:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+18:17797:x1875129709808896:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788263437.691535:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+18:17797:x1875129709808896:12345-0@lo:503:mount.lustre.0 Request processed in 125us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263437.691544:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788263437.695876:0:17797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709808896:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788263437.696901:0:17797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788263437.697002:0:17797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709809024:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788263437.697073:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263437.697119:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709809024 00000100:00100000:1.0:1788263437.697125:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709809024 00000100:00100000:1.0:1788263437.697166:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788263437.697176:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+18:17797:x1875129709809024:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788263437.698774:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384e23300 going to sleep for 11 seconds 00000100:00100000:0.0:1788263437.698806:0:17797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709809024:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788263437.699006:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788263437.699033:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1788263437.699046:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1788263437.699057:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1788263437.699068:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1788263437.699079:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1788263437.699090:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1788263437.699101:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1788263437.699126:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1788263437.699139:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1788263437.699150:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1788263437.699172:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1788263437.699183:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1788263437.699194:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1788263437.699204:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1788263437.699216:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1788263437.699227:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1788263437.699239:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1788263437.699249:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1788263437.699262:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1788263437.699274:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000100:00100000:1.0:1788263437.699508:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+18:17797:x1875129709809024:12345-0@lo:502:mount.lustre.0 Request processed in 2331us (2433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263437.699520:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000040:00080000:0.0:1788263437.700643:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1788263437.700691:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1788263437.700835:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1788263437.700853:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1788263437.700889:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1788263437.700904:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1788263437.700915:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1788263437.700927:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1788263437.700940:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1788263437.700954:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1788263437.700966:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1788263437.700980:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1788263437.700992:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1788263437.701005:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1788263437.701018:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1788263437.701030:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1788263437.701043:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1788263437.701056:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1788263437.701067:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1788263437.701080:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1788263437.701107:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1788263437.701121:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1788263437.701133:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1788263437.701156:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1788263437.701167:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1788263437.701178:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1788263437.701189:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:0.0:1788263437.701242:0:17797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709809152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788263437.702503:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263437.702609:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3901d9480 going to sleep for 11 seconds 00000100:00100000:2.0:1788263437.712465:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709809152 00000100:00100000:2.0:1788263437.712480:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709809152 00000100:00100000:2.0:1788263437.712540:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788263437.712551:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+18:17797:x1875129709809152:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788263437.712747:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+18:17797:x1875129709809152:12345-0@lo:502:mount.lustre.0 Request processed in 198us (10247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263437.712756:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788263437.712895:0:17797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709809152:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788263437.713088:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1788263437.713113:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1788263437.713144:0:17797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5473b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709809280:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788263437.713183:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263437.713213:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3c05bc600 going to sleep for 11 seconds 00000100:00100000:2.0:1788263437.713227:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709809280 00000100:00100000:2.0:1788263437.713232:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709809280 00000100:00100000:2.0:1788263437.713257:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788263437.713264:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+18:17797:x1875129709809280:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788263437.713471:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+18:17797:x1875129709809280:12345-0@lo:502:mount.lustre.0 Request processed in 206us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263437.713477:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788263437.713516:0:17797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5473b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709809280:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788263437.713552:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1788263437.713565:0:17797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788263437.718830:0:17816:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788263437.718850:0:17816:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9ff3b002cd28) 00000020:00000080:0.0:1788263437.718874:0:17816:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788263437.718957:0:17816:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ff283349800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788263437.718962:0:17816:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ff283349800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788263437.718964:0:17816:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ff283349800 3 00010000:00080000:0.0:1788263437.718997:0:17816:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ff28390d000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.126@tcp at head 00010000:00010000:3.0:1788263437.729116:0:17816:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1788263437.730842:0:17816:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788263437.730903:0:17816:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788263437.730918:0:17816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x4b1103cba667066b 00000100:00080000:3.0:1788263437.730929:0:17816:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788263437.730935:0:17816:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9ff28390d000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788263437.730972:0:17816:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff28398b480 x1875129709809408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788263437.731030:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875129709809408:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788263437.731100:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263437.731166:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709809408 00000100:00100000:3.0:1788263437.731173:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709809408 00000100:00100000:3.0:1788263437.731205:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788263437.731212:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875129709809408:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788263437.731233:0:17065:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:3.0:1788263437.731263:0:17065:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x4b1103cba6670672 00000004:00100000:3.0:1788263437.731278:0:17065:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788263437.731813:0:17065:0:(import.c:65:import_set_state_nolock()) ffff9ff283838000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788263437.731869:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875129709809408:12345-0@lo:38:llog_process_th.0 Request processed in 655us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263437.731877:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788263437.731916:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ff28398b480 x1875129709809408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788263447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263437.731926:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788263437.731933:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788263437.731939:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788263437.731944:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788263437.731946:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff28390d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788263437.731951:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875129709809408:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788263437.731971:0:17816:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788263437.732145:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788263437.732159:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788263437.732162:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788263437.732165:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788263437.736047:0:17816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1788263437.736094:0:17797:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788263437.736130:0:17797:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788263437.736144:0:17797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff381680e00/0x4b1103cba6670656 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667065d expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263437.736157:0:17797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff381680e00/0x4b1103cba6670656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667065d expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788263437.736196:0:17797:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788263437.736198:0:17797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788263437.736199:0:17797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263437.736200:0:17797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263437.736201:0:17797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263437.736203:0:17797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263437.736204:0:17797:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788263437.736206:0:17797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263437.736207:0:17797:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788263437.736210:0:17797:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1788263437.736212:0:17797:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788263437.736214:0:17797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788263437.736215:0:17797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263437.736216:0:17797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263437.736217:0:17797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263437.736218:0:17797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263437.736219:0:17797:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788263437.736219:0:17797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263437.736220:0:17797:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788263437.737371:0:17797:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788263437.737395:0:17797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709809536:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788263437.737466:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263437.737511:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff382a64180 going to sleep for 11 seconds 00000100:00100000:3.0:1788263437.737537:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709809536 00000100:00100000:3.0:1788263437.737543:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709809536 00000100:00100000:3.0:1788263437.737599:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788263437.737608:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+18:17797:x1875129709809536:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788263437.737642:0:17058:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788263437.737654:0:17058:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788263437.742648:0:17045:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788263437.742786:0:17058:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788263437.742834:0:17058:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788263437.744042:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+18:17797:x1875129709809536:12345-0@lo:253:mount.lustre.0 Request processed in 6429us (6569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263437.744054:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788263437.745732:0:17797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:17797:1875129709809536:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788263437.745751:0:17797:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788263437.745754:0:17797:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788263437.745756:0:17797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788263437.745757:0:17797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788263437.745758:0:17797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788263437.745760:0:17797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788263437.745761:0:17797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788263437.745762:0:17797:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788263437.745764:0:17797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788263437.745765:0:17797:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788263437.745780:0:17797:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788263437.750392:0:17081:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788263437.750403:0:17081:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788263437.750427:0:17081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ff283b68600/0x4b1103cba6670679 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263437.750456:0:17081:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff3bf6d1800/0x4b1103cba667057d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670576 expref: 17 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263437.750464:0:17081:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff283b68400/0x4b1103cba6670641 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba667063a expref: 17 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263437.750471:0:17081:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ff283b68600/0x4b1103cba6670679 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263437.750516:0:17081:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff283b68400/0x4b1103cba6670641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba667063a expref: 17 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263437.750543:0:17081:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ff283b68400/0x4b1103cba6670641 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba667063a expref: 17 pid: 17059 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263437.750557:0:17081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283327b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17081:1875129709809664:0@lo:104: 00000100:00100000:0.0:1788263437.750676:0:17081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788263437.750787:0:17081:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff3bf6d1800/0x4b1103cba667057d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba6670576 expref: 17 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263437.750794:0:17081:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ff3bf6d1800/0x4b1103cba667057d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba6670576 expref: 17 pid: 17058 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263437.750803:0:17081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17081:1875129709809792:0@lo:104: 00000100:00100000:0.0:1788263437.750823:0:17081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263437.750882:0:17081:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3b006c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263437.753233:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709809664 00000100:00100000:3.0:1788263437.753252:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709809664 00000100:00100000:3.0:1788263437.753295:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709809792 00000100:00100000:3.0:1788263437.753299:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709809792 00000100:00100000:3.0:1788263437.753319:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788263437.753329:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283326680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fb36e90-c209-4884-91f2-1155be4ad295+4:17081:x1875129709809664:12345-0@lo:104: 00010000:00010000:3.0:1788263437.753345:0:17048:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba667063a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba6670641 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263437.753436:0:17048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788263437.753442:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283326680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fb36e90-c209-4884-91f2-1155be4ad295+4:17081:x1875129709809664:12345-0@lo:104: Request processed in 116us (2767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263437.753460:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788263437.753477:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788263437.753483:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283327100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fb36e90-c209-4884-91f2-1155be4ad295+3:17081:x1875129709809792:12345-0@lo:104: 00010000:00010000:3.0:1788263437.753491:0:17048:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff381680200/0x4b1103cba6670576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba667057d expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263437.753528:0:17048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788263437.753532:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283327100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fb36e90-c209-4884-91f2-1155be4ad295+3:17081:x1875129709809792:12345-0@lo:104: Request processed in 51us (2709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263437.753548:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788263437.753565:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788263437.753570:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba667063a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba6670641 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263437.753597:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0c00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:3.0:1788263437.753602:0:17054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba667063a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba6670641 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263437.753611:0:17054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba667063a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba6670641 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263437.753619:0:17054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba667063a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba6670641 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263437.753625:0:17054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788263437.753662:0:17054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba667063a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba6670641 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263437.753668:0:17054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263437.753682:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba667063a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba6670641 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263437.753687:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba667063a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba6670641 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263437.753942:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fb36e90-c209-4884-91f2-1155be4ad295:3619:1875129709809920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788263437.753983:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263437.754039:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709809920 00000100:00100000:1.0:1788263437.754043:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709809920 00010000:00010000:1.0:1788263437.754059:0:17051:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff283b68400/0x4b1103cba6670641 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba667063a expref: 18 pid: 17059 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263437.754078:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788263437.754084:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8fb36e90-c209-4884-91f2-1155be4ad295+18:3619:x1875129709809920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788263437.754093:0:17051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263437.754098:0:17051:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff283b68400/0x4b1103cba6670641 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba667063a expref: 18 pid: 17059 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263437.754108:0:17051:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff283b68400/0x4b1103cba6670641 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba667063a expref: 18 pid: 17059 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263437.754134:0:17051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263437.754163:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8fb36e90-c209-4884-91f2-1155be4ad295+18:3619:x1875129709809920:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263437.754170:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788263437.754203:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fb36e90-c209-4884-91f2-1155be4ad295:3619:1875129709809920:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788263437.754233:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff283b68400/0x4b1103cba6670641 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba667063a expref: 17 pid: 17059 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263437.754354:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263437.754359:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff381680200/0x4b1103cba6670576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba667057d expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263437.754377:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381680200 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:3.0:1788263437.754381:0:17054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff381680200/0x4b1103cba6670576 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba667057d expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263437.754388:0:17054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff381680200/0x4b1103cba6670576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba667057d expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263437.754393:0:17054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff381680200/0x4b1103cba6670576 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba667057d expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263437.754398:0:17054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788263437.754415:0:17054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff381680200/0x4b1103cba6670576 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba667057d expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263437.754421:0:17054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263437.754439:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff381680200/0x4b1103cba6670576 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba667057d expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263437.754458:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff381680200/0x4b1103cba6670576 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba667057d expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263437.754473:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263437.754475:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263437.754477:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263437.754483:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263437.754497:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788263437.754506:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fb36e90-c209-4884-91f2-1155be4ad295:3621:1875129709810048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788263437.754534:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263437.754565:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709810048 00000100:00100000:3.0:1788263437.754575:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709810048 00010000:00010000:3.0:1788263437.754612:0:17052:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff3bf6d1800/0x4b1103cba667057d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba6670576 expref: 18 pid: 17058 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263437.754633:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788263437.754639:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283989180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fb36e90-c209-4884-91f2-1155be4ad295+18:3621:x1875129709810048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788263437.754647:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263437.754651:0:17052:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff3bf6d1800/0x4b1103cba667057d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba6670576 expref: 18 pid: 17058 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263437.754660:0:17052:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff3bf6d1800/0x4b1103cba667057d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba6670576 expref: 18 pid: 17058 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263437.754671:0:17052:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ff283b68600/0x4b1103cba6670679 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263437.754679:0:17052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff283b68600/0x4b1103cba6670679 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788263437.754691:0:17052:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004289675s 00010000:00010000:3.0:1788263437.754696:0:17052:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff283b68600/0x4b1103cba6670679 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263437.754716:0:17052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff283b68600/0x4b1103cba6670679 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263437.754724:0:17052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ff283b68600/0x4b1103cba6670679 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263437.754730:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ff283b68600/0x4b1103cba6670679 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263437.754746:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b68600 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263437.754751:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ff283b68600/0x4b1103cba6670679 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263437.754758:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ff283b68600/0x4b1103cba6670679 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263437.754766:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ff283b68600/0x4b1103cba6670679 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263437.754775:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263437.754804:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283989180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fb36e90-c209-4884-91f2-1155be4ad295+18:3621:x1875129709810048:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263437.754811:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788263437.754836:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fb36e90-c209-4884-91f2-1155be4ad295:3621:1875129709810048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788263437.755383:0:17081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283327b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17081:1875129709809664:0@lo:104: 00010000:00010000:1.0:1788263437.755402:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3bf6d1800/0x4b1103cba667057d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba6670576 expref: 16 pid: 17058 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263437.755410:0:17081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17081:1875129709809792:0@lo:104: 00010000:00010000:1.0:1788263437.755424:0:17081:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ff283b68600/0x4b1103cba6670679 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263437.755432:0:17081:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ff283b68600/0x4b1103cba6670679 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263437.755438:0:17081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ff283b68600/0x4b1103cba6670679 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263437.755443:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff283b68600/0x4b1103cba6670679 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:3.0:1788263437.758138:0:17797:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1788263437.758197:0:17822:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788263437.758201:0:17822:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788263437.758539:0:17823:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788263437.758908:0:17797:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1788263437.759141:0:17823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788263437.761922:0:17823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788263437.762004:0:17823:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1788263437.762965:0:17824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17824:1875129709810176:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788263437.763030:0:17824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263437.763070:0:17824:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3fdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263437.763123:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709810176 00000100:00100000:0.0:1788263437.763130:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709810176 00000100:00100000:0.0:1788263437.763175:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788263437.763184:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17824:x1875129709810176:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788263437.763273:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17824:x1875129709810176:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 90us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263437.763280:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788263437.763467:0:17824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17824:1875129709810176:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1788263437.763498:0:17824:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788263437.763525:0:17824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17824:1875129709810304:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788263437.763555:0:17824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263437.763601:0:17824:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3fdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263437.763650:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709810304 00000100:00100000:0.0:1788263437.763655:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709810304 00000100:00100000:0.0:1788263437.763674:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788263437.763680:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17824:x1875129709810304:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788263437.763797:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17824:x1875129709810304:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 116us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263437.763820:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788263437.763932:0:17824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17824:1875129709810304:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788263437.763985:0:17824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17824:1875129709810432:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788263437.764014:0:17824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263437.764040:0:17824:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3fdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263437.764108:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709810432 00000100:00100000:0.0:1788263437.764113:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709810432 00000100:00100000:0.0:1788263437.764178:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788263437.764185:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17824:x1875129709810432:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788263437.764227:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17824:x1875129709810432:12345-0@lo:900:lod0001_rec0000.0 Request processed in 43us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263437.764233:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:3.0:1788263437.764725:0:17797:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788263437.764765:0:17797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788263437.765189:0:17797:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788263437.765195:0:17797:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788263437.765230:0:17797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788263437.766643:0:17797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788263437.767181:0:17797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788263437.767211:0:17797:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00010000:00080000:1.0:1788263437.767675:0:17824:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ff2833e0000 x1875129709810432/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788263453 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263437.767691:0:17824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17824:1875129709810432:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788263437.767776:0:17824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17824:1875129709810560:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788263437.767837:0:17824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263437.767885:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709810560 00000100:00100000:1.0:1788263437.767893:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709810560 00000100:00100000:1.0:1788263437.767928:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788263437.767936:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17824:x1875129709810560:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788263437.768026:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17824:x1875129709810560:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 89us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263437.768044:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788263437.768065:0:17824:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3fdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788263437.768079:0:17824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17824:1875129709810560:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788263437.768118:0:17824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788263437.768910:0:17797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788263437.770979:0:17797:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:1.0:1788263437.773222:0:17824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788263437.774799:0:17824:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788263437.774807:0:17824:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:3.0:1788263437.775224:0:17797:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788263437.799821:0:17797:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788263437.799859:0:17797:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffad45c18df988 00100000:10000000:3.0:1788263437.799869:0:17797:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788263437.801169:0:17797:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788263437.801201:0:17797:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.126@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788263437.801218:0:17797:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788263437.801239:0:17797:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788263437.804971:0:17797:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788263437.805223:0:17797:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788263437.807797:0:17107:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3813590c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788263438.578851:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788263438.773995:0:17817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788263438.833646:0:17107:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3813590c0 going to sleep for 0 seconds 00000040:00080000:0.0:1788263438.844818:0:17101:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788263439.151814:0:17062:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788263439.151826:0:17062:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ff283349800 from 8 10000000:01000000:3.0:1788263439.151833:0:17062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788263439.151899:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff38150e600/0x4b1103cba6670680 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263439.151913:0:17062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff38150e600/0x4b1103cba6670680 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263439.151926:0:17062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff38150e600/0x4b1103cba6670680 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263439.151957:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709810688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788263439.153256:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263439.153810:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709810688 00000100:00100000:2.0:1788263439.153826:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709810688 00000100:00100000:2.0:1788263439.153893:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788263439.153904:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+16:17062:x1875129709810688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263439.153933:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263439.153953:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3bf6d1000/0x4b1103cba6670687 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba6670680 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263439.153980:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3bf6d1000/0x4b1103cba6670687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba6670680 expref: 17 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263439.153991:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3bf6d1000/0x4b1103cba6670687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670680 expref: 17 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263439.154001:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d1000, rc 0) 00000100:00100000:3.0:1788263439.154974:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff391446840 going to sleep for 11 seconds 00000100:00100000:2.0:1788263439.155113:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+17:17062:x1875129709810688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1205us (1858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263439.155124:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788263439.155394:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709810688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263439.155527:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff38150e600/0x4b1103cba6670680 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670687 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263439.155545:0:17062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff38150e600/0x4b1103cba6670680 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba6670687 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263439.155736:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709810816:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788263439.156012:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263439.156258:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff391446840 going to sleep for 11 seconds 00000100:00100000:2.0:1788263439.156791:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709810816 00000100:00100000:2.0:1788263439.156804:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709810816 00000100:00100000:2.0:1788263439.156879:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788263439.156889:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+17:17062:x1875129709810816:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788263439.156915:0:17058:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788263439.157013:0:17058:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788263439.157087:0:17058:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788263439.157293:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+17:17062:x1875129709810816:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 404us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263439.157311:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788263439.157802:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709810816:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788263439.157857:0:17062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788263439.157867:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff38150e600/0x4b1103cba6670680 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670687 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263439.157877:0:17062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff38150e600/0x4b1103cba6670680 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670687 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263439.157888:0:17062:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788263439.157890:0:17062:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ff28389c800 from 8 10000000:01000000:3.0:1788263439.157893:0:17062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788263439.157996:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba667068e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263439.158006:0:17062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba667068e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263439.158343:0:17062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba667068e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263439.158368:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709810944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788263439.158411:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263439.158509:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff391446840 going to sleep for 11 seconds 00000100:00100000:0.0:1788263439.167425:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709810944 00000100:00100000:0.0:1788263439.167452:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709810944 00000100:00100000:0.0:1788263439.167520:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788263439.167530:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+17:17062:x1875129709810944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263439.167545:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263439.167562:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff283b68c00/0x4b1103cba6670695 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba667068e expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263439.167603:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff283b68c00/0x4b1103cba6670695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba667068e expref: 18 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263439.167614:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff283b68c00/0x4b1103cba6670695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba667068e expref: 18 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263439.167622:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b68c00, rc 0) 00000100:00100000:0.0:1788263439.168469:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+18:17062:x1875129709810944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 938us (10054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263439.168478:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788263439.174542:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709810944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263439.174591:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba667068e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670695 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263439.174625:0:17062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba667068e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba6670695 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263439.176202:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709811072:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788263439.176275:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263439.176321:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff391446840 going to sleep for 11 seconds 00000100:00100000:0.0:1788263439.176509:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709811072 00000100:00100000:0.0:1788263439.176518:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709811072 00000100:00100000:0.0:1788263439.176571:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788263439.176597:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+18:17062:x1875129709811072:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788263439.176617:0:17059:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788263439.176636:0:17059:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788263439.176639:0:17059:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788263439.176745:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+18:17062:x1875129709811072:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 165us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263439.176752:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788263439.177429:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709811072:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788263439.177490:0:17062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788263439.177499:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba667068e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670695 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263439.177510:0:17062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba667068e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670695 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263439.601205:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788263439.796219:0:17817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788263439.855772:0:17107:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3813590c0 going to sleep for 0 seconds 00010000:00010000:3.0:1788263440.628541:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263440.882886:0:17107:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3813590c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788263441.647770:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263441.907148:0:17107:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3813590c0 going to sleep for 0 seconds 00000001:02000400:2.0:1788263442.426127:0:18067:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788263442.673253:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263442.928072:0:17107:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3813590c0 going to sleep for 0 seconds 00000100:00100000:1.0:1788263442.991753:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263442.991776:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709811200:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788263442.991790:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788263442.991796:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788263442.991800:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ff3bc672800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788263442.991809:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ff3bc672800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263442.991831:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff3b5470380 x1875129709811456/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788263442.991844:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788263442.991847:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788263442.991852:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788263442.991855:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788263442.991858:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788263442.991869:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788263442.991872:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788263442.991875:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788263442.991877:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788263442.991902:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fb36e90-c209-4884-91f2-1155be4ad295:3618:1875129709811328:0@lo:400:kworker.0 00000100:00100000:3.0:1788263442.991914:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788263442.991938:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263442.991939:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875129709811712:0@lo:400:kworker.0 00000100:00100000:2.0:1788263442.991971:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709811584:0@lo:400:kworker.0 00000100:00100000:3.0:1788263442.991980:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263442.992017:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263442.992018:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709811712 00000100:00100000:3.0:1788263442.992025:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709811712 00000100:00100000:2.0:1788263442.992049:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5470380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709811456:0@lo:38:kworker.0 00000100:00100000:3.0:1788263442.992069:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709811584 00000100:00100000:3.0:1788263442.992073:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709811584 00000100:00100000:2.0:1788263442.992078:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263442.992097:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788263442.992108:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28398a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875129709811712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263442.992109:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709811328 00000100:00100000:2.0:1788263442.992114:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709811328 00000100:00100000:2.0:1788263442.992148:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788263442.992158:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+18:3618:x1875129709811328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263442.992197:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28398a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875129709811712:12345-0@lo:400:kworker.0 Request processed in 89us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263442.992208:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788263442.992208:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+18:3618:x1875129709811328:12345-0@lo:400:kworker.0 Request processed in 50us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263442.992218:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788263442.992230:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788263442.992241:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709811584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263442.992271:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709811200 00000100:00100000:2.0:1788263442.992275:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709811200 00000100:00100000:3.0:1788263442.992278:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709811584:12345-0@lo:400:kworker.0 Request processed in 40us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263442.992286:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788263442.992297:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709811456 00000100:00100000:2.0:1788263442.992301:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709811456 00000100:00100000:2.0:1788263442.992315:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788263442.992322:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709811200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788263442.992348:0:17071:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788263442.992639:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709811200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 316us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263442.992646:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788263442.992659:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788263442.992663:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3617:x1875129709811456:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788263442.992685:0:17071:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:3.0:1788263442.992718:0:17071:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b1103cba667069c 00000004:00100000:3.0:1788263442.992731:0:17071:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788263442.992737:0:17071:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1788263442.992766:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709811200:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788263442.992837:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fb36e90-c209-4884-91f2-1155be4ad295:3618:1875129709811328:0@lo:400:kworker.0 00010000:00080000:3.0:1788263442.993055:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ff3b5473100 x1875129709811584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263442.993066:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709811584:0@lo:400:kworker.0 00010000:00080000:1.0:1788263442.993433:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ff3b5472d80 x1875129709811712/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263442.993443:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875129709811712:0@lo:400:kworker.0 00000100:00080000:1.0:1788263443.012639:0:17071:0:(import.c:65:import_set_state_nolock()) ffff9ff386766000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788263443.012739:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1875129709811456:12345-0@lo:38:kworker.0 Request processed in 20072us (20660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263443.012762:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788263443.012836:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788263443.012845:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788263443.012851:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788263443.012854:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3bc672800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788263443.012875:0:3617:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000b23a5d97): req@ffff9ff2833e1180 x1875129709804416/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263443.012903:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5470380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709811456:0@lo:38:kworker.0 00000100:00100000:1.0:1788263443.013054:0:17107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263443.013092:0:17107:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3813590c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263443.013093:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788263443.013108:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709811840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788263443.013123:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709804416 00000100:00100000:1.0:1788263443.013129:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709804416 00000100:00100000:0.0:1788263443.013156:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263443.013163:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709811840 00000100:00100000:1.0:1788263443.013167:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709811840 00000100:00100000:1.0:1788263443.013181:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788263443.013188:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17107:x1875129709804416:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788263443.014019:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17107:x1875129709804416:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 827us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263443.014028:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788263443.014047:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788263443.014055:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3620:x1875129709811840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788263443.014079:0:17070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788263443.014136:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3620:x1875129709811840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263443.014143:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788263443.014277:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709811840:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788263443.018693:0:17107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e1180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17107:1875129709804416:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788263443.018739:0:17107:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788263443.018790:0:17107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283327b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17107:1875129709811968:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788263443.018855:0:17107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263443.018909:0:17107:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3b006c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263443.018935:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709811968 00000100:00100000:0.0:1788263443.018941:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709811968 00000100:00100000:0.0:1788263443.018982:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788263443.018991:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17107:x1875129709811968:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788263443.019099:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17107:x1875129709811968:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 108us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263443.019107:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788263443.019147:0:17107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283327b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17107:1875129709811968:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788263443.019226:0:17107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283327b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17107:1875129709812096:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788263443.019247:0:17107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263443.019259:0:17107:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3b006c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263443.019270:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709812096 00000100:00100000:0.0:1788263443.019272:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709812096 00000100:00100000:0.0:1788263443.019289:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788263443.019294:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17107:x1875129709812096:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788263443.019333:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17107:x1875129709812096:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 38us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263443.019338:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788263443.019370:0:17107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283327b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17107:1875129709812096:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788263443.019404:0:17107:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788263443.023631:0:17107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788263443.023724:0:17107:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 17, retries 0 00000004:00080000:0.0:1788263443.023730:0:17107:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:3.0:1788263443.411535:0:18119:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788263443.411920:0:18119:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788263443.696042:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788263444.385314:0:18169:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788263444.385726:0:18169:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788263444.721694:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788263445.410124:0:18217:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe51fa63b0 20000000:00000080:0.0:1788263445.410138:0:18217:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ff386710800 uarg=0000000000000000 20000000:01000000:0.0:1788263445.410174:0:18217:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788263445.410181:0:18217:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788263445.410186:0:18217:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788263445.411813:0:18218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1788263445.412460:0:18217:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788263445.421039:0:18217:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788263445.421191:0:18217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ff3bf6d1e00/0x4b1103cba66706a3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263445.421211:0:18217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff38150f600/0x4b1103cba667054c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670545 expref: 17 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263445.421220:0:18217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff381680000/0x4b1103cba667064f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670648 expref: 17 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263445.421228:0:18217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ff3bf6d1e00/0x4b1103cba66706a3 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263445.421283:0:18217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff381680000/0x4b1103cba667064f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba6670648 expref: 17 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263445.421296:0:18217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ff381680000/0x4b1103cba667064f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba6670648 expref: 17 pid: 17058 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263445.421308:0:18217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5470380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18217:1875129709812224:0@lo:104: 00000100:00100000:2.0:1788263445.421371:0:18217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788263445.421434:0:18217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff38150f600/0x4b1103cba667054c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba6670545 expref: 17 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263445.421442:0:18217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ff38150f600/0x4b1103cba667054c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba6670545 expref: 17 pid: 17058 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263445.421450:0:18217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18217:1875129709812352:0@lo:104: 00000100:00100000:2.0:1788263445.421472:0:18217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263445.421498:0:18217:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae57ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788263445.421646:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709812224 00000100:00100000:3.0:1788263445.421654:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709812224 00000100:00100000:3.0:1788263445.421689:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709812352 00000100:00100000:3.0:1788263445.421692:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709812352 00000100:00100000:3.0:1788263445.421706:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788263445.421713:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5470a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fb36e90-c209-4884-91f2-1155be4ad295+4:18217:x1875129709812224:12345-0@lo:104: 00010000:00010000:3.0:1788263445.421726:0:17048:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0e00/0x4b1103cba6670648 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba667064f expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263445.421776:0:17048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788263445.421781:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5470a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fb36e90-c209-4884-91f2-1155be4ad295+4:18217:x1875129709812224:12345-0@lo:104: Request processed in 69us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263445.421788:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788263445.421804:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788263445.421811:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5472300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fb36e90-c209-4884-91f2-1155be4ad295+3:18217:x1875129709812352:12345-0@lo:104: 00010000:00010000:3.0:1788263445.421819:0:17048:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba6670545 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba667054c expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263445.421819:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263445.421826:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0e00/0x4b1103cba6670648 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba667064f expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263445.421832:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0e00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:0.0:1788263445.421843:0:17053:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0e00/0x4b1103cba6670648 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba667064f expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263445.421847:0:17048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788263445.421851:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5472300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fb36e90-c209-4884-91f2-1155be4ad295+3:18217:x1875129709812352:12345-0@lo:104: Request processed in 42us (380us total) trans 0 rc 0/0 00010000:00010000:0.0:1788263445.421853:0:17053:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0e00/0x4b1103cba6670648 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba667064f expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263445.421857:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 10000000:00010000:0.0:1788263445.421860:0:17053:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0e00/0x4b1103cba6670648 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba667064f expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263445.421866:0:17053:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788263445.421903:0:17053:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0e00/0x4b1103cba6670648 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba667064f expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263445.421910:0:17053:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263445.421936:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0e00/0x4b1103cba6670648 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba667064f expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263445.421944:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0e00/0x4b1103cba6670648 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba667064f expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263445.421957:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263445.421959:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba6670545 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba667054c expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263445.421964:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b69200 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:0.0:1788263445.421967:0:17053:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba6670545 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba667054c expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263445.421981:0:17053:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba6670545 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba667054c expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263445.421996:0:17053:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba6670545 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba667054c expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263445.422001:0:17053:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788263445.422020:0:17053:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba6670545 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba667054c expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263445.422025:0:17053:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263445.422031:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba6670545 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba667054c expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263445.422036:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba6670545 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba667054c expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263445.422047:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263445.422048:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263445.422049:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263445.422061:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fb36e90-c209-4884-91f2-1155be4ad295:3619:1875129709812608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263445.422090:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263445.422119:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788263445.422124:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fb36e90-c209-4884-91f2-1155be4ad295:3619:1875129709812480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263445.422143:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263445.422166:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709812608 00000100:00100000:0.0:1788263445.422185:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709812608 00010000:00010000:0.0:1788263445.422204:0:17052:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff38150f600/0x4b1103cba667054c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba6670545 expref: 18 pid: 17058 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263445.422205:0:18217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5470380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18217:1875129709812224:0@lo:104: 00000100:00100000:2.0:1788263445.422221:0:18217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18217:1875129709812352:0@lo:104: 00000100:00100000:0.0:1788263445.422221:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709812480 00000100:00100000:0.0:1788263445.422224:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709812480 00010000:00010000:0.0:1788263445.422240:0:17052:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff381680000/0x4b1103cba667064f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba6670648 expref: 19 pid: 17058 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263445.422251:0:18217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ff3bf6d1e00/0x4b1103cba66706a3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263445.422253:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788263445.422259:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283325180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fb36e90-c209-4884-91f2-1155be4ad295+19:3619:x1875129709812608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263445.422269:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263445.422274:0:17052:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff38150f600/0x4b1103cba667054c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba6670545 expref: 19 pid: 17058 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263445.422283:0:17052:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff38150f600/0x4b1103cba667054c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba6670545 expref: 19 pid: 17058 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263445.422295:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff38150f600/0x4b1103cba667054c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba6670545 expref: 19 pid: 17058 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263445.422308:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263445.422359:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283325180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fb36e90-c209-4884-91f2-1155be4ad295+18:3619:x1875129709812608:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263445.422366:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788263445.422380:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788263445.422386:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283324a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fb36e90-c209-4884-91f2-1155be4ad295+17:3619:x1875129709812480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263445.422402:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263445.422406:0:17052:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff381680000/0x4b1103cba667064f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba6670648 expref: 17 pid: 17058 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263445.422415:0:17052:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff381680000/0x4b1103cba667064f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba6670648 expref: 17 pid: 17058 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263445.422425:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff381680000/0x4b1103cba667064f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba6670648 expref: 17 pid: 17058 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263445.422446:0:17052:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ff3bf6d1e00/0x4b1103cba66706a3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263445.422464:0:17052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3bf6d1e00/0x4b1103cba66706a3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263445.422483:0:17052:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff3bf6d1e00/0x4b1103cba66706a3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263445.422490:0:17052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff3bf6d1e00/0x4b1103cba66706a3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263445.422496:0:17052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ff3bf6d1e00/0x4b1103cba66706a3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263445.422502:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ff3bf6d1e00/0x4b1103cba66706a3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263445.422506:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1e00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263445.422515:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ff3bf6d1e00/0x4b1103cba66706a3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263445.422524:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ff3bf6d1e00/0x4b1103cba66706a3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263445.422536:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ff3bf6d1e00/0x4b1103cba66706a3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263445.422544:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263445.422568:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283324a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fb36e90-c209-4884-91f2-1155be4ad295+16:3619:x1875129709812480:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263445.422601:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788263445.422620:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fb36e90-c209-4884-91f2-1155be4ad295:3619:1875129709812480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263445.422628:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fb36e90-c209-4884-91f2-1155be4ad295:3619:1875129709812608:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788263445.422646:0:18217:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ff3bf6d1e00/0x4b1103cba66706a3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263445.422652:0:18217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ff3bf6d1e00/0x4b1103cba66706a3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263445.422658:0:18217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3bf6d1e00/0x4b1103cba66706a3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263445.424120:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263445.749651:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263446.773729:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263447.087659:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263437/real 1788263437] req@ffff9ff3b5471880 x1875129709807616/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263447 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263447.087689:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ff3b5471880 x1875129709807616/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263447 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263447.087699:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263437/real 1788263437] req@ffff9ff283324700 x1875129709807488/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263447 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263447.087721:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ff283324700 x1875129709807488/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263447 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788263447.087739:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3bc483800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788263447.087755:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788263447.087769:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709807616:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788263447.087776:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff39ab18800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788263447.087781:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788263447.087784:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709807488:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788263447.088000:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788263447.088005:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788263447.088008:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788263447.088011:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788263447.088031:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788263447.088042:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788263447.088045:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ff39ab18800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788263447.088049:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 446 00000100:00080000:3.0:1788263447.088054:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788263447.088060:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ff39ab18800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788263447.088079:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff283989880 x1875129709813248/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788263447.088093:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788263447.088096:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788263447.088098:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ff3bc483800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788263447.088101:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 446 00000100:00080000:3.0:1788263447.088104:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788263447.088107:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ff3bc483800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788263447.088117:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff283989c00 x1875129709813376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788263447.088160:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709812864:0@lo:400:kworker.0 00000100:00100000:3.0:1788263447.088218:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263447.088256:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788263447.088263:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fb36e90-c209-4884-91f2-1155be4ad295:3621:1875129709812736:0@lo:400:kworker.0 00000100:00100000:3.0:1788263447.088289:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263447.088309:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875129709813504:0@lo:400:kworker.0 00000100:00100000:3.0:1788263447.088330:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263447.088353:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709812992:0@lo:400:kworker.0 00000100:00100000:3.0:1788263447.088373:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263447.088408:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788263447.088414:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283989500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709813120:0@lo:400:kworker.0 00000100:00100000:3.0:1788263447.088437:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263447.088466:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709812864 00000100:00100000:3.0:1788263447.088473:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709812864 00000100:00100000:3.0:1788263447.088504:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709813120 00000100:00100000:3.0:1788263447.088507:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709813120 00000100:00100000:3.0:1788263447.088521:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788263447.088529:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28398ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1875129709812864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263447.088600:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28398ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1875129709812864:12345-0@lo:400:kworker.0 Request processed in 48us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263447.088609:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788263447.088624:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788263447.088630:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28398b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709813120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263447.088663:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28398b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709813120:12345-0@lo:400:kworker.0 Request processed in 34us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263447.088668:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788263447.088685:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709812736 00000100:00100000:3.0:1788263447.088688:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709812736 00000100:00100000:3.0:1788263447.088712:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788263447.088718:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+16:3621:x1875129709812736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263447.088745:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+16:3621:x1875129709812736:12345-0@lo:400:kworker.0 Request processed in 28us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263447.088751:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788263447.088900:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709813504 00000100:00100000:3.0:1788263447.088905:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709813504 00000100:00100000:3.0:1788263447.088966:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709812992 00000100:00100000:3.0:1788263447.088970:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709812992 00000100:00100000:2.0:1788263447.089756:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788263447.090260:0:17065:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788263447.090270:0:17065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788263447.090295:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788263447.090303:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788263447.090312:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28398aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709812992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263447.090373:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28398aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709812992:12345-0@lo:400:kworker.0 Request processed in 62us (1998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263447.090379:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788263447.090440:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283989500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709813120:0@lo:400:kworker.0 00010000:00080000:3.0:1788263447.090455:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ff283988e00 x1875129709812992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263447.090465:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709812992:0@lo:400:kworker.0 00000100:00100000:3.0:1788263447.090495:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709813248:0@lo:8:kworker.0 00000400:00000100:3.0:1788263447.090520:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875129709813248 offset 0 length 520: 4 00000100:00100000:3.0:1788263447.090542:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709813376:0@lo:8:kworker.0 00000400:00000100:3.0:1788263447.090557:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875129709813376 offset 0 length 520: 4 00000100:00100000:3.0:1788263447.090609:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fb36e90-c209-4884-91f2-1155be4ad295:3621:1875129709812736:0@lo:400:kworker.0 00000100:00100000:3.0:1788263447.090621:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709812864:0@lo:400:kworker.0 00000100:00100000:1.0:1788263447.090847:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28398bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875129709813504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263447.090930:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28398bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875129709813504:12345-0@lo:400:kworker.0 Request processed in 1166us (2598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263447.090942:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788263447.094564:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ff283988380 x1875129709813504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263447.094737:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875129709813504:0@lo:400:kworker.0 10000000:01000000:2.0:1788263447.216884:0:17062:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788263447.216893:0:17062:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff283349800 from 13 10000000:01000000:2.0:1788263447.216899:0:17062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788263447.216945:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba66706aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.216957:0:17062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba66706aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.216980:0:17062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba66706aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263447.217004:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709813632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788263447.217072:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263447.217107:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae57a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788263447.217182:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709813632 00000100:00100000:0.0:1788263447.217190:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709813632 00000100:00100000:0.0:1788263447.217242:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788263447.217251:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+16:17062:x1875129709813632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263447.217275:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263447.217289:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff283b68200/0x4b1103cba66706b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba66706aa expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.217312:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff283b68200/0x4b1103cba66706b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba66706aa expref: 17 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.217322:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff283b68200/0x4b1103cba66706b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba66706aa expref: 17 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.217331:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b68200, rc 0) 00000100:00100000:0.0:1788263447.217371:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+17:17062:x1875129709813632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263447.217378:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788263447.217517:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709813632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263447.217531:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba66706aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66706b1 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263447.217540:0:17062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba66706aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba66706b1 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263447.217636:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709813760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263447.217662:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263447.217682:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae57a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788263447.217748:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709813760 00000100:00100000:0.0:1788263447.217753:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709813760 00000100:00100000:0.0:1788263447.217777:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788263447.217783:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+17:17062:x1875129709813760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263447.217885:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+17:17062:x1875129709813760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263447.217892:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788263447.218027:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709813760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263447.218053:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709813888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263447.218090:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263447.218113:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae57a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788263447.218162:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709813888 00000100:00100000:0.0:1788263447.218166:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709813888 00000100:00100000:0.0:1788263447.218196:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788263447.218203:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+17:17062:x1875129709813888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263447.218463:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+17:17062:x1875129709813888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 259us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263447.218469:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788263447.218551:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709813888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788263447.222766:0:18302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788263447.223740:0:17062:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788263447.223771:0:17062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788263447.223783:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba66706aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66706b1 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.223795:0:17062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba66706aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66706b1 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263447.223805:0:17062:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788263447.223808:0:17062:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff28389c800 from 13 10000000:01000000:0.0:1788263447.223811:0:17062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788263447.223851:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba66706b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.223859:0:17062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba66706b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.223869:0:17062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba66706b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263447.223893:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283327800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709814016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788263447.223955:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263447.224017:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3b006c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788263447.224060:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709814016 00000100:00100000:1.0:1788263447.224068:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709814016 00000100:00100000:1.0:1788263447.224119:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788263447.224129:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+17:17062:x1875129709814016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263447.224141:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263447.224153:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff381680c00/0x4b1103cba66706bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba66706b8 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.224182:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff381680c00/0x4b1103cba66706bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba66706b8 expref: 18 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.224192:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff381680c00/0x4b1103cba66706bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba66706b8 expref: 18 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.224208:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381680c00, rc 0) 00000100:00100000:1.0:1788263447.224250:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+18:17062:x1875129709814016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263447.224256:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788263447.224298:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283327800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709814016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263447.224312:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba66706b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66706bf expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263447.224320:0:17062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba66706b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba66706bf expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263447.224554:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709814144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263447.224605:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263447.224628:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2831a6180 going to sleep for 11 seconds 00000100:00100000:2.0:1788263447.224654:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709814144 00000100:00100000:2.0:1788263447.224660:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709814144 00000100:00100000:2.0:1788263447.224701:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788263447.224708:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+18:17062:x1875129709814144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263447.224814:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+18:17062:x1875129709814144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263447.224821:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788263447.224854:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709814144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263447.224882:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709814272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263447.224920:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263447.224934:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3ae57ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788263447.224947:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709814272 00000100:00100000:1.0:1788263447.224952:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709814272 00000100:00100000:1.0:1788263447.225046:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788263447.225054:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+18:17062:x1875129709814272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263447.225181:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+18:17062:x1875129709814272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263447.225189:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788263447.232463:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709814272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788263447.240033:0:18303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788263447.240224:0:17062:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788263447.240249:0:17062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788263447.240268:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba66706b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66706bf expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263447.240279:0:17062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba66706b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66706bf expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263447.792447:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788263448.053078:0:17101:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788263448.112266:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788263448.112284:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709814400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788263448.112507:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263448.112613:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709814400 00000100:00100000:0.0:1788263448.112622:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709814400 00000100:00100000:0.0:1788263448.112672:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788263448.112682:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3620:x1875129709814400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788263448.112713:0:17071:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788263448.112764:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3620:x1875129709814400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263448.112771:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788263448.112815:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709814400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788263448.113411:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788263448.113422:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709814528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788263448.113455:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263448.113483:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709814528 00000100:00100000:3.0:1788263448.113487:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709814528 00000100:00100000:3.0:1788263448.113517:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788263448.113525:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709814528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788263448.113543:0:17071:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788263448.114152:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709814528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 626us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263448.114160:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788263448.114202:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709814528:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788263448.815964:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788263449.008179:0:17817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:2.0:1788263449.152069:0:17798:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788263449.843348:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263450.864225:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263451.183727:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263436/real 1788263436] req@ffff9ff283326d80 x1875129709805568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263451 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263451.183759:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ff283326d80 x1875129709805568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263451 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263451.183769:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263436/real 1788263436] req@ffff9ff283324e00 x1875129709805696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263451 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263451.183780:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ff283324e00 x1875129709805696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263451 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788263451.183798:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3af7da000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788263451.183821:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788263451.183825:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709805568:0@lo:8:kworker.0 00000100:00080000:2.0:1788263451.183831:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3843fb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788263451.183855:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788263451.183857:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709805696:0@lo:8:kworker.0 00000100:00080000:3.0:1788263451.183908:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1788263451.183908:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:3.0:1788263451.183912:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788263451.183915:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ff3af7da000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788263451.183919:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 445 00000100:00100000:2.0:1788263451.183919:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fb36e90-c209-4884-91f2-1155be4ad295:3618:1875129709814656:0@lo:400:kworker.0 00000100:00080000:3.0:1788263451.183924:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788263451.183930:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ff3af7da000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788263451.183947:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff283988000 x1875129709814912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788263451.183970:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788263451.183973:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788263451.183974:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ff3843fb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788263451.183978:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 445 00000100:00080000:3.0:1788263451.183980:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788263451.183983:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ff3843fb800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263451.183986:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263451.183995:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff28398b800 x1875129709815040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788263451.184017:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788263451.184021:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788263451.184023:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788263451.184026:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788263451.184028:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398663800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709815296:0@lo:400:kworker.0 00000100:00080000:3.0:1788263451.184038:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788263451.184041:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788263451.184043:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788263451.184046:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788263451.184051:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263451.184058:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709814784:0@lo:400:kworker.0 00000100:00100000:2.0:1788263451.184067:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263451.184072:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709815424:0@lo:400:kworker.0 00000100:00100000:3.0:1788263451.184083:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263451.184090:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263451.184098:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788263451.184103:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709815168:0@lo:400:kworker.0 00000100:00100000:2.0:1788263451.184114:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709814656 00000100:00100000:2.0:1788263451.184120:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709814656 00000100:00100000:3.0:1788263451.184122:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263451.184146:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709815296 00000100:00100000:3.0:1788263451.184155:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709815296 00000100:00100000:2.0:1788263451.184159:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788263451.184167:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+18:3618:x1875129709814656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263451.184172:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709814784 00000100:00100000:3.0:1788263451.184174:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709814784 00000100:00100000:3.0:1788263451.184186:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788263451.184191:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709815296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263451.184217:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+18:3618:x1875129709814656:12345-0@lo:400:kworker.0 Request processed in 49us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263451.184221:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709815296:12345-0@lo:400:kworker.0 Request processed in 30us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263451.184224:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788263451.184226:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788263451.184239:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788263451.184244:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709814784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263451.184260:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709814912:0@lo:8:kworker.0 00000100:00100000:3.0:1788263451.184272:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709814784:12345-0@lo:400:kworker.0 Request processed in 28us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263451.184278:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000400:00000100:2.0:1788263451.184280:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875129709814912 offset 0 length 520: 4 00000100:00100000:2.0:1788263451.184291:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28398b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709815040:0@lo:8:kworker.0 00000100:00100000:3.0:1788263451.184295:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709815424 00000100:00100000:3.0:1788263451.184298:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709815424 00000400:00000100:2.0:1788263451.184307:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875129709815040 offset 0 length 520: 4 00000100:00100000:3.0:1788263451.184319:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709815168 00000100:00100000:3.0:1788263451.184323:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709815168 00000100:00100000:2.0:1788263451.184336:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398663800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709815296:0@lo:400:kworker.0 00000100:00100000:3.0:1788263451.184338:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788263451.184343:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709815424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263451.184345:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fb36e90-c209-4884-91f2-1155be4ad295:3618:1875129709814656:0@lo:400:kworker.0 00000100:00100000:3.0:1788263451.184392:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709815424:12345-0@lo:400:kworker.0 Request processed in 48us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263451.184397:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788263451.184412:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709815168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263451.184442:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709815168:12345-0@lo:400:kworker.0 Request processed in 32us (319us total) trans 0 rc 0/0 00010000:00080000:0.0:1788263451.184713:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ff283988380 x1875129709815168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263451.184723:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709815168:0@lo:400:kworker.0 00000100:00100000:0.0:1788263451.184733:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709814784:0@lo:400:kworker.0 00000100:00100000:3.0:1788263451.186785:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788263451.186882:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ff398662a00 x1875129709815424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263451.186897:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709815424:0@lo:400:kworker.0 00000100:00100000:2.0:1788263451.189685:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000020:01000004:2.0:1788263451.764164:0:18567:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788263451.764167:0:18567:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788263451.764169:0:18567:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788263451.764408:0:18567:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ff38760a800 00000020:01000004:2.0:1788263451.764424:0:18567:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788263451.764438:0:18567:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788263451.764451:0:18567:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ff281fa4d28) 00000020:00000080:2.0:1788263451.764474:0:18567:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788263451.836449:0:18567:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788263451.839025:0:18567:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788263451.839246:0:18567:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788263451.839832:0:18567:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788263451.840031:0:18567:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788263451.840692:0:18567:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788263451.840927:0:18567:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1788263451.857263:0:18567:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788263451.857626:0:18567:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788263451.857640:0:18567:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788263451.857653:0:18567:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4b1103cba66706cd 00000020:01000004:2.0:1788263451.857660:0:18567:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788263451.857681:0:18567:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.126@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788263451.857684:0:18567:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788263451.857690:0:18567:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788263451.857694:0:18567:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788263451.857705:0:18567:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ff281fa3370) 00000020:00000080:2.0:1788263451.857721:0:18567:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1788263451.860409:0:18567:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788263451.860643:0:18567:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788263451.860649:0:18567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788263451.864077:0:18567:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788263451.864087:0:18567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788263451.864368:0:18567:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788263451.864375:0:18567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788263451.866938:0:18567:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788263451.867540:0:18567:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788263451.867553:0:18567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788263451.869505:0:18567:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788263451.869516:0:18567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:0.0:1788263451.887872:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263451.891748:0:18567:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788263451.891980:0:18567:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788263451.891987:0:18567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788263451.897296:0:18567:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788263451.897311:0:18567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788263451.908185:0:18567:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788263451.908201:0:18567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788263451.909876:0:18567:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788263451.910064:0:18567:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788263451.910069:0:18567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788263451.912440:0:18567:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788263451.915473:0:18567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788263451.974333:0:18567:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788263451.975177:0:18567:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788263451.975185:0:18567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788263451.976297:0:18567:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788263451.976306:0:18567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788263451.977276:0:18567:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788263451.977302:0:18567:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788263451.977307:0:18567:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.126@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788263451.999318:0:18567:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788263451.999431:0:18567:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.126@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788263451.999436:0:18567:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788263451.999437:0:18567:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788263451.999439:0:18567:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788263451.999440:0:18567:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788263451.999441:0:18567:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788263451.999442:0:18567:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788263451.999444:0:18567:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788263451.999446:0:18567:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788263451.999447:0:18567:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788263451.999450:0:18567:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788263451.999452:0:18567:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788263451.999503:0:18567:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788263451.999504:0:18567:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788263451.999505:0:18567:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788263451.999506:0:18567:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788263451.999508:0:18567:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788263451.999509:0:18567:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788263451.999510:0:18567:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788263451.999511:0:18567:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788263451.999539:0:18567:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788263451.999565:0:18567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709815552:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788263451.999671:0:18567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263451.999720:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709815552 00000100:00100000:0.0:1788263451.999720:0:18567:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3c05bc000 going to sleep for 11 seconds 00000100:00100000:1.0:1788263451.999727:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709815552 00000100:00100000:1.0:1788263451.999795:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788263451.999805:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+18:18567:x1875129709815552:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788263451.999843:0:17059:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788263451.999847:0:17059:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788263451.999850:0:17059:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788263452.000202:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+18:18567:x1875129709815552:12345-0@lo:253:mount.lustre.0 Request processed in 397us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263452.000208:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788263452.000501:0:18567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709815552:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788263452.000509:0:18567:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788263452.000511:0:18567:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788263452.000511:0:18567:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788263452.000512:0:18567:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788263452.000513:0:18567:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788263452.000514:0:18567:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788263452.000514:0:18567:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788263452.000515:0:18567:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788263452.000516:0:18567:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788263452.000517:0:18567:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788263452.000534:0:18567:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ff38760a800 from lustre-OST0000 10000000:01000000:0.0:1788263452.000561:0:18567:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788263452.000563:0:18567:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788263452.000569:0:18567:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ff3af7e19b8 local copy 00010000:00010000:0.0:1788263452.000699:0:18567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0600/0x4b1103cba6670488 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667048f expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263452.000791:0:18567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709815680:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263452.000825:0:18567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263452.000845:0:18567:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39aad63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263452.000901:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709815680 00000100:00100000:2.0:1788263452.000906:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709815680 00000100:00100000:2.0:1788263452.000974:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788263452.000983:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+18:18567:x1875129709815680:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263452.001053:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+18:18567:x1875129709815680:12345-0@lo:501:mount.lustre.0 Request processed in 72us (227us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788263452.001059:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788263452.001073:0:18567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709815680:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788263452.001087:0:18567:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788263452.001106:0:18567:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788263452.001111:0:18567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0600/0x4b1103cba6670488 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667048f expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.001119:0:18567:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0600/0x4b1103cba6670488 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667048f expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263452.001141:0:18567:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ff38760a800 10000000:01000000:0.0:1788263452.001146:0:18567:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788263452.001150:0:18567:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788263452.001153:0:18567:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788263452.001157:0:18567:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788263452.001160:0:18567:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788263452.001178:0:18567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff283b69c00/0x4b1103cba66706db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.001247:0:18567:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff283b69c00/0x4b1103cba66706db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.001387:0:18567:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff283b69c00/0x4b1103cba66706db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263452.001401:0:18567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709815808:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788263452.001427:0:18567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263452.001446:0:18567:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39aad63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263452.001500:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709815808 00000100:00100000:2.0:1788263452.001504:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709815808 00000100:00100000:2.0:1788263452.001535:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788263452.001542:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+18:18567:x1875129709815808:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788263452.001551:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263452.001564:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3bf6d0000/0x4b1103cba66706e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba66706db expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263452.001875:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3bf6d0000/0x4b1103cba66706e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba66706db expref: 19 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263452.001887:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3bf6d0000/0x4b1103cba66706e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba66706db expref: 19 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263452.001896:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d0000, rc 0) 00000100:00100000:2.0:1788263452.001934:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+19:18567:x1875129709815808:12345-0@lo:101:mount.lustre.0 Request processed in 392us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263452.001948:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788263452.001962:0:18567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709815808:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788263452.001974:0:18567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff283b69c00/0x4b1103cba66706db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66706e2 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.001983:0:18567:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff283b69c00/0x4b1103cba66706db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba66706e2 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788263452.004511:0:18567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788263452.006512:0:18567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788263452.008991:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788263452.009047:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788263452.009065:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788263452.009081:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788263452.009096:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788263452.009111:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788263452.009139:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788263452.009145:0:18567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788263452.009311:0:18567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709815936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263452.009394:0:18567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263452.009508:0:18567:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39aad6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788263452.009771:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709815936 00000100:00100000:2.0:1788263452.009780:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709815936 00000100:00100000:2.0:1788263452.009865:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788263452.009875:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+19:18567:x1875129709815936:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263452.010066:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+19:18567:x1875129709815936:12345-0@lo:501:mount.lustre.0 Request processed in 193us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263452.010074:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788263452.010141:0:18567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709815936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263452.010198:0:18567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709816064:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788263452.010237:0:18567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263452.010263:0:18567:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39aad6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788263452.010409:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709816064 00000100:00100000:2.0:1788263452.010414:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709816064 00000100:00100000:2.0:1788263452.010472:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788263452.010478:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+19:18567:x1875129709816064:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788263452.011268:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+19:18567:x1875129709816064:12345-0@lo:503:mount.lustre.0 Request processed in 788us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263452.011276:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788263452.011563:0:18567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709816064:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788263452.012019:0:18567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788263452.012099:0:18567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709816192:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788263452.012147:0:18567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263452.012320:0:18567:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28323e780 going to sleep for 11 seconds 00000100:00100000:2.0:1788263452.012464:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709816192 00000100:00100000:2.0:1788263452.012470:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709816192 00000100:00100000:2.0:1788263452.012520:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788263452.012529:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+19:18567:x1875129709816192:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788263452.013041:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+19:18567:x1875129709816192:12345-0@lo:502:mount.lustre.0 Request processed in 512us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263452.013049:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788263452.013140:0:18567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709816192:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788263452.013456:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788263452.013497:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788263452.013516:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788263452.013532:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788263452.013548:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788263452.013614:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788263452.013633:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788263452.013648:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788263452.013663:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788263452.013678:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788263452.013693:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788263452.013707:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788263452.013738:0:18567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709816320:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788263452.013783:0:18567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263452.013816:0:18567:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39aad63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263452.013895:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709816320 00000100:00100000:1.0:1788263452.013902:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709816320 00000100:00100000:1.0:1788263452.013933:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788263452.013940:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+19:18567:x1875129709816320:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788263452.014031:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+19:18567:x1875129709816320:12345-0@lo:502:mount.lustre.0 Request processed in 91us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263452.014038:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788263452.014264:0:18567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709816320:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788263452.014302:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788263452.014315:0:18567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788263452.015101:0:18584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788263452.015113:0:18584:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788263452.015120:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263452.015122:0:18584:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788263452.015128:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788263452.015142:0:18584:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ff3aec2cd28) 00000020:00000080:1.0:1788263452.015164:0:18584:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788263452.015170:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788263452.015302:0:18584:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ff38760a800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788263452.015310:0:18584:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788263452.015318:0:18584:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4b1103cba66706f0 00010000:00010000:0.0:1788263452.020439:0:18584:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1788263452.021100:0:18584:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:0.0:1788263452.022809:0:18584:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1788263452.024234:0:18584:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788263452.024245:0:18584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263452.024251:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263452.024254:0:18584:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788263452.024258:0:18584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788263452.024260:0:18584:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1788263452.024262:0:18584:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788263452.024264:0:18584:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788263452.024265:0:18584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788263452.024268:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263452.024269:0:18584:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788263452.024272:0:18584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263452.024275:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263452.024276:0:18584:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788263452.024279:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788263452.024281:0:18584:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788263452.024283:0:18584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263452.024285:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263452.024287:0:18584:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788263452.024289:0:18584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263452.024291:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263452.024292:0:18584:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788263452.024295:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788263452.024320:0:18584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263452.024401:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263452.024403:0:18584:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788263452.024406:0:18584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788263452.024660:0:18567:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788263452.024692:0:18567:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788263452.024716:0:18567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff283b69c00/0x4b1103cba66706db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66706e2 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263452.024728:0:18567:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff283b69c00/0x4b1103cba66706db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66706e2 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263452.024737:0:18567:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff38760a800 from 1 10000000:01000000:3.0:1788263452.024740:0:18567:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788263452.024772:0:18567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff38150ea00/0x4b1103cba66706f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263452.024781:0:18567:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff38150ea00/0x4b1103cba66706f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263452.024791:0:18567:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff38150ea00/0x4b1103cba66706f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263452.024814:0:18567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398662a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709816448:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788263452.024877:0:18567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263452.024912:0:18567:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3c059b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788263452.025626:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709816448 00000100:00100000:0.0:1788263452.025636:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709816448 00000100:00100000:0.0:1788263452.025681:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788263452.025704:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+19:18567:x1875129709816448:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788263452.025716:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263452.025729:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff283b68000/0x4b1103cba66706fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba66706f7 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.025751:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff283b68000/0x4b1103cba66706fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba66706f7 expref: 20 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.025760:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff283b68000/0x4b1103cba66706fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba66706f7 expref: 20 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.025768:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b68000, rc 0) 00000100:00100000:0.0:1788263452.025813:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+20:18567:x1875129709816448:12345-0@lo:101:mount.lustre.0 Request processed in 112us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263452.025820:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788263452.026451:0:18567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398662a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709816448:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788263452.026471:0:18567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff38150ea00/0x4b1103cba66706f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66706fe expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263452.026480:0:18567:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff38150ea00/0x4b1103cba66706f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba66706fe expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788263452.029085:0:18567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788263452.030083:0:18567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788263452.030312:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788263452.030359:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788263452.030380:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788263452.030386:0:18567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788263452.030460:0:18567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398662a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709816576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788263452.030539:0:18567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263452.030576:0:18567:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3c059b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788263452.030861:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709816576 00000100:00100000:1.0:1788263452.030869:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709816576 00000100:00100000:1.0:1788263452.030950:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788263452.030960:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+20:18567:x1875129709816576:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788263452.031082:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+20:18567:x1875129709816576:12345-0@lo:501:mount.lustre.0 Request processed in 124us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263452.031089:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788263452.031160:0:18567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398662a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709816576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788263452.031193:0:18567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398662a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709816704:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788263452.031239:0:18567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263452.031456:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709816704 00000100:00100000:2.0:1788263452.031461:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709816704 00000100:00100000:2.0:1788263452.031492:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788263452.031499:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+20:18567:x1875129709816704:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788263452.031574:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+20:18567:x1875129709816704:12345-0@lo:503:mount.lustre.0 Request processed in 75us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263452.031598:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788263452.031775:0:18567:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3c059b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788263452.031789:0:18567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398662a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709816704:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788263452.032127:0:18567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788263452.032260:0:18567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398662a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709816832:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788263452.032302:0:18567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263452.032442:0:18567:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff38325c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263452.032547:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709816832 00000100:00100000:2.0:1788263452.032552:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709816832 00000100:00100000:2.0:1788263452.032708:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788263452.032719:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+20:18567:x1875129709816832:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788263452.032819:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+20:18567:x1875129709816832:12345-0@lo:502:mount.lustre.0 Request processed in 102us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263452.032828:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788263452.032895:0:18567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398662a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709816832:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788263452.033080:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788263452.033107:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788263452.033123:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788263452.033134:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788263452.033145:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788263452.033158:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788263452.033202:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788263452.033228:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1788263452.033247:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788263452.033275:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1788263452.033291:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1788263452.033316:0:18567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398662a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709816960:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788263452.033374:0:18567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263452.033715:0:18567:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff38325c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263452.033766:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709816960 00000100:00100000:1.0:1788263452.033773:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709816960 00000100:00100000:1.0:1788263452.033809:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788263452.033818:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+20:18567:x1875129709816960:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788263452.033951:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+20:18567:x1875129709816960:12345-0@lo:502:mount.lustre.0 Request processed in 134us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263452.033958:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788263452.035306:0:18567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398662a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709816960:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788263452.035461:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1788263452.035474:0:18567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788263452.038410:0:18588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263452.038422:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263452.038425:0:18588:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788263452.038432:0:18588:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ff38760a800 00000020:00000080:2.0:1788263452.038435:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788263452.038443:0:18588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263452.038446:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263452.038447:0:18588:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788263452.038449:0:18588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263452.038452:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263452.038453:0:18588:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788263452.038456:0:18588:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ff38760a800 00000020:00000080:2.0:1788263452.038459:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788263452.038515:0:18588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263452.038519:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263452.038521:0:18588:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788263452.038523:0:18588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263452.038526:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263452.038527:0:18588:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788263452.038530:0:18588:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ff38760a800 00000020:00000080:2.0:1788263452.038538:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788263452.038559:0:18588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263452.038562:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263452.038564:0:18588:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788263452.038566:0:18588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263452.038569:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263452.038570:0:18588:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788263452.038574:0:18588:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ff38760a800 00000020:00000080:2.0:1788263452.038603:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788263452.038629:0:18588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263452.039322:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263452.039324:0:18588:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788263452.039328:0:18588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1788263452.039666:0:18567:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788263452.039697:0:18567:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788263452.039711:0:18567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff38150ea00/0x4b1103cba66706f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66706fe expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.039723:0:18567:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff38150ea00/0x4b1103cba66706f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66706fe expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263452.039779:0:18567:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788263452.039782:0:18567:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ff38760a800 10000000:01000000:0.0:1788263452.039785:0:18567:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ff38760a800 10000000:01000000:0.0:1788263452.039790:0:18567:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788263452.039796:0:18567:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ff38760a800 from 1 10000000:01000000:0.0:1788263452.039799:0:18567:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788263452.039833:0:18567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff283b69000/0x4b1103cba6670705 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.039847:0:18567:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff283b69000/0x4b1103cba6670705 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.039859:0:18567:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff283b69000/0x4b1103cba6670705 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263452.039944:0:18567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709817088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788263452.040008:0:18567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263452.040090:0:18567:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39aad6780 going to sleep for 11 seconds 00000100:00100000:3.0:1788263452.041302:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709817088 00000100:00100000:3.0:1788263452.041315:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709817088 00000100:00100000:3.0:1788263452.041532:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788263452.041543:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+20:18567:x1875129709817088:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788263452.041558:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263452.041574:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff38150e200/0x4b1103cba667070c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba6670705 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263452.041628:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff38150e200/0x4b1103cba667070c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba6670705 expref: 21 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263452.041639:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff38150e200/0x4b1103cba667070c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670705 expref: 21 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263452.041648:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150e200, rc 0) 00000100:00100000:3.0:1788263452.041715:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+21:18567:x1875129709817088:12345-0@lo:101:mount.lustre.0 Request processed in 174us (1706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263452.041721:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788263452.042044:0:18567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709817088:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788263452.042062:0:18567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff283b69000/0x4b1103cba6670705 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667070c expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.042072:0:18567:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff283b69000/0x4b1103cba6670705 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba667070c expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788263452.048663:0:18567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788263452.049088:0:18567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788263452.049851:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788263452.049886:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788263452.049902:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788263452.049920:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788263452.049935:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788263452.049949:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788263452.049964:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788263452.049979:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788263452.049999:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788263452.050013:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788263452.050026:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788263452.050054:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788263452.050076:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788263452.050090:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788263452.050104:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788263452.050120:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788263452.050138:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788263452.050153:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788263452.050170:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788263452.050196:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788263452.050214:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788263452.050242:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788263452.050258:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788263452.050275:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788263452.050292:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1788263452.050312:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1788263452.050451:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1788263452.050493:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1788263452.050511:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1788263452.050524:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1788263452.050536:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1788263452.050549:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1788263452.050562:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1788263452.050573:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1788263452.050620:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1788263452.050633:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1788263452.050646:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1788263452.050670:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1788263452.050676:0:18567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788263452.050769:0:18567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709817216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263452.050830:0:18567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263452.050873:0:18567:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39aad6240 going to sleep for 11 seconds 00000100:00100000:3.0:1788263452.051024:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709817216 00000100:00100000:3.0:1788263452.051032:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709817216 00000100:00100000:3.0:1788263452.051081:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788263452.051091:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+21:18567:x1875129709817216:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788263452.051204:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+21:18567:x1875129709817216:12345-0@lo:501:mount.lustre.0 Request processed in 113us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263452.051212:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788263452.051438:0:18567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709817216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263452.051546:0:18567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709817344:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788263452.051617:0:18567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263452.051636:0:18567:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39aad6240 going to sleep for 11 seconds 00000100:00100000:3.0:1788263452.053602:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709817344 00000100:00100000:3.0:1788263452.053615:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709817344 00000100:00100000:3.0:1788263452.053668:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788263452.053677:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+21:18567:x1875129709817344:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788263452.053815:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+21:18567:x1875129709817344:12345-0@lo:503:mount.lustre.0 Request processed in 139us (2197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263452.053823:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788263452.053945:0:18567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709817344:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788263452.055702:0:18567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788263452.055797:0:18567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709817472:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788263452.055869:0:18567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263452.055908:0:18567:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a9671000 going to sleep for 11 seconds 00000100:00100000:0.0:1788263452.055933:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709817472 00000100:00100000:0.0:1788263452.055938:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709817472 00000100:00100000:0.0:1788263452.055991:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788263452.056001:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+21:18567:x1875129709817472:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788263452.056097:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+21:18567:x1875129709817472:12345-0@lo:502:mount.lustre.0 Request processed in 97us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263452.056105:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788263452.056153:0:18567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709817472:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788263452.057637:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788263452.057680:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788263452.057696:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788263452.057708:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788263452.057721:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788263452.057734:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788263452.057747:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788263452.057759:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788263452.057773:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788263452.057784:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788263452.057796:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788263452.057820:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788263452.057832:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788263452.057845:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788263452.058133:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788263452.058151:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788263452.058166:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788263452.058264:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788263452.058281:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788263452.058295:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788263452.058309:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788263452.058411:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788263452.058430:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788263452.058445:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788263452.058459:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788263452.058473:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788263452.058560:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788263452.058646:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788263452.058667:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788263452.058682:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788263452.058696:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788263452.058708:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788263452.058719:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788263452.058747:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788263452.058763:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788263452.058778:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788263452.058792:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788263452.058805:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788263452.058818:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788263452.058831:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788263452.058845:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788263452.058858:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788263452.058872:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788263452.058886:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788263452.058910:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788263452.058924:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788263452.058938:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788263452.058951:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788263452.059014:0:18567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709817600:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788263452.059090:0:18567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263452.059686:0:18567:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39aad6780 going to sleep for 11 seconds 00000100:00100000:1.0:1788263452.060275:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709817600 00000100:00100000:1.0:1788263452.060284:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709817600 00000100:00100000:1.0:1788263452.060357:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788263452.060367:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+21:18567:x1875129709817600:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788263452.060513:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+21:18567:x1875129709817600:12345-0@lo:502:mount.lustre.0 Request processed in 146us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263452.060529:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788263452.060614:0:18567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709817600:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788263452.060814:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1788263452.060839:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1788263452.060869:0:18567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709817728:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788263452.060908:0:18567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263452.060939:0:18567:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a9671000 going to sleep for 11 seconds 00000100:00100000:1.0:1788263452.060954:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709817728 00000100:00100000:1.0:1788263452.060959:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709817728 00000100:00100000:1.0:1788263452.061116:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788263452.061125:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+21:18567:x1875129709817728:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788263452.061213:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+21:18567:x1875129709817728:12345-0@lo:502:mount.lustre.0 Request processed in 89us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263452.061230:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788263452.061358:0:18567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709817728:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788263452.061394:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1788263452.061402:0:18567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788263452.066272:0:18593:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788263452.066287:0:18593:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ff283228000) 00000020:00000080:3.0:1788263452.066310:0:18593:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1788263452.066679:0:18593:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ff38760a800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788263452.066683:0:18593:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ff38760a800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788263452.066687:0:18593:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ff38760a800 3 00010000:00080000:3.0:1788263452.066724:0:18593:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ff282c72000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.126@tcp at head 00010000:00010000:3.0:1788263452.078017:0:18593:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1788263452.080537:0:18593:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788263452.080618:0:18593:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788263452.080634:0:18593:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4b1103cba667071a 00000100:00080000:3.0:1788263452.080645:0:18593:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788263452.080651:0:18593:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ff282c72000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788263452.080687:0:18593:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff398662a00 x1875129709817856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788263452.080722:0:18593:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788263452.080942:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875129709817856:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788263452.081010:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263452.081076:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709817856 00000100:00100000:0.0:1788263452.081084:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709817856 00000100:00100000:0.0:1788263452.081116:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788263452.081123:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3617:x1875129709817856:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788263452.081164:0:18294:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:0.0:1788263452.081210:0:18294:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4b1103cba6670721 00000004:00100000:0.0:1788263452.081225:0:18294:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788263452.081258:0:18294:0:(import.c:65:import_set_state_nolock()) ffff9ff38438a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263452.081315:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875129709817856:12345-0@lo:38:llog_process_th.0 Request processed in 190us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263452.081323:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788263452.081648:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ff398662a00 x1875129709817856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788263462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263452.081658:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788263452.081665:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788263452.081671:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788263452.081675:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788263452.081677:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff282c72000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788263452.081683:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3617:1875129709817856:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788263452.082906:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788263452.082912:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788263452.082914:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788263452.082917:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788263452.083036:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788263452.083039:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788263452.083042:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788263452.083044:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788263452.083081:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709818240:0@lo:400:kworker.0 00000100:00100000:1.0:1788263452.083103:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709818368:0@lo:400:kworker.0 00000100:00100000:2.0:1788263452.083135:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263452.083135:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263452.083181:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875129709818112:0@lo:400:kworker.0 00000100:00100000:2.0:1788263452.083441:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709818240 00000100:00100000:2.0:1788263452.083449:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709818240 00000100:00100000:0.0:1788263452.083569:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709817984:0@lo:400:kworker.0 00000100:00100000:0.0:1788263452.083629:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263452.083737:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709817984 00000100:00100000:2.0:1788263452.083741:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709817984 00000100:00100000:2.0:1788263452.083768:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788263452.083776:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709818240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263452.083834:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709818240:12345-0@lo:400:kworker.0 Request processed in 59us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263452.083841:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788263452.083855:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788263452.083861:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709817984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263452.083893:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709817984:12345-0@lo:400:kworker.0 Request processed in 32us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263452.083898:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788263452.087518:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709818240:0@lo:400:kworker.0 00000100:00100000:0.0:1788263452.087644:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709818368 00000100:00100000:0.0:1788263452.087651:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709818368 00000100:00100000:0.0:1788263452.087710:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788263452.087720:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709818368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263452.087803:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709818368:12345-0@lo:400:kworker.0 Request processed in 84us (4667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263452.087810:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788263452.087827:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ff3b5471880 x1875129709818368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263452.087842:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709818368:0@lo:400:kworker.0 00000020:01000004:0.0:1788263452.087924:0:18593:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788263452.087938:0:18593:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9ff3b002b370) 00000020:00000080:0.0:1788263452.087960:0:18593:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1788263452.088064:0:18593:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ff38760a800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788263452.088068:0:18593:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ff38760a800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788263452.088076:0:18593:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ff38760a800 3 00010000:00080000:0.0:1788263452.088105:0:18593:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ff282290000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.126@tcp at head 00010000:00010000:0.0:1788263452.089806:0:18593:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1788263452.090005:0:18593:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788263452.090046:0:18593:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788263452.090057:0:18593:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x4b1103cba667072f 00000100:00080000:0.0:1788263452.090065:0:18593:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788263452.090070:0:18593:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9ff282290000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:0.0:1788263452.090102:0:18593:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff283324380 x1875129709818496/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788263452.090136:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1875129709818496:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788263452.090194:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263452.090249:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709818496 00000100:00100000:0.0:1788263452.090254:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709818496 00000100:00100000:0.0:1788263452.090283:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788263452.090290:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3617:x1875129709818496:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788263452.090324:0:18294:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:0.0:1788263452.090367:0:18294:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x4b1103cba6670736 00000004:00100000:0.0:1788263452.090382:0:18294:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788263452.090410:0:18294:0:(import.c:65:import_set_state_nolock()) ffff9ff282296000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263452.090457:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875129709818496:12345-0@lo:38:llog_process_th.0 Request processed in 166us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263452.090464:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788263452.090477:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709817984:0@lo:400:kworker.0 00010000:00080000:0.0:1788263452.090500:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ff283324380 x1875129709818496/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788263462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263452.090509:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788263452.090514:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788263452.090526:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788263452.090529:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788263452.090532:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff282290000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788263452.090537:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3617:1875129709818496:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788263452.091533:0:18593:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788263452.091560:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263452.091620:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709818112 00000100:00100000:3.0:1788263452.091627:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709818112 00000100:00080000:0.0:1788263452.091655:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788263452.091661:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788263452.091664:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788263452.091668:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788263452.091670:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788263452.091673:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788263452.091678:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788263452.091680:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875129709818112:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788263452.091681:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788263452.091689:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788263452.091734:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875129709818112:12345-0@lo:400:kworker.0 Request processed in 56us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263452.091742:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788263452.091780:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ff3b5471f80 x1875129709818112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263452.091792:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875129709818112:0@lo:400:kworker.0 00000040:00080000:3.0:1788263452.093311:0:18593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1788263452.093692:0:18567:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788263452.093723:0:18567:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788263452.093745:0:18567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff283b69000/0x4b1103cba6670705 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667070c expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.093760:0:18567:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff283b69000/0x4b1103cba6670705 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667070c expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788263452.093815:0:18567:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788263452.093817:0:18567:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788263452.093818:0:18567:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788263452.093820:0:18567:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788263452.093827:0:18567:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788263452.093828:0:18567:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788263452.093830:0:18567:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788263452.093831:0:18567:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788263452.093833:0:18567:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788263452.093836:0:18567:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788263452.093838:0:18567:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788263452.093839:0:18567:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788263452.093840:0:18567:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788263452.093841:0:18567:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788263452.093842:0:18567:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788263452.093843:0:18567:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788263452.093844:0:18567:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788263452.093845:0:18567:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788263452.093846:0:18567:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788263452.094063:0:18567:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788263452.094081:0:18567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283324380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709818624:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788263452.094140:0:18567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263452.094180:0:18567:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28222b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263452.094405:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709818624 00000100:00100000:1.0:1788263452.094413:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709818624 00000100:00100000:1.0:1788263452.094458:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788263452.094467:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+21:18567:x1875129709818624:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788263452.094494:0:17060:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788263452.094505:0:17060:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788263452.103052:0:17060:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788263452.103107:0:17060:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788263452.105656:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+21:18567:x1875129709818624:12345-0@lo:253:mount.lustre.0 Request processed in 11181us (11506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263452.105670:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 20000000:01000000:0.0:1788263452.106494:0:17081:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788263452.106500:0:17081:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788263452.106520:0:17081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ff283b68400/0x4b1103cba667073d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.106537:0:17081:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff3bf6d1000/0x4b1103cba6670687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670680 expref: 20 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.106545:0:17081:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff283b68c00/0x4b1103cba6670695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba667068e expref: 20 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.106551:0:17081:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ff283b68400/0x4b1103cba667073d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.106601:0:17081:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff283b68c00/0x4b1103cba6670695 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba667068e expref: 20 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.106625:0:17081:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ff283b68c00/0x4b1103cba6670695 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba667068e expref: 20 pid: 17060 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263452.106639:0:17081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283326d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17081:1875129709818752:0@lo:104: 00000100:00100000:0.0:1788263452.106681:0:17081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788263452.106728:0:17081:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff3bf6d1000/0x4b1103cba6670687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba6670680 expref: 20 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.106737:0:17081:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ff3bf6d1000/0x4b1103cba6670687 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba6670680 expref: 20 pid: 17059 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263452.106746:0:17081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283324700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17081:1875129709818880:0@lo:104: 00000100:00100000:0.0:1788263452.106768:0:17081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263452.106785:0:17081:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff28323e840 going to sleep for 11 seconds 00000100:00100000:0.0:1788263452.106809:0:17048:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788263452.106827:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709818752 00000100:00100000:0.0:1788263452.106833:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709818752 00000100:00100000:0.0:1788263452.106861:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709818880 00000100:00100000:0.0:1788263452.106864:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709818880 00000100:00100000:0.0:1788263452.106878:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788263452.106886:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283327800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fb36e90-c209-4884-91f2-1155be4ad295+4:17081:x1875129709818752:12345-0@lo:104: 00010000:00010000:0.0:1788263452.106898:0:17048:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba667068e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba6670695 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.106990:0:17048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788263452.106997:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283327800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fb36e90-c209-4884-91f2-1155be4ad295+4:17081:x1875129709818752:12345-0@lo:104: Request processed in 112us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263452.107004:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788263452.107026:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788263452.107032:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf6cac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fb36e90-c209-4884-91f2-1155be4ad295+3:17081:x1875129709818880:12345-0@lo:104: 00010000:00010000:0.0:1788263452.107040:0:17048:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff38150e600/0x4b1103cba6670680 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba6670687 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.107073:0:17048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788263452.107078:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf6cac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fb36e90-c209-4884-91f2-1155be4ad295+3:17081:x1875129709818880:12345-0@lo:104: Request processed in 47us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263452.107084:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788263452.107116:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788263452.107121:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba667068e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba6670695 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.107128:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150e000 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:0.0:1788263452.107131:0:17054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba667068e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba6670695 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.107139:0:17054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba667068e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba6670695 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263452.107146:0:17054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba667068e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba6670695 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263452.107152:0:17054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788263452.107176:0:17054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba667068e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba6670695 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.107182:0:17054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263452.107199:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba667068e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba6670695 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.107216:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba667068e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba6670695 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.107227:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263452.107231:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff38150e600/0x4b1103cba6670680 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba6670687 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.107237:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150e600 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:0.0:1788263452.107240:0:17054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff38150e600/0x4b1103cba6670680 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba6670687 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.107246:0:17054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff38150e600/0x4b1103cba6670680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba6670687 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263452.107252:0:17054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff38150e600/0x4b1103cba6670680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba6670687 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263452.107273:0:17054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788263452.107287:0:17054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff38150e600/0x4b1103cba6670680 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba6670687 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.107293:0:17054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263452.107300:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff38150e600/0x4b1103cba6670680 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba6670687 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.107305:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff38150e600/0x4b1103cba6670680 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba6670687 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.107316:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263452.107322:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263452.107324:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263452.107330:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263452.107341:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fb36e90-c209-4884-91f2-1155be4ad295:3620:1875129709819008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263452.107385:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263452.107406:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788263452.107412:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fb36e90-c209-4884-91f2-1155be4ad295:3620:1875129709819136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263452.107434:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263452.107459:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709819008 00000100:00100000:0.0:1788263452.107463:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709819008 00010000:00010000:0.0:1788263452.107478:0:17051:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff283b68c00/0x4b1103cba6670695 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba667068e expref: 21 pid: 17060 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263452.107497:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709819136 00000100:00100000:0.0:1788263452.107499:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709819136 00010000:00010000:0.0:1788263452.107509:0:17051:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff3bf6d1000/0x4b1103cba6670687 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba6670680 expref: 22 pid: 17059 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263452.107520:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788263452.107526:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283327800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8fb36e90-c209-4884-91f2-1155be4ad295+22:3620:x1875129709819008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263452.107535:0:17051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263452.107540:0:17051:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff283b68c00/0x4b1103cba6670695 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba667068e expref: 22 pid: 17060 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.107550:0:17051:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff283b68c00/0x4b1103cba6670695 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba667068e expref: 22 pid: 17060 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.107564:0:17051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263452.107607:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283327800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8fb36e90-c209-4884-91f2-1155be4ad295+22:3620:x1875129709819008:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263452.107620:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788263452.107633:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788263452.107638:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b54b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8fb36e90-c209-4884-91f2-1155be4ad295+21:3620:x1875129709819136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263452.107646:0:17051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263452.107650:0:17051:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff3bf6d1000/0x4b1103cba6670687 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba6670680 expref: 21 pid: 17059 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.107658:0:17051:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff3bf6d1000/0x4b1103cba6670687 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba6670680 expref: 21 pid: 17059 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.107669:0:17051:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ff283b68400/0x4b1103cba667073d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.107677:0:17051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff283b68400/0x4b1103cba667073d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788263452.107690:0:17051:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004289675s 00010000:00010000:0.0:1788263452.107694:0:17051:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff283b68400/0x4b1103cba667073d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.107700:0:17051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff283b68400/0x4b1103cba667073d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.107707:0:17051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ff283b68400/0x4b1103cba667073d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.107712:0:17051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ff283b68400/0x4b1103cba667073d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.107718:0:17051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b68400 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263452.107727:0:17051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ff283b68400/0x4b1103cba667073d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.107735:0:17051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ff283b68400/0x4b1103cba667073d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.107743:0:17051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ff283b68400/0x4b1103cba667073d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263452.107752:0:17051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263452.107773:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b54b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8fb36e90-c209-4884-91f2-1155be4ad295+21:3620:x1875129709819136:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263452.107779:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788263452.107832:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fb36e90-c209-4884-91f2-1155be4ad295:3620:1875129709819136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263452.107840:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fb36e90-c209-4884-91f2-1155be4ad295:3620:1875129709819008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263452.107874:0:18567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283324380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:18567:1875129709818624:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788263452.107883:0:18567:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788263452.107886:0:18567:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788263452.107887:0:18567:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788263452.107889:0:18567:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788263452.107890:0:18567:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788263452.107891:0:18567:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788263452.107892:0:18567:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788263452.107893:0:18567:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788263452.107895:0:18567:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788263452.107896:0:18567:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788263452.107904:0:18567:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788263452.108805:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff283b68c00/0x4b1103cba6670695 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba667068e expref: 20 pid: 17060 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263452.108831:0:17081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283326d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17081:1875129709818752:0@lo:104: 00010000:00010000:1.0:1788263452.108845:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3bf6d1000/0x4b1103cba6670687 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba6670680 expref: 19 pid: 17059 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263452.108854:0:17081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283324700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17081:1875129709818880:0@lo:104: 00010000:00010000:1.0:1788263452.108870:0:17081:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ff283b68400/0x4b1103cba667073d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263452.108878:0:17081:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ff283b68400/0x4b1103cba667073d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263452.108884:0:17081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ff283b68400/0x4b1103cba667073d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263452.108890:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff283b68400/0x4b1103cba667073d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1788263452.112408:0:18567:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788263452.115824:0:18567:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788263452.115835:0:18567:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788263452.115881:0:18567:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788263452.115919:0:18567:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788263452.116004:0:18567:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788263452.116025:0:18567:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788263452.117807:0:18567:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788263452.117995:0:18567:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788263452.915295:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788263452.973469:0:18646:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788263452.973835:0:18646:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788263453.231943:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788263453.231976:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709819264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788263453.232104:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263453.232271:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709819264 00000100:00100000:0.0:1788263453.232283:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709819264 00000100:00100000:0.0:1788263453.232358:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788263453.232371:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709819264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788263453.232424:0:17071:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788263453.232491:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709819264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263453.232499:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788263453.232612:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709819264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788263453.239824:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788263453.239869:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709819392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788263453.239966:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263453.240040:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709819392 00000100:00100000:1.0:1788263453.240049:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709819392 00000100:00100000:1.0:1788263453.240107:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788263453.240135:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709819392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788263453.240179:0:17070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788263453.240235:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709819392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263453.240243:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788263453.240300:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709819392:0@lo:41:osp-pre-0-1.0 10000000:01000000:0.0:1788263453.745821:0:17062:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788263453.745830:0:17062:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ff283349800 from 9 10000000:01000000:0.0:1788263453.745836:0:17062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788263453.745885:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263453.745897:0:17062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263453.745909:0:17062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670744 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263453.745946:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283326680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709819520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788263453.746016:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263453.746084:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39aad6780 going to sleep for 11 seconds 00000100:00100000:1.0:1788263453.746098:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709819520 00000100:00100000:1.0:1788263453.746115:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709819520 00000100:00100000:0.0:1788263453.746424:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788263453.746438:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+19:17062:x1875129709819520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263453.746451:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263453.746465:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff283b68400/0x4b1103cba667074b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba6670744 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263453.746490:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff283b68400/0x4b1103cba667074b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba6670744 expref: 20 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263453.746500:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff283b68400/0x4b1103cba667074b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670744 expref: 20 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263453.746523:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b68400, rc 0) 00000100:00100000:0.0:1788263453.746616:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+20:17062:x1875129709819520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263453.746624:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788263453.746655:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283326680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709819520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263453.746686:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670744 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667074b expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263453.746701:0:17062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670744 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba667074b expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263453.746813:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709819648:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788263453.746875:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263453.746918:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39064b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788263453.747028:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709819648 00000100:00100000:1.0:1788263453.747034:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709819648 00000100:00100000:1.0:1788263453.747082:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788263453.747094:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+20:17062:x1875129709819648:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788263453.747117:0:17060:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788263453.747137:0:17060:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788263453.747141:0:17060:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788263453.747491:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+20:17062:x1875129709819648:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 397us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263453.747501:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788263453.747666:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709819648:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788263453.747749:0:17062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788263453.747758:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670744 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667074b expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263453.747780:0:17062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667074b expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263453.747792:0:17062:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788263453.747795:0:17062:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ff28389c800 from 9 10000000:01000000:2.0:1788263453.747798:0:17062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788263453.747830:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1400/0x4b1103cba6670752 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263453.747838:0:17062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1400/0x4b1103cba6670752 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263453.747847:0:17062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1400/0x4b1103cba6670752 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263453.747865:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709819776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788263453.747910:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263453.747950:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39064b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788263453.749289:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709819776 00000100:00100000:3.0:1788263453.749303:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709819776 00000100:00100000:3.0:1788263453.749367:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788263453.749378:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+20:17062:x1875129709819776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263453.749393:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263453.749409:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff38150e800/0x4b1103cba6670759 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba6670752 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263453.749569:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff38150e800/0x4b1103cba6670759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba6670752 expref: 21 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263453.749623:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff38150e800/0x4b1103cba6670759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670752 expref: 21 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263453.749632:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff38150e800, rc 0) 00000100:00100000:3.0:1788263453.749718:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+21:17062:x1875129709819776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 340us (1809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263453.749727:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788263453.749787:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709819776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263453.749807:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1400/0x4b1103cba6670752 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670759 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263453.749817:0:17062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1400/0x4b1103cba6670752 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba6670759 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263453.749883:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398662680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709819904:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788263453.749924:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263453.749961:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2831a6180 going to sleep for 11 seconds 00000100:00100000:1.0:1788263453.750428:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709819904 00000100:00100000:1.0:1788263453.750441:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709819904 00000100:00100000:1.0:1788263453.750517:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788263453.750526:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+21:17062:x1875129709819904:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788263453.750550:0:17059:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788263453.750605:0:17059:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788263453.750609:0:17059:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788263453.750739:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+21:17062:x1875129709819904:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 214us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263453.750747:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788263453.750800:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398662680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709819904:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788263453.750873:0:17062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788263453.750883:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1400/0x4b1103cba6670752 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670759 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263453.750894:0:17062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1400/0x4b1103cba6670752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670759 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263453.941235:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263454.963961:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263455.983738:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263457.007914:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788263457.327758:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788263457.327764:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788263457.327767:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788263457.327770:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788263457.327796:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788263457.327799:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788263457.327802:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788263457.327805:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788263457.327847:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709820160:0@lo:400:kworker.0 00000100:00100000:0.0:1788263457.327913:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263457.327964:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875129709820672:0@lo:400:kworker.0 00000100:00100000:0.0:1788263457.327989:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263457.328012:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788263457.328018:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fb36e90-c209-4884-91f2-1155be4ad295:3621:1875129709820032:0@lo:400:kworker.0 00000100:00100000:0.0:1788263457.328046:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263457.328070:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875129709820544:0@lo:400:kworker.0 00000100:00100000:0.0:1788263457.328095:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263457.328136:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709820288:0@lo:400:kworker.0 00000100:00100000:0.0:1788263457.328161:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263457.328193:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709820800:0@lo:400:kworker.0 00000100:00100000:0.0:1788263457.328214:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263457.328229:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263457.328234:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709820416:0@lo:400:kworker.0 00000100:00100000:0.0:1788263457.328250:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263457.328278:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709820160 00000100:00100000:0.0:1788263457.328287:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709820160 00000100:00100000:0.0:1788263457.328329:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709820416 00000100:00100000:0.0:1788263457.328332:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709820416 00000100:00100000:0.0:1788263457.328347:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788263457.328354:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709820160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263457.328407:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709820160:12345-0@lo:400:kworker.0 Request processed in 51us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263457.328414:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788263457.328428:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788263457.328433:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709820416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263457.328460:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709820416:12345-0@lo:400:kworker.0 Request processed in 27us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263457.328466:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788263457.328482:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709820672 00000100:00100000:0.0:1788263457.328485:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709820672 00000100:00100000:0.0:1788263457.328510:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709820544 00000100:00100000:0.0:1788263457.328512:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709820544 00000100:00100000:0.0:1788263457.328522:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709820288 00000100:00100000:0.0:1788263457.328524:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709820288 00000100:00100000:0.0:1788263457.328533:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709820800 00000100:00100000:0.0:1788263457.328542:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709820800 00000100:00100000:0.0:1788263457.328561:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788263457.328601:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875129709820672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263457.328631:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875129709820672:12345-0@lo:400:kworker.0 Request processed in 54us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263457.328637:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788263457.328648:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788263457.328654:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875129709820544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263457.328680:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875129709820544:12345-0@lo:400:kworker.0 Request processed in 26us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263457.328685:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788263457.328695:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788263457.328700:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709820288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263457.328725:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709820288:12345-0@lo:400:kworker.0 Request processed in 24us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263457.328729:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788263457.328739:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788263457.328744:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709820800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263457.328768:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709820800:12345-0@lo:400:kworker.0 Request processed in 24us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263457.328773:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788263457.328789:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709820032 00000100:00100000:0.0:1788263457.328793:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709820032 00000100:00100000:0.0:1788263457.328818:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788263457.328824:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+21:3621:x1875129709820032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263457.328850:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+21:3621:x1875129709820032:12345-0@lo:400:kworker.0 Request processed in 27us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263457.328863:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788263457.328925:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709820416:0@lo:400:kworker.0 00010000:00080000:0.0:1788263457.328939:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff283324a80 x1875129709820288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263457.328949:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709820288:0@lo:400:kworker.0 00010000:00080000:0.0:1788263457.328959:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff283326a00 x1875129709820800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263457.328968:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709820800:0@lo:400:kworker.0 00000100:00100000:0.0:1788263457.328998:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fb36e90-c209-4884-91f2-1155be4ad295:3621:1875129709820032:0@lo:400:kworker.0 00010000:00080000:0.0:1788263457.329009:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff283326300 x1875129709820544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263457.329016:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875129709820544:0@lo:400:kworker.0 00000100:00100000:0.0:1788263457.329026:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709820160:0@lo:400:kworker.0 00010000:00080000:0.0:1788263457.329033:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff283327b80 x1875129709820672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263457.329040:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283327b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1875129709820672:0@lo:400:kworker.0 00000100:00080000:2.0:1788263457.329220:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788263457.329224:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1788263457.972854:0:18936:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788263458.037282:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788263458.291510:0:17101:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788263458.352196:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788263458.352220:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398661f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709820928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788263458.354443:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263458.354502:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709821056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788263458.354529:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263458.354655:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709820928 00000100:00100000:2.0:1788263458.354663:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709820928 00000100:00100000:2.0:1788263458.354703:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709821056 00000100:00100000:2.0:1788263458.354705:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709821056 00000100:00100000:2.0:1788263458.354720:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788263458.354729:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709820928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788263458.354764:0:17071:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788263458.354820:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709820928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263458.354826:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788263458.354843:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788263458.354849:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709821056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788263458.354864:0:17071:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788263458.354892:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709821056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 44us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263458.354898:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788263458.354981:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398661f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709820928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788263458.355009:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709821056:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1788263458.889603:0:18988:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788263458.892912:0:18988:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788263459.059426:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788263459.248926:0:17817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1788263459.904479:0:19038:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788263459.904908:0:19038:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788263460.083969:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263461.105730:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263462.127803:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263462.322637:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263447/real 1788263447] req@ffff9ff283989880 x1875129709813248/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263462 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263462.322673:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ff283989880 x1875129709813248/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263462 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263462.322683:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263447/real 1788263447] req@ffff9ff283989c00 x1875129709813376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263462 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263462.322707:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ff283989c00 x1875129709813376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263462 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788263462.322730:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff39ab18800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788263462.322755:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788263462.322759:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709813248:0@lo:8:kworker.0 00000100:00080000:2.0:1788263462.322765:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3bc483800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788263462.322770:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788263462.322773:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709813376:0@lo:8:kworker.0 00000100:00080000:3.0:1788263462.324102:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788263462.324108:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788263462.324110:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788263462.324112:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788263462.324146:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788263462.324149:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788263462.324152:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ff39ab18800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788263462.324159:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 456 00000100:00080000:3.0:1788263462.324165:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788263462.324170:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ff39ab18800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788263462.324191:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff398663480 x1875129709821696/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788263462.324200:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788263462.324202:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788263462.324204:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ff3bc483800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788263462.324207:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 456 00000100:00080000:3.0:1788263462.324210:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788263462.324213:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ff3bc483800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788263462.324226:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff398662d80 x1875129709821824/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788263462.324525:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fb36e90-c209-4884-91f2-1155be4ad295:3620:1875129709821184:0@lo:400:kworker.0 00000100:00100000:2.0:1788263462.324623:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263462.324669:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709821952:0@lo:400:kworker.0 00000100:00100000:2.0:1788263462.324696:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263462.324721:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788263462.324727:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709821312:0@lo:400:kworker.0 00000100:00100000:2.0:1788263462.324749:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263462.324764:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709822080:0@lo:400:kworker.0 00000100:00100000:2.0:1788263462.324787:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263462.324827:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709821184 00000100:00100000:2.0:1788263462.324835:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709821184 00000100:00100000:2.0:1788263462.324880:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788263462.324889:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+21:3620:x1875129709821184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263462.324933:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+21:3620:x1875129709821184:12345-0@lo:400:kworker.0 Request processed in 45us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263462.324951:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788263462.324990:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709821952 00000100:00100000:2.0:1788263462.324994:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709821952 00000100:00100000:2.0:1788263462.325017:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709822080 00000100:00100000:2.0:1788263462.325019:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709822080 00000100:00100000:2.0:1788263462.325046:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788263462.325052:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709821952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263462.325093:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709821952:12345-0@lo:400:kworker.0 Request processed in 42us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263462.325097:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788263462.325106:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788263462.325110:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709822080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263462.325143:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709822080:12345-0@lo:400:kworker.0 Request processed in 33us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263462.325150:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788263462.325169:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709821312 00000100:00100000:2.0:1788263462.325172:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709821312 00000100:00100000:2.0:1788263462.325194:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788263462.325201:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709821312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263462.325232:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5473b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709821312:12345-0@lo:400:kworker.0 Request processed in 32us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263462.325237:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788263462.325261:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263462.325304:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709821312:0@lo:400:kworker.0 00010000:00080000:2.0:1788263462.325322:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff398661c00 x1875129709822080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263462.325345:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709822080:0@lo:400:kworker.0 00000100:00100000:2.0:1788263462.325356:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fb36e90-c209-4884-91f2-1155be4ad295:3620:1875129709821184:0@lo:400:kworker.0 00000100:00100000:3.0:1788263462.325364:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709821440:0@lo:400:kworker.0 00010000:00080000:2.0:1788263462.325366:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff398660a80 x1875129709821952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263462.325373:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709821952:0@lo:400:kworker.0 00000100:00100000:3.0:1788263462.325396:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263462.325404:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709821696:0@lo:8:kworker.0 00000100:00100000:3.0:1788263462.325428:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709822208:0@lo:400:kworker.0 00000100:00100000:2.0:1788263462.325435:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263462.325449:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263462.325452:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709821824:0@lo:8:kworker.0 00000100:00100000:3.0:1788263462.325465:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788263462.325471:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709821568:0@lo:400:kworker.0 00000100:00100000:2.0:1788263462.325473:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263462.325492:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263462.325519:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709821696 00000100:00100000:3.0:1788263462.325528:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709821696 00000100:00100000:3.0:1788263462.325554:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709821824 00000100:00100000:3.0:1788263462.325557:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709821824 00000100:00100000:3.0:1788263462.325566:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788263462.325571:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5470a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3617:x1875129709821696:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788263462.325623:0:18572:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:3.0:1788263462.325653:0:18572:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b1103cba6670760 00002000:00100000:3.0:1788263462.325669:0:18572:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9ff282c75800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788263462.325673:0:18572:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788263462.325676:0:18572:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788263462.325841:0:18572:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788263462.325874:0:18572:0:(import.c:65:import_set_state_nolock()) ffff9ff282c70000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788263462.325913:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5470a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1875129709821696:12345-0@lo:8:kworker.0 Request processed in 341us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263462.325919:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788263462.325932:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788263462.325935:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5472300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3617:x1875129709821824:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788263462.325946:0:18572:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1788263462.326241:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff398663480 x1875129709821696/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788263482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263462.326251:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788263462.326257:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788263462.326263:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788263462.326269:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788263462.326271:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff39ab18800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788263462.326294:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788263462.326299:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709821696:0@lo:8:kworker.0 00000004:00080000:2.0:1788263462.326343:0:17807:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788263462.326362:0:17807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17807:1875129709822464:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1788263462.326390:0:17807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263462.326405:0:17807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39064bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263462.326425:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263462.326434:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709822336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788263462.326460:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263462.326490:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709822336 00000100:00100000:2.0:1788263462.326494:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709822336 00000100:00100000:2.0:1788263462.326541:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788263462.326550:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1875129709822336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788263462.326572:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788263462.326630:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1875129709822336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263462.326636:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788263462.326651:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263462.326664:0:18574:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788263462.326670:0:18574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:2.0:1788263462.326763:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3b5471f80 x1875129709822336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263462.326778:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709822336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788263462.326997:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709822464 00000100:00100000:2.0:1788263462.327001:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709822464 00000100:00100000:2.0:1788263462.327224:0:19151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788263462.327232:0:19151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17807:x1875129709822464:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788263462.328997:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709821568 00000100:00100000:1.0:1788263462.329007:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709821568 00000100:00100000:1.0:1788263462.329050:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788263462.329059:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709821568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263462.329154:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709821568:12345-0@lo:400:kworker.0 Request processed in 96us (3660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263462.329161:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788263462.329217:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709821568:0@lo:400:kworker.0 00000100:00100000:1.0:1788263462.330743:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709821440 00000100:00100000:1.0:1788263462.330754:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709821440 00000100:00100000:1.0:1788263462.330806:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709822208 00000100:00100000:1.0:1788263462.330810:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709822208 00000100:00100000:1.0:1788263462.330844:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788263462.330852:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709821440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263462.330953:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709821440:12345-0@lo:400:kworker.0 Request processed in 102us (5556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263462.330961:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788263462.330976:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788263462.331695:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709822208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263462.331742:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709822208:12345-0@lo:400:kworker.0 Request processed in 761us (6292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263462.331748:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1788263462.331769:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788263462.331805:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff398662300 x1875129709821440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263462.331820:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709821440:0@lo:400:kworker.0 00010000:00080000:1.0:1788263462.331838:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff398660700 x1875129709822208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263478 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263462.331848:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709822208:0@lo:400:kworker.0 00002000:00080000:2.0:1788263462.333252:0:19151:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788263462.333260:0:19151:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788263462.333335:0:19151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17807:x1875129709822464:12345-0@lo:7:osp-pre-0-1.0 Request processed in 6102us (6942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263462.333344:0:19151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788263462.333386:0:17807:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff3b5471880 x1875129709822464/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788263478 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263462.333411:0:17807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17807:1875129709822464:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1788263462.333425:0:17807:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788263462.333460:0:17807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283989880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17807:1875129709822592:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788263462.333491:0:17807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263462.333511:0:17807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39064bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263462.333528:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709822592 00000100:00100000:2.0:1788263462.333620:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709822592 00000100:00100000:2.0:1788263462.333662:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788263462.333671:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17807:x1875129709822592:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788263462.333693:0:18574:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1788263462.333723:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17807:x1875129709822592:12345-0@lo:5:osp-pre-0-1.0 Request processed in 54us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263462.333729:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788263462.333753:0:17807:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff283989880 x1875129709822592/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788263478 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263462.333762:0:17807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283989880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17807:1875129709822592:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788263462.333769:0:17807:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788263462.333791:0:17807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283989880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17807:1875129709822720:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788263462.333811:0:17807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263462.333824:0:17807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39064bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263462.333834:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709822720 00000100:00100000:2.0:1788263462.333837:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709822720 00000100:00100000:2.0:1788263462.333853:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788263462.333859:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17807:x1875129709822720:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788263462.333887:0:18574:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:1.0:1788263462.334649:0:17806:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788263462.334727:0:17806:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 471406147170ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788263462.334733:0:17806:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1788263462.338672:0:17798:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788263462.355516:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5472300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3617:x1875129709821824:12345-0@lo:8:kworker.0 Request processed in 29573us (30035us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788263462.355540:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788263462.355714:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3bc483800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788263462.355721:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788263462.355725:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709821824:0@lo:8:kworker.0 00000001:00080000:3.0:1788263462.361782:0:18568:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788263462.361797:0:18568:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788263462.362082:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17807:x1875129709822720:12345-0@lo:5:osp-pre-0-1.0 Request processed in 28219us (28265us total) trans 8589934593 rc 0/0 00010000:00080000:2.0:1788263462.362245:0:17807:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff283989880 x1875129709822720/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788263478 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263462.362257:0:17807:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788263462.362264:0:17807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283989880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17807:1875129709822720:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788263462.362290:0:17807:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1788263462.362343:0:17807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283989880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17807:1875129709822848:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788263462.362377:0:17807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263462.362443:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788263462.362506:0:17807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff39064bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788263462.362550:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709822848 00000100:00100000:3.0:1788263462.362556:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709822848 00000100:00100000:3.0:1788263462.362780:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788263462.362797:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28398b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17807:x1875129709822848:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788263462.362855:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28398b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17807:x1875129709822848:12345-0@lo:900:osp-pre-0-1.0 Request processed in 61us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263462.362862:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788263462.362908:0:17807:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ff283989880 x1875129709822848/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788263478 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263462.362919:0:17807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283989880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17807:1875129709822848:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1788263463.154167:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263463.472344:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788263463.472505:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709823104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788263463.472573:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263463.473022:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709822976:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788263463.473090:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263463.479304:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709823104 00000100:00100000:2.0:1788263463.479317:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709823104 00000100:00100000:2.0:1788263463.479368:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709822976 00000100:00100000:2.0:1788263463.479370:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709822976 00000100:00100000:2.0:1788263463.479389:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788263463.479399:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709823104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788263463.479433:0:17070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788263463.479510:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709823104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (6937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263463.479533:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788263463.479549:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788263463.479555:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709822976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788263463.479570:0:17070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788263463.479618:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709822976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (6528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263463.479624:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788263463.480848:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709823104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788263463.480867:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709822976:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788263464.177256:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263465.200218:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263466.224640:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788263466.981301:0:19384:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788263466.981304:0:19384:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788263466.981306:0:19384:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788263466.981465:0:19384:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ff3bc204800 00000020:01000004:2.0:1788263466.981481:0:19384:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788263466.981509:0:19384:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788263466.981524:0:19384:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ff3ad8e8000) 00000020:00000080:2.0:1788263466.981541:0:19384:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788263467.136005:0:19384:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788263467.136964:0:19384:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788263467.137165:0:19384:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788263467.137366:0:19384:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788263467.137931:0:19384:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788263467.138342:0:19384:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788263467.138665:0:19384:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:2.0:1788263467.142914:0:19384:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788263467.144283:0:19384:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788263467.144300:0:19384:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788263467.144315:0:19384:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4b1103cba667076e 00000020:01000004:2.0:1788263467.144322:0:19384:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788263467.144343:0:19384:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.126@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788263467.144346:0:19384:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788263467.144351:0:19384:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788263467.144380:0:19384:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788263467.144385:0:19384:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.126@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788263467.159324:0:19384:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788263467.159376:0:19384:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.126@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788263467.159380:0:19384:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788263467.159382:0:19384:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788263467.159383:0:19384:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263467.159384:0:19384:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263467.159385:0:19384:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263467.159387:0:19384:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263467.159388:0:19384:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788263467.159390:0:19384:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263467.159391:0:19384:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788263467.159394:0:19384:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788263467.159396:0:19384:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788263467.159397:0:19384:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788263467.159398:0:19384:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263467.159399:0:19384:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263467.159400:0:19384:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263467.159401:0:19384:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263467.159402:0:19384:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788263467.159403:0:19384:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263467.159404:0:19384:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788263467.159431:0:19384:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788263467.159451:0:19384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283989880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709823232:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788263467.159522:0:19384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263467.159565:0:19384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a05bca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263467.159994:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709823232 00000100:00100000:0.0:1788263467.160002:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709823232 00000100:00100000:0.0:1788263467.160054:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788263467.160064:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+21:19384:x1875129709823232:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788263467.160105:0:17059:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788263467.160108:0:17059:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788263467.160112:0:17059:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788263467.160537:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+21:19384:x1875129709823232:12345-0@lo:253:mount.lustre.0 Request processed in 473us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263467.160545:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788263467.160714:0:19384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283989880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709823232:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788263467.160724:0:19384:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788263467.160727:0:19384:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788263467.160728:0:19384:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788263467.160730:0:19384:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263467.160731:0:19384:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263467.160732:0:19384:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263467.160733:0:19384:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263467.160735:0:19384:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788263467.160736:0:19384:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263467.160737:0:19384:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788263467.160754:0:19384:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ff3bc204800 from lustre-OST0001 10000000:01000000:2.0:1788263467.160779:0:19384:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788263467.160792:0:19384:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788263467.160801:0:19384:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ff3af7e19b8 local copy 00010000:00010000:2.0:1788263467.160812:0:19384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0600/0x4b1103cba6670488 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667048f expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263467.160896:0:19384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283989880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709823360:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263467.160925:0:19384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263467.160957:0:19384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff383968600 going to sleep for 11 seconds 00000100:00100000:0.0:1788263467.161006:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709823360 00000100:00100000:0.0:1788263467.161010:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709823360 00000100:00100000:0.0:1788263467.161042:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788263467.161049:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+21:19384:x1875129709823360:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263467.161132:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+21:19384:x1875129709823360:12345-0@lo:501:mount.lustre.0 Request processed in 83us (205us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788263467.161139:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788263467.161221:0:19384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283989880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709823360:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788263467.161233:0:19384:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788263467.161264:0:19384:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788263467.161271:0:19384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0600/0x4b1103cba6670488 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667048f expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.161280:0:19384:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0600/0x4b1103cba6670488 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667048f expref: -99 pid: 17044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263467.161303:0:19384:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ff3bc204800 10000000:01000000:3.0:1788263467.161307:0:19384:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788263467.161312:0:19384:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788263467.161315:0:19384:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788263467.161319:0:19384:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788263467.161321:0:19384:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788263467.161340:0:19384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff38150e600/0x4b1103cba6670775 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.161348:0:19384:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff38150e600/0x4b1103cba6670775 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.161357:0:19384:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff38150e600/0x4b1103cba6670775 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263467.161382:0:19384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398661880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709823488:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788263467.161408:0:19384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263467.161432:0:19384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3fdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263467.161600:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709823488 00000100:00100000:0.0:1788263467.161610:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709823488 00000100:00100000:0.0:1788263467.161643:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788263467.161650:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+21:19384:x1875129709823488:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788263467.161658:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263467.161671:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff283b69600/0x4b1103cba667077c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba6670775 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263467.161690:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff283b69600/0x4b1103cba667077c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba6670775 expref: 22 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263467.161700:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff283b69600/0x4b1103cba667077c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670775 expref: 22 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263467.161710:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b69600, rc 0) 00000100:00100000:0.0:1788263467.161748:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+22:19384:x1875129709823488:12345-0@lo:101:mount.lustre.0 Request processed in 99us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263467.161754:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788263467.161967:0:19384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398661880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709823488:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788263467.161979:0:19384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff38150e600/0x4b1103cba6670775 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667077c expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.161988:0:19384:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff38150e600/0x4b1103cba6670775 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba667077c expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788263467.163021:0:19384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788263467.163806:0:19384:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788263467.167519:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788263467.167571:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788263467.167888:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788263467.167906:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788263467.167921:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788263467.167934:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788263467.167959:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788263467.167965:0:19384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788263467.168514:0:19384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398661880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709823616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788263467.168672:0:19384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263467.168758:0:19384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3fd540 going to sleep for 11 seconds 00000100:00100000:0.0:1788263467.173708:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709823616 00000100:00100000:0.0:1788263467.173725:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709823616 00000100:00100000:0.0:1788263467.173779:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788263467.173788:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+22:19384:x1875129709823616:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263467.174021:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+22:19384:x1875129709823616:12345-0@lo:501:mount.lustre.0 Request processed in 234us (5348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263467.174029:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788263467.175049:0:19384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398661880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709823616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788263467.175111:0:19384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398661880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709823744:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788263467.175167:0:19384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263467.175210:0:19384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3fd540 going to sleep for 11 seconds 00000100:00100000:2.0:1788263467.175280:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709823744 00000100:00100000:2.0:1788263467.175285:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709823744 00000100:00100000:2.0:1788263467.175317:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788263467.175326:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+22:19384:x1875129709823744:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788263467.176125:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+22:19384:x1875129709823744:12345-0@lo:503:mount.lustre.0 Request processed in 799us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263467.176134:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788263467.176973:0:19384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398661880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709823744:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788263467.177500:0:19384:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788263467.177644:0:19384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398661880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709823872:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788263467.177704:0:19384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263467.177787:0:19384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3fdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263467.177908:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709823872 00000100:00100000:1.0:1788263467.177915:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709823872 00000100:00100000:1.0:1788263467.177986:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788263467.177996:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+22:19384:x1875129709823872:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788263467.182977:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+22:19384:x1875129709823872:12345-0@lo:502:mount.lustre.0 Request processed in 4975us (5264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263467.182990:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788263467.183097:0:19384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398661880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709823872:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788263467.183318:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788263467.183348:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788263467.183361:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788263467.183375:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788263467.183388:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788263467.183400:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788263467.183413:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788263467.183427:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788263467.183454:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788263467.183486:0:19384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398661880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709824000:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788263467.183530:0:19384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263467.183562:0:19384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3fdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263467.183788:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709824000 00000100:00100000:1.0:1788263467.183795:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709824000 00000100:00100000:1.0:1788263467.183826:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788263467.183835:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+22:19384:x1875129709824000:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788263467.183921:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+22:19384:x1875129709824000:12345-0@lo:502:mount.lustre.0 Request processed in 87us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263467.183928:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788263467.184335:0:19384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398661880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709824000:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788263467.184378:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788263467.184387:0:19384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1788263467.185311:0:19388:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788263467.185319:0:19388:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788263467.185324:0:19388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263467.185326:0:19388:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788263467.185331:0:19388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788263467.185343:0:19388:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ff3aec299b8) 00000020:00000080:1.0:1788263467.185364:0:19388:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788263467.185370:0:19388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788263467.185499:0:19388:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ff3bc204800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788263467.185509:0:19388:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788263467.185516:0:19388:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4b1103cba667078a 00010000:00010000:1.0:1788263467.195512:0:19388:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1788263467.198484:0:19388:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1788263467.200332:0:19388:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1788263467.203375:0:19388:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788263467.203388:0:19388:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263467.203394:0:19388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263467.203397:0:19388:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788263467.203400:0:19388:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788263467.203404:0:19388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263467.203405:0:19388:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788263467.203408:0:19388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788263467.203411:0:19388:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788263467.203414:0:19388:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263467.203416:0:19388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263467.203417:0:19388:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788263467.203420:0:19388:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788263467.203422:0:19388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263467.203423:0:19388:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788263467.203426:0:19388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788263467.203468:0:19388:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263467.203472:0:19388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263467.203473:0:19388:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788263467.203476:0:19388:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788263467.203986:0:19384:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788263467.204016:0:19384:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788263467.204032:0:19384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff38150e600/0x4b1103cba6670775 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667077c expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.204044:0:19384:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff38150e600/0x4b1103cba6670775 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba667077c expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263467.204066:0:19384:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff3bc204800 from 1 10000000:01000000:3.0:1788263467.204069:0:19384:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788263467.204115:0:19384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba6670791 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.204123:0:19384:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba6670791 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.204134:0:19384:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba6670791 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263467.204156:0:19384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398661880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709824128:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788263467.204215:0:19384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263467.204262:0:19384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3fd000 going to sleep for 11 seconds 00000100:00100000:1.0:1788263467.206253:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709824128 00000100:00100000:1.0:1788263467.206266:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709824128 00000100:00100000:1.0:1788263467.206323:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788263467.206331:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+22:19384:x1875129709824128:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788263467.206346:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263467.206363:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff381681a00/0x4b1103cba6670798 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba6670791 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.206398:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff381681a00/0x4b1103cba6670798 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba6670791 expref: 23 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.206409:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff381681a00/0x4b1103cba6670798 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670791 expref: 23 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.206419:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381681a00, rc 0) 00000100:00100000:1.0:1788263467.206498:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+23:19384:x1875129709824128:12345-0@lo:101:mount.lustre.0 Request processed in 167us (2282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263467.206505:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788263467.206672:0:19384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398661880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709824128:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788263467.206689:0:19384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba6670791 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670798 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.206698:0:19384:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba6670791 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba6670798 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788263467.209175:0:19384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788263467.209963:0:19384:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788263467.210219:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788263467.210258:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788263467.210279:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788263467.210284:0:19384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788263467.210359:0:19384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709824256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263467.210421:0:19384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263467.210474:0:19384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2831a6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788263467.211631:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709824256 00000100:00100000:0.0:1788263467.211641:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709824256 00000100:00100000:0.0:1788263467.211690:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788263467.211700:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+23:19384:x1875129709824256:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263467.211836:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+23:19384:x1875129709824256:12345-0@lo:501:mount.lustre.0 Request processed in 139us (1415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263467.211844:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788263467.212820:0:19384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709824256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263467.212872:0:19384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709824384:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788263467.212929:0:19384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263467.212966:0:19384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2831a6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788263467.213021:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709824384 00000100:00100000:0.0:1788263467.213027:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709824384 00000100:00100000:0.0:1788263467.213068:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788263467.213076:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+23:19384:x1875129709824384:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788263467.213177:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+23:19384:x1875129709824384:12345-0@lo:503:mount.lustre.0 Request processed in 101us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263467.213184:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788263467.213334:0:19384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709824384:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788263467.213724:0:19384:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788263467.213786:0:19384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709824512:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788263467.213821:0:19384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263467.213894:0:19384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bc67b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263467.217009:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709824512 00000100:00100000:0.0:1788263467.217022:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709824512 00000100:00100000:0.0:1788263467.217078:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788263467.217096:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+23:19384:x1875129709824512:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788263467.217278:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+23:19384:x1875129709824512:12345-0@lo:502:mount.lustre.0 Request processed in 182us (3455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263467.217285:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788263467.217468:0:19384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709824512:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788263467.217725:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788263467.217758:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788263467.217776:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788263467.217791:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788263467.217805:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788263467.217819:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788263467.217834:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788263467.217865:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1788263467.217881:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788263467.217897:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1788263467.217909:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1788263467.217940:0:19384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709824640:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788263467.217987:0:19384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263467.218015:0:19384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bc67b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263467.218099:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709824640 00000100:00100000:1.0:1788263467.218105:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709824640 00000100:00100000:1.0:1788263467.218139:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788263467.218148:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+23:19384:x1875129709824640:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788263467.218255:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+23:19384:x1875129709824640:12345-0@lo:502:mount.lustre.0 Request processed in 97us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263467.218262:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788263467.218428:0:19384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709824640:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788263467.218464:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788263467.218472:0:19384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788263467.219383:0:19392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263467.219393:0:19392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263467.219395:0:19392:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788263467.219401:0:19392:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ff3bc204800 00000020:00000080:2.0:1788263467.219410:0:19392:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788263467.219417:0:19392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263467.219420:0:19392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263467.219421:0:19392:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788263467.219423:0:19392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263467.219426:0:19392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263467.219427:0:19392:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788263467.219430:0:19392:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ff3bc204800 00000020:00000080:2.0:1788263467.219432:0:19392:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788263467.219530:0:19392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263467.219534:0:19392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263467.219535:0:19392:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788263467.219538:0:19392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263467.219541:0:19392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263467.219542:0:19392:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788263467.219546:0:19392:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ff3bc204800 00000020:00000080:2.0:1788263467.219548:0:19392:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788263467.227491:0:19392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263467.227504:0:19392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263467.227506:0:19392:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788263467.227510:0:19392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263467.227515:0:19392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263467.227516:0:19392:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788263467.227521:0:19392:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ff3bc204800 00000020:00000080:2.0:1788263467.227523:0:19392:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788263467.227651:0:19392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263467.227656:0:19392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263467.227658:0:19392:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788263467.227685:0:19392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1788263467.227882:0:19384:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788263467.227916:0:19384:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788263467.227938:0:19384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba6670791 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670798 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.227950:0:19384:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba6670791 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670798 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263467.228020:0:19384:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788263467.228023:0:19384:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ff3bc204800 10000000:01000000:3.0:1788263467.228025:0:19384:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ff3bc204800 10000000:01000000:3.0:1788263467.228029:0:19384:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788263467.228034:0:19384:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ff3bc204800 from 1 10000000:01000000:3.0:1788263467.228037:0:19384:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788263467.228070:0:19384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff38150f600/0x4b1103cba667079f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.228089:0:19384:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff38150f600/0x4b1103cba667079f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.228101:0:19384:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff38150f600/0x4b1103cba667079f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263467.228126:0:19384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398661880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709824768:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788263467.228193:0:19384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263467.228235:0:19384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3fd480 going to sleep for 11 seconds 00000100:00100000:3.0:1788263467.228282:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709824768 00000100:00100000:3.0:1788263467.228289:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709824768 00000100:00100000:3.0:1788263467.228330:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788263467.228340:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+23:19384:x1875129709824768:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788263467.228351:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263467.228364:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3ae764800/0x4b1103cba66707a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba667079f expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.228388:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3ae764800/0x4b1103cba66707a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba667079f expref: 24 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.228412:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3ae764800/0x4b1103cba66707a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba667079f expref: 24 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.228420:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae764800, rc 0) 00000100:00100000:3.0:1788263467.228460:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+24:19384:x1875129709824768:12345-0@lo:101:mount.lustre.0 Request processed in 121us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263467.228467:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788263467.228517:0:19384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398661880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709824768:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788263467.228530:0:19384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff38150f600/0x4b1103cba667079f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66707a6 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.228539:0:19384:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff38150f600/0x4b1103cba667079f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba66707a6 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788263467.248632:0:19384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1788263467.249081:0:19384:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788263467.249283:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788263467.249308:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788263467.249332:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788263467.249344:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788263467.249356:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788263467.249366:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788263467.249379:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788263467.249392:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788263467.249404:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788263467.249417:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788263467.249429:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788263467.249659:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788263467.249676:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788263467.249691:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788263467.249706:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788263467.249719:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788263467.249731:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788263467.249761:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788263467.249778:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788263467.249791:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788263467.249802:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788263467.249816:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788263467.249830:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788263467.249842:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788263467.249854:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788263467.249869:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788263467.251138:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788263467.251166:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788263467.251178:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788263467.251189:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1788263467.251200:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1788263467.251212:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1788263467.251223:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1788263467.251268:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1788263467.251282:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1788263467.251302:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1788263467.251312:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1788263467.251323:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1788263467.251332:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1788263467.251342:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1788263467.251353:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1788263467.251363:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1788263467.251374:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1788263467.251385:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1788263467.251397:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1788263467.251409:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1788263467.251432:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1788263467.251438:0:19384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1788263467.251543:0:19384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709824896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263467.251619:0:19384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263467.251664:0:19384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bc67bb40 going to sleep for 11 seconds 00010000:00010000:3.0:1788263467.252175:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263467.252636:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709824896 00000100:00100000:2.0:1788263467.252645:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709824896 00000100:00100000:2.0:1788263467.252693:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788263467.252702:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+24:19384:x1875129709824896:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263467.252834:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+24:19384:x1875129709824896:12345-0@lo:501:mount.lustre.0 Request processed in 133us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263467.252842:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788263467.253020:0:19384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709824896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263467.253060:0:19384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709825024:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788263467.253102:0:19384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263467.253116:0:19384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bc67bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788263467.253212:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709825024 00000100:00100000:3.0:1788263467.253217:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709825024 00000100:00100000:3.0:1788263467.253275:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788263467.253283:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+24:19384:x1875129709825024:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788263467.253358:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+24:19384:x1875129709825024:12345-0@lo:503:mount.lustre.0 Request processed in 77us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263467.253365:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788263467.253714:0:19384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709825024:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788263467.254190:0:19384:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788263467.254273:0:19384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709825152:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788263467.254311:0:19384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263467.254386:0:19384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bc67bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788263467.256980:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709825152 00000100:00100000:3.0:1788263467.256994:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709825152 00000100:00100000:2.0:1788263467.259383:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788263467.259396:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+24:19384:x1875129709825152:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788263467.259836:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+24:19384:x1875129709825152:12345-0@lo:502:mount.lustre.0 Request processed in 442us (5524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263467.259844:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788263467.259961:0:19384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709825152:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788263467.260174:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788263467.260206:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788263467.260219:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788263467.260231:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788263467.260257:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788263467.260273:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788263467.260284:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788263467.260296:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788263467.260309:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788263467.260323:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788263467.260335:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788263467.260347:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788263467.260359:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788263467.260372:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788263467.260384:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788263467.260397:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788263467.260411:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788263467.260441:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788263467.260477:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788263467.260493:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788263467.260506:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788263467.260517:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788263467.261006:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788263467.261025:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788263467.261040:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788263467.261053:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788263467.261066:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788263467.261079:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788263467.261092:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788263467.261105:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788263467.261117:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788263467.261129:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788263467.261143:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788263467.261168:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788263467.261183:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788263467.261196:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788263467.261208:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788263467.261221:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788263467.261232:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788263467.261275:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788263467.261291:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788263467.261303:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788263467.261315:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788263467.261327:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788263467.261340:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788263467.261354:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788263467.261366:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788263467.261376:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788263467.261429:0:19384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709825280:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788263467.261998:0:19384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263467.262078:0:19384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bc67bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788263467.272836:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709825280 00000100:00100000:3.0:1788263467.272852:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709825280 00000100:00100000:2.0:1788263467.273151:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788263467.273161:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+24:19384:x1875129709825280:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788263467.273328:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+24:19384:x1875129709825280:12345-0@lo:502:mount.lustre.0 Request processed in 168us (11329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263467.273336:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788263467.273392:0:19384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709825280:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788263467.273617:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788263467.273644:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788263467.273675:0:19384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709825408:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788263467.273715:0:19384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263467.273739:0:19384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bc67bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788263467.274680:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709825408 00000100:00100000:3.0:1788263467.274694:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709825408 00000100:00100000:3.0:1788263467.274730:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788263467.274737:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+24:19384:x1875129709825408:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788263467.274837:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+24:19384:x1875129709825408:12345-0@lo:502:mount.lustre.0 Request processed in 100us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263467.274844:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788263467.276131:0:19384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709825408:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788263467.276204:0:19384:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788263467.276216:0:19384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788263467.278198:0:19398:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788263467.278214:0:19398:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ff3ad8ecd28) 00000020:00000080:2.0:1788263467.278237:0:19398:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1788263467.278319:0:19398:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ff3bc204800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788263467.278323:0:19398:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ff3bc204800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788263467.278325:0:19398:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ff3bc204800 3 00010000:00080000:2.0:1788263467.278355:0:19398:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ff282f62000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.126@tcp at head 00010000:00010000:2.0:1788263467.286160:0:19398:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1788263467.286347:0:19398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788263467.286390:0:19398:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788263467.286401:0:19398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4b1103cba66707b4 00000100:00080000:2.0:1788263467.286410:0:19398:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788263467.286420:0:19398:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ff282f62000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263467.286451:0:19398:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff283988380 x1875129709825536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788263467.286487:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875129709825536:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788263467.286572:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263467.286645:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709825536 00000100:00100000:2.0:1788263467.286651:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709825536 00000100:00100000:2.0:1788263467.286682:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788263467.286690:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875129709825536:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788263467.286710:0:17067:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:2.0:1788263467.286743:0:17067:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4b1103cba66707bb 00000004:00100000:2.0:1788263467.286758:0:17067:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788263467.286783:0:17067:0:(import.c:65:import_set_state_nolock()) ffff9ff282f64000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263467.286828:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875129709825536:12345-0@lo:38:llog_process_th.0 Request processed in 138us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263467.286835:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788263467.286868:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283988380 x1875129709825536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788263477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263467.288589:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788263467.288604:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788263467.288613:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788263467.288619:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788263467.288622:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff282f62000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788263467.288631:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3617:1875129709825536:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788263467.288665:0:19398:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788263467.288737:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788263467.288741:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788263467.288744:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788263467.288747:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788263467.288774:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788263467.288777:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788263467.288780:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ff3bc483800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788263467.288784:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 471 00000100:00080000:2.0:1788263467.288788:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788263467.288793:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ff3bc483800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263467.288808:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff398743100 x1875129709826176/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788263467.288848:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709825664:0@lo:400:kworker.0 00000100:00100000:2.0:1788263467.289836:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263467.289871:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398743b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709826304:0@lo:400:kworker.0 00000100:00100000:2.0:1788263467.289909:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263467.289934:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788263467.289939:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709825792:0@lo:400:kworker.0 00000100:00100000:2.0:1788263467.289958:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263467.289975:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398742680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709826432:0@lo:400:kworker.0 00000100:00100000:2.0:1788263467.289993:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263467.290022:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709825920:0@lo:400:kworker.0 00000100:00100000:2.0:1788263467.290043:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263467.290068:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709826560:0@lo:400:kworker.0 00000100:00100000:2.0:1788263467.290092:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263467.290109:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788263467.290114:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709826048:0@lo:400:kworker.0 00000100:00100000:2.0:1788263467.290135:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263467.290166:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709825664 00000100:00100000:2.0:1788263467.290172:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709825664 00000100:00100000:2.0:1788263467.290202:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709825920 00000100:00100000:2.0:1788263467.290205:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709825920 00000100:00100000:2.0:1788263467.290219:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788263467.290226:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709825664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263467.290285:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709825664:12345-0@lo:400:kworker.0 Request processed in 59us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263467.290291:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788263467.290305:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788263467.290310:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709825920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263467.290335:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709825920:12345-0@lo:400:kworker.0 Request processed in 25us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263467.290340:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788263467.290355:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709826304 00000100:00100000:2.0:1788263467.290357:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709826304 00000100:00100000:2.0:1788263467.290371:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709825792 00000100:00100000:2.0:1788263467.290373:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709825792 00000100:00100000:2.0:1788263467.290381:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709826432 00000100:00100000:2.0:1788263467.290383:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709826432 00000100:00100000:2.0:1788263467.290415:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709826560 00000100:00100000:2.0:1788263467.290418:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709826560 00000100:00100000:2.0:1788263467.290431:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788263467.290437:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709826304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263467.290485:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709826304:12345-0@lo:400:kworker.0 Request processed in 48us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263467.290491:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788263467.290503:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788263467.290509:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709825792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263467.291092:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709825792:12345-0@lo:400:kworker.0 Request processed in 581us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263467.291100:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788263467.291114:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788263467.291121:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709826432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263467.291149:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709826432:12345-0@lo:400:kworker.0 Request processed in 29us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263467.291155:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788263467.291165:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788263467.291171:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709826560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263467.291196:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709826560:12345-0@lo:400:kworker.0 Request processed in 26us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263467.291201:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788263467.291234:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709826048 00000100:00100000:2.0:1788263467.291238:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709826048 00000100:00100000:2.0:1788263467.291279:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788263467.291285:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398741180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709826048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263467.291312:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398741180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709826048:12345-0@lo:400:kworker.0 Request processed in 27us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263467.291317:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788263467.291336:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788263467.291340:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788263467.291342:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788263467.291371:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3b5471f80 x1875129709826048/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263467.291384:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709826048:0@lo:400:kworker.0 00000100:00100000:2.0:1788263467.291394:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709825920:0@lo:400:kworker.0 00010000:00080000:2.0:1788263467.291402:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff398740a80 x1875129709826560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263467.291409:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709826560:0@lo:400:kworker.0 00000100:00100000:2.0:1788263467.291438:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709826176:0@lo:8:kworker.0 00000100:00100000:2.0:1788263467.291464:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263467.291490:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709826176 00000100:00100000:2.0:1788263467.291493:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709826176 00000100:00100000:2.0:1788263467.291510:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788263467.291514:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3617:x1875129709826176:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788263467.292400:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3617:x1875129709826176:12345-0@lo:8:kworker.0 Request processed in 881us (932us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788263467.292408:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788263467.292422:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788263467.292428:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3bc483800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788263467.292432:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788263467.292435:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709826176:0@lo:8:kworker.0 00010000:00080000:2.0:1788263467.292440:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283989880 x1875129709825792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263467.292450:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709825792:0@lo:400:kworker.0 00010000:00080000:2.0:1788263467.294060:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff398742680 x1875129709826432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263467.294073:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398742680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709826432:0@lo:400:kworker.0 00000100:00100000:2.0:1788263467.294099:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709825664:0@lo:400:kworker.0 00010000:00080000:2.0:1788263467.294109:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff398743b80 x1875129709826304/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263467.294117:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398743b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709826304:0@lo:400:kworker.0 00000020:01000004:2.0:1788263467.294788:0:19398:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788263467.294801:0:19398:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9ff3ad8e99b8) 00000020:00000080:2.0:1788263467.294823:0:19398:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1788263467.294994:0:19398:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ff3bc204800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788263467.294998:0:19398:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ff3bc204800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788263467.295001:0:19398:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ff3bc204800 3 00010000:00080000:2.0:1788263467.295026:0:19398:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ff3bc672000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.126@tcp at head 00010000:00010000:2.0:1788263467.302804:0:19398:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1788263467.302989:0:19398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788263467.303032:0:19398:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788263467.303054:0:19398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x4b1103cba66707c9 00000100:00080000:2.0:1788263467.303064:0:19398:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788263467.303070:0:19398:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9ff3bc672000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788263467.303104:0:19398:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff398743b80 x1875129709826688/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788263467.303124:0:19398:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788263467.303162:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788263467.303167:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788263467.303170:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788263467.303172:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788263467.303393:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398743b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1875129709826688:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788263467.303607:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263467.303661:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709826688 00000100:00100000:2.0:1788263467.303668:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709826688 00000100:00100000:2.0:1788263467.303696:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788263467.303703:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3617:x1875129709826688:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788263467.303727:0:17066:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:2.0:1788263467.303757:0:17066:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x4b1103cba66707d0 00000004:00100000:2.0:1788263467.303771:0:17066:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788263467.303797:0:17066:0:(import.c:65:import_set_state_nolock()) ffff9ff28209b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263467.303844:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875129709826688:12345-0@lo:38:llog_process_th.0 Request processed in 140us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263467.303851:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788263467.304063:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff398743b80 x1875129709826688/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788263477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263467.304074:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788263467.304081:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788263467.304089:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788263467.304093:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788263467.304095:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3bc672000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788263467.304101:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398743b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3617:1875129709826688:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788263467.305220:0:19398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1788263467.305643:0:19384:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788263467.305675:0:19384:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788263467.305691:0:19384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff38150f600/0x4b1103cba667079f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66707a6 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.305703:0:19384:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff38150f600/0x4b1103cba667079f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66707a6 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788263467.305742:0:19384:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788263467.305745:0:19384:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788263467.305747:0:19384:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263467.305748:0:19384:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263467.305749:0:19384:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263467.305751:0:19384:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263467.305752:0:19384:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788263467.305754:0:19384:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263467.305755:0:19384:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788263467.305759:0:19384:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788263467.305761:0:19384:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788263467.305763:0:19384:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788263467.305764:0:19384:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263467.305768:0:19384:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263467.305769:0:19384:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263467.305770:0:19384:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263467.305771:0:19384:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788263467.305772:0:19384:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263467.305773:0:19384:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788263467.305791:0:19384:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788263467.305806:0:19384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398661880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709826816:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788263467.305855:0:19384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263467.306214:0:19384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff390d05a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263467.314454:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709826816 00000100:00100000:0.0:1788263467.314466:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709826816 00000100:00100000:0.0:1788263467.314531:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788263467.314541:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+24:19384:x1875129709826816:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788263467.314573:0:17058:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788263467.314689:0:17058:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788263467.325472:0:17058:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788263467.325492:0:17058:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788263467.325878:0:17081:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788263467.325883:0:17081:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788263467.325902:0:17081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ff381680600/0x4b1103cba66707d7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.325919:0:17081:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff283b68400/0x4b1103cba667074b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670744 expref: 24 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.325927:0:17081:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff38150e800/0x4b1103cba6670759 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670752 expref: 24 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.325947:0:17081:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ff381680600/0x4b1103cba66707d7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.325983:0:17081:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff38150e800/0x4b1103cba6670759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba6670752 expref: 24 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.325996:0:17081:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ff38150e800/0x4b1103cba6670759 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba6670752 expref: 24 pid: 17058 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263467.326009:0:17081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e1180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17081:1875129709826944:0@lo:104: 00000100:00100000:1.0:1788263467.326068:0:17081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788263467.326131:0:17081:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff283b68400/0x4b1103cba667074b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba6670744 expref: 24 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263467.326139:0:17081:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ff283b68400/0x4b1103cba667074b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba6670744 expref: 24 pid: 17058 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263467.326147:0:17081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17081:1875129709827072:0@lo:104: 00000100:00100000:1.0:1788263467.326168:0:17081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263467.326193:0:17081:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff385410900 going to sleep for 11 seconds 00000100:00100000:0.0:1788263467.326366:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709826944 00000100:00100000:0.0:1788263467.326373:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709826944 00000100:00100000:0.0:1788263467.326403:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709827072 00000100:00100000:0.0:1788263467.326412:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709827072 00000100:00100000:0.0:1788263467.326429:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788263467.326437:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fb36e90-c209-4884-91f2-1155be4ad295+4:17081:x1875129709826944:12345-0@lo:104: 00010000:00010000:0.0:1788263467.326448:0:17048:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1400/0x4b1103cba6670752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba6670759 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263467.326513:0:17048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788263467.326520:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fb36e90-c209-4884-91f2-1155be4ad295+4:17081:x1875129709826944:12345-0@lo:104: Request processed in 83us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263467.326527:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788263467.326543:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788263467.326549:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fb36e90-c209-4884-91f2-1155be4ad295+3:17081:x1875129709827072:12345-0@lo:104: 00010000:00010000:0.0:1788263467.326557:0:17048:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba667074b expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263467.326602:0:17048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788263467.326607:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fb36e90-c209-4884-91f2-1155be4ad295+3:17081:x1875129709827072:12345-0@lo:104: Request processed in 60us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263467.326613:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788263467.326749:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788263467.326756:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1400/0x4b1103cba6670752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba6670759 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.326763:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1400 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:3.0:1788263467.326766:0:17054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1400/0x4b1103cba6670752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba6670759 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.326774:0:17054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1400/0x4b1103cba6670752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba6670759 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263467.326781:0:17054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1400/0x4b1103cba6670752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba6670759 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263467.326787:0:17054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788263467.326824:0:17054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1400/0x4b1103cba6670752 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba6670759 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.326830:0:17054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263467.326845:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1400/0x4b1103cba6670752 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba6670759 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.326862:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1400/0x4b1103cba6670752 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba6670759 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.326872:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263467.326876:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba667074b expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.326881:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b68c00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:3.0:1788263467.326885:0:17054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670744 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba667074b expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.326891:0:17054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba667074b expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788263467.326896:0:17054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670744 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba667074b expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263467.326900:0:17054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788263467.326913:0:17054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670744 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba667074b expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.326918:0:17054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788263467.326929:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670744 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba667074b expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.326934:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff283b68c00/0x4b1103cba6670744 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba667074b expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263467.326946:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263467.326952:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263467.326954:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263467.327042:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+24:19384:x1875129709826816:12345-0@lo:253:mount.lustre.0 Request processed in 12503us (21186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263467.327051:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00010000:1.0:1788263467.327430:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263467.327647:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fb36e90-c209-4884-91f2-1155be4ad295:3621:1875129709827200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263467.327686:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263467.327713:0:19384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398661880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fb36e90-c209-4884-91f2-1155be4ad295:19384:1875129709826816:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788263467.327724:0:19384:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788263467.327727:0:19384:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788263467.327728:0:19384:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788263467.327729:0:19384:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263467.327731:0:19384:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263467.327732:0:19384:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263467.327733:0:19384:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263467.327734:0:19384:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788263467.327736:0:19384:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000100:00100000:2.0:1788263467.327736:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fb36e90-c209-4884-91f2-1155be4ad295:3618:1875129709827328:0@lo:103:ldlm_bl.0 00000020:01000004:3.0:1788263467.327738:0:19384:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788263467.327749:0:19384:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788263467.327757:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263467.327794:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709827200 00000100:00100000:2.0:1788263467.327805:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709827200 00010000:00010000:2.0:1788263467.327827:0:17052:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff38150e800/0x4b1103cba6670759 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba6670752 expref: 24 pid: 17058 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263467.327847:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709827328 00000100:00100000:2.0:1788263467.327850:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709827328 00010000:00010000:2.0:1788263467.327860:0:17052:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff283b68400/0x4b1103cba667074b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba6670744 expref: 25 pid: 17058 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263467.327871:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788263467.327876:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398743b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fb36e90-c209-4884-91f2-1155be4ad295+25:3621:x1875129709827200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788263467.327886:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263467.327891:0:17052:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff38150e800/0x4b1103cba6670759 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba6670752 expref: 25 pid: 17058 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.327902:0:17052:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff38150e800/0x4b1103cba6670759 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba6670752 expref: 25 pid: 17058 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.327917:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263467.327946:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398743b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fb36e90-c209-4884-91f2-1155be4ad295+25:3621:x1875129709827200:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263467.327952:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788263467.327966:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788263467.327972:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398740380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fb36e90-c209-4884-91f2-1155be4ad295+24:3618:x1875129709827328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788263467.327979:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263467.327983:0:17052:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff283b68400/0x4b1103cba667074b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba6670744 expref: 24 pid: 17058 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.327992:0:17052:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff283b68400/0x4b1103cba667074b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba6670744 expref: 24 pid: 17058 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.328015:0:17052:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ff381680600/0x4b1103cba66707d7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.328024:0:17052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff381680600/0x4b1103cba66707d7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788263467.328036:0:17052:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004289675s 00010000:00010000:2.0:1788263467.328041:0:17052:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff381680600/0x4b1103cba66707d7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.328048:0:17052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff381680600/0x4b1103cba66707d7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.328055:0:17052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ff381680600/0x4b1103cba66707d7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.328061:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ff381680600/0x4b1103cba66707d7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.328067:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381680600 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:2.0:1788263467.328071:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ff381680600/0x4b1103cba66707d7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.328078:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ff381680600/0x4b1103cba66707d7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.328087:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ff381680600/0x4b1103cba66707d7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263467.328096:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263467.328123:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398740380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fb36e90-c209-4884-91f2-1155be4ad295+24:3618:x1875129709827328:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263467.328135:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788263467.328164:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fb36e90-c209-4884-91f2-1155be4ad295:3618:1875129709827328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263467.328183:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fb36e90-c209-4884-91f2-1155be4ad295:3621:1875129709827200:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263467.340184:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff38150e800/0x4b1103cba6670759 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba6670752 expref: 23 pid: 17058 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263467.340206:0:17081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e1180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17081:1875129709826944:0@lo:104: 00010000:00010000:0.0:1788263467.340217:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff283b68400/0x4b1103cba667074b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba6670744 expref: 22 pid: 17058 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263467.340256:0:17081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17081:1875129709827072:0@lo:104: 00010000:00010000:0.0:1788263467.340280:0:17081:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ff381680600/0x4b1103cba66707d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263467.340291:0:17081:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ff381680600/0x4b1103cba66707d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263467.340296:0:17081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ff381680600/0x4b1103cba66707d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263467.340303:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff381680600/0x4b1103cba66707d7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1788263467.349268:0:19384:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788263467.353518:0:19384:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788263467.353528:0:19384:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788263467.353572:0:19384:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788263467.353635:0:19384:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.126@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788263467.353652:0:19384:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788263467.353681:0:19384:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788263467.357386:0:19384:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788263467.357660:0:19384:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788263467.574066:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788263467.574097:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709827456:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788263467.574174:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263467.574556:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709827456 00000100:00100000:1.0:1788263467.574643:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709827456 00000100:00100000:1.0:1788263467.574744:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788263467.574754:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398661880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709827456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788263467.574782:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788263467.574833:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398661880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709827456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263467.574850:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788263467.574993:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff398741c00 x1875129709827456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263467.575011:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709827456:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788263468.275108:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788263468.444434:0:19453:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788263468.444748:0:19453:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1788263468.529468:0:17101:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788263468.530216:0:17062:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788263468.530221:0:17062:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ff283349800 from 10 10000000:01000000:3.0:1788263468.530226:0:17062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788263468.530278:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764c00/0x4b1103cba66707de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263468.530300:0:17062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764c00/0x4b1103cba66707de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263468.530310:0:17062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764c00/0x4b1103cba66707de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263468.530334:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398661f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709827584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788263468.530401:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263468.530958:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3888c2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788263468.538816:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709827584 00000100:00100000:1.0:1788263468.538831:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709827584 00000100:00100000:1.0:1788263468.538881:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788263468.538891:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+22:17062:x1875129709827584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263468.538907:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263468.538925:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff381681800/0x4b1103cba66707e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba66707de expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.538951:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff381681800/0x4b1103cba66707e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba66707de expref: 23 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.538962:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff381681800/0x4b1103cba66707e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba66707de expref: 23 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.538972:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381681800, rc 0) 00000100:00100000:1.0:1788263468.539047:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+23:17062:x1875129709827584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (8646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263468.539055:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788263468.539111:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398661f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709827584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263468.539128:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764c00/0x4b1103cba66707de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66707e5 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.539150:0:17062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764c00/0x4b1103cba66707de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba66707e5 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263468.539216:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709827712:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788263468.539265:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263468.539291:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff385410a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263468.539444:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709827712 00000100:00100000:0.0:1788263468.539450:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709827712 00000100:00100000:0.0:1788263468.539474:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788263468.539481:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+23:17062:x1875129709827712:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788263468.539494:0:17059:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788263468.539511:0:17059:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788263468.539515:0:17059:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788263468.539616:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+23:17062:x1875129709827712:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 135us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263468.539623:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788263468.539913:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709827712:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788263468.539969:0:17062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788263468.539978:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764c00/0x4b1103cba66707de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66707e5 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.539986:0:17062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764c00/0x4b1103cba66707de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66707e5 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263468.539995:0:17062:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788263468.539998:0:17062:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ff28389c800 from 10 10000000:01000000:1.0:1788263468.540000:0:17062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788263468.540020:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff381681e00/0x4b1103cba66707ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.540027:0:17062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff381681e00/0x4b1103cba66707ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.540036:0:17062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff381681e00/0x4b1103cba66707ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263468.540049:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709827840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788263468.540084:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263468.540458:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff385410a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788263468.540485:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709827840 00000100:00100000:1.0:1788263468.540490:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709827840 00000100:00100000:1.0:1788263468.540956:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788263468.540965:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+23:17062:x1875129709827840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263468.540976:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263468.540990:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff381681200/0x4b1103cba66707f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba66707ec expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.541012:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff381681200/0x4b1103cba66707f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba66707ec expref: 24 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.541022:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff381681200/0x4b1103cba66707f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba66707ec expref: 24 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.541031:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff381681200, rc 0) 00000100:00100000:1.0:1788263468.541076:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+24:17062:x1875129709827840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263468.541082:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788263468.541120:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709827840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263468.541133:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff381681e00/0x4b1103cba66707ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66707f3 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.541141:0:17062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff381681e00/0x4b1103cba66707ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba66707f3 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263468.541192:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709827968:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788263468.541227:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263468.541260:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff385410a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788263468.541272:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709827968 00000100:00100000:1.0:1788263468.541275:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709827968 00000100:00100000:1.0:1788263468.541292:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788263468.541298:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+24:17062:x1875129709827968:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788263468.541309:0:17058:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788263468.541325:0:17058:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788263468.541328:0:17058:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788263468.541400:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+24:17062:x1875129709827968:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 101us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263468.541407:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788263468.541435:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709827968:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788263468.541479:0:17062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788263468.541486:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff381681e00/0x4b1103cba66707ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66707f3 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263468.541494:0:17062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff381681e00/0x4b1103cba66707ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba66707f3 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263468.592616:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709828096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788263468.592689:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263468.592741:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709828096 00000100:00100000:3.0:1788263468.592748:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709828096 00000100:00100000:3.0:1788263468.592902:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788263468.592911:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709828096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788263468.592940:0:17070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788263468.592983:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709828096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263468.592990:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788263468.593030:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709828096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788263468.593274:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788263468.593284:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709828224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788263468.593312:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263468.593338:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709828224 00000100:00100000:0.0:1788263468.593351:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709828224 00000100:00100000:0.0:1788263468.593377:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788263468.593384:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709828224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788263468.593401:0:17070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788263468.593437:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709828224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263468.593444:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788263468.593476:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709828224:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788263469.295785:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788263469.502877:0:17817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788263470.320377:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263471.344793:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263471.408929:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263451/real 1788263451] req@ffff9ff283988000 x1875129709814912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263471 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263471.408961:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ff283988000 x1875129709814912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263471 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263471.408970:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263451/real 1788263451] req@ffff9ff28398b800 x1875129709815040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263471 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263471.408980:0:3617:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ff28398b800 x1875129709815040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263471 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788263471.408997:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3af7da000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788263471.409082:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788263471.409087:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709814912:0@lo:8:kworker.0 00000100:00080000:0.0:1788263471.409093:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3843fb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788263471.410428:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788263471.410433:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788263471.410436:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ff3af7da000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788263471.410442:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 460 00000100:00080000:1.0:1788263471.410448:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788263471.410455:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ff3af7da000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:1.0:1788263471.410483:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff28414b480 x1875129709828608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788263471.410494:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788263471.410497:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788263471.410498:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ff3843fb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788263471.410501:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 460 00000100:00080000:1.0:1788263471.410504:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788263471.410507:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ff3843fb800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:1.0:1788263471.410517:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff28414b100 x1875129709828736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788263471.410551:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788263471.410555:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788263471.410556:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ff3bc483800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788263471.410560:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ff3bc483800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:1.0:1788263471.410598:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ff28414a680 x1875129709829248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788263471.410655:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709828480:0@lo:400:kworker.0 00000100:00100000:1.0:1788263471.410716:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263471.410757:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28414a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709829376:0@lo:400:kworker.0 00000100:00100000:1.0:1788263471.410778:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263471.410794:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff284149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709829888:0@lo:400:kworker.0 00000100:00100000:1.0:1788263471.410816:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263471.410835:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788263471.410841:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fb36e90-c209-4884-91f2-1155be4ad295:3619:1875129709828352:0@lo:400:kworker.0 00000100:00100000:1.0:1788263471.410873:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263471.410893:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff284149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709829120:0@lo:400:kworker.0 00000100:00100000:1.0:1788263471.410915:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788263471.411071:0:3617:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788263471.411077:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28398b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709815040:0@lo:8:kworker.0 00000100:00100000:0.0:1788263471.411104:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28414b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709828608:0@lo:8:kworker.0 00000100:00100000:1.0:1788263471.411154:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28414b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875129709829760:0@lo:400:kworker.0 00000100:00100000:0.0:1788263471.411260:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263471.411267:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709829376 00000100:00100000:3.0:1788263471.411276:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709829376 00000100:00100000:0.0:1788263471.411297:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28414b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709828736:0@lo:8:kworker.0 00000100:00100000:3.0:1788263471.411319:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709829888 00000100:00100000:3.0:1788263471.411323:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709829888 00000100:00100000:0.0:1788263471.411325:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263471.411348:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28414a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709829248:0@lo:8:kworker.0 00000100:00100000:3.0:1788263471.411370:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788263471.411376:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263471.411382:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28414ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709829376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263471.411407:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff284149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709828864:0@lo:400:kworker.0 00000100:00100000:0.0:1788263471.411429:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263471.411440:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff284148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709829504:0@lo:400:kworker.0 00000100:00100000:0.0:1788263471.411458:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263471.411468:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788263471.411473:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28414aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709828992:0@lo:400:kworker.0 00000100:00100000:0.0:1788263471.411490:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263471.411505:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff284149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709829632:0@lo:400:kworker.0 00000100:00100000:0.0:1788263471.411522:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263471.411543:0:19151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709829120 00000100:00100000:0.0:1788263471.411547:0:19151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709829120 00000100:00100000:0.0:1788263471.411568:0:19151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709828608 00000100:00100000:0.0:1788263471.411571:0:19151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709828608 00000100:00100000:0.0:1788263471.411594:0:19151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709828736 00000100:00100000:0.0:1788263471.411597:0:19151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709828736 00000100:00100000:0.0:1788263471.411605:0:19151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709829248 00000100:00100000:0.0:1788263471.411607:0:19151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709829248 00000100:00100000:0.0:1788263471.411616:0:19151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788263471.411623:0:19151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709829120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263471.411665:0:19151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284148e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709829120:12345-0@lo:400:kworker.0 Request processed in 43us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263471.411672:0:19151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788263471.411698:0:19151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788263471.411704:0:19151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3617:x1875129709828608:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788263471.411727:0:19151:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:0.0:1788263471.411755:0:19151:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b1103cba66707fa 00002000:00100000:0.0:1788263471.411768:0:19151:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ff282291000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788263471.411773:0:19151:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788263471.411775:0:19151:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788263471.411845:0:19151:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788263471.411863:0:19151:0:(import.c:65:import_set_state_nolock()) ffff9ff282295000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263471.411899:0:19151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3617:x1875129709828608:12345-0@lo:8:kworker.0 Request processed in 194us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263471.411905:0:19151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788263471.411917:0:19151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788263471.411921:0:19151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3617:x1875129709828736:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788263471.411949:0:19151:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:0.0:1788263471.411964:0:19151:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b1103cba6670801 00002000:00100000:0.0:1788263471.411970:0:19151:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ff282294000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788263471.411974:0:19151:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788263471.411976:0:19151:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788263471.412108:0:19151:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788263471.412121:0:19151:0:(import.c:65:import_set_state_nolock()) ffff9ff282295800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263471.412150:0:19151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3617:x1875129709828736:12345-0@lo:8:kworker.0 Request processed in 227us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263471.412156:0:19151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788263471.412168:0:19151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788263471.412173:0:19151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3617:x1875129709829248:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788263471.412192:0:19151:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:0.0:1788263471.412207:0:19151:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b1103cba6670808 00002000:00100000:0.0:1788263471.412224:0:19151:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9ff282290800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788263471.412228:0:19151:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1788263471.412230:0:19151:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788263471.412250:0:19151:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788263471.412261:0:19151:0:(import.c:65:import_set_state_nolock()) ffff9ff282296800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263471.412287:0:19151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3617:x1875129709829248:12345-0@lo:8:kworker.0 Request processed in 113us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263471.412294:0:19151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788263471.412319:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709828480 00000100:00100000:0.0:1788263471.412323:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709828480 00000100:00100000:0.0:1788263471.412340:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709828992 00000100:00100000:0.0:1788263471.412342:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709828992 00000100:00100000:0.0:1788263471.412354:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788263471.412360:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709828480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263471.412392:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284148700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709828480:12345-0@lo:400:kworker.0 Request processed in 32us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263471.412399:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788263471.412409:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788263471.412415:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709828992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263471.412441:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709828992:12345-0@lo:400:kworker.0 Request processed in 26us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263471.412447:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788263471.412479:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28414aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709828992:0@lo:400:kworker.0 00010000:00080000:0.0:1788263471.412506:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28414b480 x1875129709828608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788263496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263471.412522:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788263471.412528:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788263471.412535:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788263471.412540:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788263471.412543:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3af7da000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788263471.412562:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788263471.412567:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28414b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709828608:0@lo:8:kworker.0 00010000:00080000:0.0:1788263471.412601:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28414b100 x1875129709828736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788263496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263471.412610:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788263471.412614:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788263471.412620:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000004:00080000:2.0:1788263471.412622:0:17090:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00080000:0.0:1788263471.412624:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788263471.412628:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3843fb800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788263471.412644:0:17090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398741500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17090:1875129709830144:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788263471.412648:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788263471.412653:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28414b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3617:1875129709828736:0@lo:8:kworker.0 00010000:00080000:0.0:1788263471.412667:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28414a680 x1875129709829248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788263496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788263471.412676:0:3617:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00100000:2.0:1788263471.412681:0:17090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788263471.412682:0:3617:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788263471.412687:0:3617:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788263471.412689:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9ff3bc483800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788263471.412701:0:3617:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788263471.412702:0:17090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bc67b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263471.412707:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28414a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3617:1875129709829248:0@lo:8:kworker.0 00000100:00100000:0.0:1788263471.412738:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709830016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263471.412776:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263471.412805:0:19151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709830144 00000100:00100000:0.0:1788263471.412809:0:19151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709830144 00000100:00100000:0.0:1788263471.412833:0:19151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788263471.412841:0:19151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17090:x1875129709830144:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788263471.412956:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263471.412986:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709828480:0@lo:400:kworker.0 00010000:00080000:1.0:1788263471.413008:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff284149f80 x1875129709829120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788263487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263471.413016:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff284149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709829120:0@lo:400:kworker.0 00000100:00100000:1.0:1788263471.413041:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709828352 00000100:00100000:1.0:1788263471.413046:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709828352 00000004:00080000:0.0:1788263471.413047:0:17809:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788263471.413068:0:17809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283ae9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17809:1875129709830400:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788263471.413082:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788263471.413090:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+24:3619:x1875129709828352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263471.413099:0:17809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263471.413117:0:17809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3b006c240 going to sleep for 11 seconds 00000004:00080000:0.0:1788263471.413133:0:17808:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788263471.413188:0:17808:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 480484608411ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788263471.413195:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+24:3619:x1875129709828352:12345-0@lo:400:kworker.0 Request processed in 105us (2319us total) trans 0 rc 0/0 00080000:00080000:0.0:1788263471.413196:0:17808:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788263471.413206:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788263471.413236:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709830400 00000100:00100000:0.0:1788263471.413241:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709830400 00000004:00080000:1.0:1788263471.413252:0:17089:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788263471.413306:0:17089:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 480484725874ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788263471.413311:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00080000:00080000:1.0:1788263471.413313:0:17089:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788263471.413323:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17809:x1875129709830400:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788263471.413534:0:17092:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1788263471.413543:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788263471.413555:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709830272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788263471.413560:0:17092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff284149180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17092:1875129709830656:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788263471.413608:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263471.413829:0:17092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263471.414009:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28414ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709829376:12345-0@lo:400:kworker.0 Request processed in 2629us (3228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263471.414018:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788263471.414030:0:17092:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff383968f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788263471.414037:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709828864 00000100:00100000:3.0:1788263471.414042:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709828864 00000100:00100000:3.0:1788263471.414061:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709829504 00000100:00100000:3.0:1788263471.414065:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709829504 00000004:00080000:1.0:1788263471.414081:0:17091:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788263471.414082:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709829632 00000100:00100000:3.0:1788263471.414086:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709829632 00000100:00100000:3.0:1788263471.414106:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709829760 00000100:00100000:3.0:1788263471.414109:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709829760 00000004:00080000:1.0:1788263471.414130:0:17091:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 480485550722ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788263471.414143:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788263471.414152:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875129709829888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263471.414189:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875129709829888:12345-0@lo:400:kworker.0 Request processed in 39us (3372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263471.414195:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788263471.414207:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788263471.414227:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709828864:12345-0@lo:400:kworker.0 00080000:00080000:1.0:1788263471.414239:0:17091:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788263471.414262:0:18573:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788263471.414268:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875129709828864:12345-0@lo:400:kworker.0 Request processed in 53us (2836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263471.414272:0:18573:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788263471.414279:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788263471.414295:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788263471.414302:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709829504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263471.414330:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875129709829504:12345-0@lo:400:kworker.0 Request processed in 29us (2871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263471.414347:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788263471.414359:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788263471.414365:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709829632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263471.414392:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875129709829632:12345-0@lo:400:kworker.0 Request processed in 27us (2869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263471.414397:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788263471.414407:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788263471.414413:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875129709829760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263471.414437:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284148a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875129709829760:12345-0@lo:400:kworker.0 Request processed in 24us (1595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263471.414442:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788263471.414475:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788263471.414479:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788263471.414481:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788263471.414483:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788263471.414501:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709830016 00000100:00100000:3.0:1788263471.414505:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709830016 00000100:00100000:3.0:1788263471.414520:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709830272 00000100:00100000:3.0:1788263471.414523:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709830272 00000100:00100000:3.0:1788263471.414535:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788263471.414540:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1875129709830016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788263471.414558:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788263471.414610:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1875129709830016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (1834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263471.414616:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788263471.414629:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788263471.414635:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3620:x1875129709830272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788263471.414655:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788263471.414687:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3620:x1875129709830272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263471.414693:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788263471.414737:0:18574:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788263471.414745:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709830656 00000100:00100000:3.0:1788263471.414748:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709830656 00000100:00080000:3.0:1788263471.414776:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788263471.414788:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff284149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709830528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788263471.414824:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263471.414831:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fb36e90-c209-4884-91f2-1155be4ad295:3619:1875129709828352:0@lo:400:kworker.0 00010000:00080000:1.0:1788263471.414862:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28414b800 x1875129709829760/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263471.414873:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28414b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1875129709829760:0@lo:400:kworker.0 00000100:00100000:3.0:1788263471.414878:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709830528 00000100:00100000:3.0:1788263471.414883:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709830528 00010000:00080000:1.0:1788263471.414889:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28414a300 x1875129709829376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263471.414899:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28414a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709829376:0@lo:400:kworker.0 00000100:00100000:3.0:1788263471.414909:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788263471.414919:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3618:x1875129709830528:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788263471.414924:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff284149500 x1875129709829888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:3.0:1788263471.414930:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788263471.414934:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff284149500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709829888:0@lo:400:kworker.0 00000100:00100000:3.0:1788263471.414971:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3618:x1875129709830528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263471.414978:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788263471.415012:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff284149f80 x1875129709830528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263471.415028:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff284149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709830528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263471.415064:0:19604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788263471.415073:0:19604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28414bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17092:x1875129709830656:12345-0@lo:5:osp-pre-1-0.0 00010000:00080000:1.0:1788263471.416074:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283aebb80 x1875129709830272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263471.416091:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709830272:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788263471.416107:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff398741f80 x1875129709830016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263471.416117:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709830016:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788263471.416129:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff284149c00 x1875129709829632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263471.416222:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff284149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1875129709829632:0@lo:400:kworker.0 00010000:00080000:1.0:1788263471.416239:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff284149880 x1875129709828864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263471.416247:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff284149880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875129709828864:0@lo:400:kworker.0 00010000:00080000:1.0:1788263471.416261:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff284148000 x1875129709829504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263471.416268:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff284148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3620:1875129709829504:0@lo:400:kworker.0 00002000:00080000:0.0:1788263471.418486:0:19151:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788263471.418499:0:19151:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788263471.418505:0:19151:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000004:00080000:3.0:1788263471.420189:0:17798:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:3.0:1788263471.421521:0:17045:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788263471.421541:0:17045:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:1.0:1788263471.428273:0:18572:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788263471.428282:0:18572:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788263471.428392:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17809:x1875129709830400:12345-0@lo:7:osp-pre-1-1.0 Request processed in 15068us (15289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263471.428403:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788263471.429858:0:17809:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283ae9880 x1875129709830400/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788263487 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263471.429876:0:17809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283ae9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17809:1875129709830400:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788263471.429901:0:17809:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788263471.429945:0:17809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398663800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17809:1875129709830784:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788263471.430014:0:17809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263471.430046:0:17809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3853e2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788263471.430069:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709830784 00000100:00100000:3.0:1788263471.430076:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709830784 00000100:00100000:3.0:1788263471.430120:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788263471.430130:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17809:x1875129709830784:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788263471.430157:0:18574:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1788263471.430194:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17809:x1875129709830784:12345-0@lo:5:osp-pre-1-1.0 Request processed in 64us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263471.430202:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788263471.430246:0:17809:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff398663800 x1875129709830784/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788263487 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263471.430257:0:17809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398663800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17809:1875129709830784:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788263471.430268:0:17809:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788263471.430297:0:17809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398663800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17809:1875129709830912:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788263471.430325:0:17809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263471.430343:0:17809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3853e2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788263471.430355:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709830912 00000100:00100000:3.0:1788263471.430359:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709830912 00000100:00100000:3.0:1788263471.430379:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788263471.430385:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17809:x1875129709830912:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788263471.430408:0:18572:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:1.0:1788263471.432922:0:19604:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788263471.432934:0:19604:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788263471.432940:0:19604:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00010000:0.0:1788263471.434288:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.434299:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fba29a29/0x4b1103cba667080f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.434316:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.434328:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.434335:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fba29a29/0x4b1103cba667080f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.434367:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fba29a29/0x4b1103cba667080f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.434378:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fba29a29/0x4b1103cba667080f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.434385:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fba29a29/0x4b1103cba667080f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.434403:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263471.434415:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263471.434420:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fba29a29/0x4b1103cba667080f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.434427:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b68c00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263471.434432:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fba29a29/0x4b1103cba667080f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.434441:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fba29a29/0x4b1103cba667080f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.434456:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fba29a29/0x4b1103cba667080f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.434475:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fba29a29/0x4b1103cba667080f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.434491:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.434493:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.434495:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263471.435418:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.435426:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba6670816 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.435437:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.435441:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.435446:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba6670816 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.435457:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba6670816 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.435466:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba6670816 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.435473:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba6670816 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.435489:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263471.435498:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263471.435508:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba6670816 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.435516:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b68400 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263471.435520:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba6670816 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.435527:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba6670816 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.435539:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba6670816 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.435545:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba6670816 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.435559:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.435561:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.435562:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263471.436372:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.436379:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031fe45e8/0x4b1103cba667081d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.436390:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.436393:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.436397:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031fe45e8/0x4b1103cba667081d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.436417:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031fe45e8/0x4b1103cba667081d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.436426:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031fe45e8/0x4b1103cba667081d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.436433:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031fe45e8/0x4b1103cba667081d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.436449:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263471.436457:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263471.436461:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031fe45e8/0x4b1103cba667081d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.436468:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150e800 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263471.436473:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031fe45e8/0x4b1103cba667081d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.436480:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031fe45e8/0x4b1103cba667081d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.436493:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031fe45e8/0x4b1103cba667081d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.436500:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031fe45e8/0x4b1103cba667081d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.436520:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.436522:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.436524:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263471.437296:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.437305:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f94c011c/0x4b1103cba6670824 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.437316:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.437319:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.437324:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f94c011c/0x4b1103cba6670824 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.437333:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f94c011c/0x4b1103cba6670824 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.437342:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f94c011c/0x4b1103cba6670824 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.437349:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f94c011c/0x4b1103cba6670824 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.437365:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263471.437373:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263471.437377:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f94c011c/0x4b1103cba6670824 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.437396:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9000 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263471.437401:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f94c011c/0x4b1103cba6670824 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.437408:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f94c011c/0x4b1103cba6670824 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.437420:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f94c011c/0x4b1103cba6670824 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.437427:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f94c011c/0x4b1103cba6670824 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.437442:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.437443:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.437445:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263471.437858:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.437865:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009ec6b03/0x4b1103cba667082b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.437873:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.437876:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.437881:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009ec6b03/0x4b1103cba667082b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.437890:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009ec6b03/0x4b1103cba667082b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.437905:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009ec6b03/0x4b1103cba667082b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.437912:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009ec6b03/0x4b1103cba667082b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.437926:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263471.437934:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263471.437938:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009ec6b03/0x4b1103cba667082b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.437944:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e8600 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263471.437948:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009ec6b03/0x4b1103cba667082b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.437955:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009ec6b03/0x4b1103cba667082b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.437966:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009ec6b03/0x4b1103cba667082b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.437973:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009ec6b03/0x4b1103cba667082b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.437987:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.437994:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.437995:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263471.441721:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.441735:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d65a87/0x4b1103cba6670832 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.441752:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.441756:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.441833:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d65a87/0x4b1103cba6670832 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.442023:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7d65a87/0x4b1103cba6670832 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.442037:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7d65a87/0x4b1103cba6670832 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.442045:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7d65a87/0x4b1103cba6670832 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.442075:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263471.442088:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263471.442093:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7d65a87/0x4b1103cba6670832 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.442101:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e8a00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263471.442105:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d65a87/0x4b1103cba6670832 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.442127:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7d65a87/0x4b1103cba6670832 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.442142:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7d65a87/0x4b1103cba6670832 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.442149:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7d65a87/0x4b1103cba6670832 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.442168:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.442170:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.442171:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263471.442720:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.442727:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001aa2e588/0x4b1103cba6670839 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.442747:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.442751:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.442755:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aa2e588/0x4b1103cba6670839 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.442977:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aa2e588/0x4b1103cba6670839 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.442985:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001aa2e588/0x4b1103cba6670839 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.442999:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001aa2e588/0x4b1103cba6670839 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.443013:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263471.443022:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263471.443026:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001aa2e588/0x4b1103cba6670839 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.443033:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9a00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263471.443036:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001aa2e588/0x4b1103cba6670839 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.443043:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001aa2e588/0x4b1103cba6670839 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.443141:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001aa2e588/0x4b1103cba6670839 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.443151:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aa2e588/0x4b1103cba6670839 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.443168:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.443170:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.443172:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263471.443973:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.443989:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e37f8cc8/0x4b1103cba6670840 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.443999:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.444002:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.444006:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e37f8cc8/0x4b1103cba6670840 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.444015:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e37f8cc8/0x4b1103cba6670840 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.444024:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e37f8cc8/0x4b1103cba6670840 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.444031:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e37f8cc8/0x4b1103cba6670840 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.444055:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263471.444282:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263471.444295:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e37f8cc8/0x4b1103cba6670840 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.444304:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9600 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263471.444309:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e37f8cc8/0x4b1103cba6670840 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.444319:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e37f8cc8/0x4b1103cba6670840 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.444337:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e37f8cc8/0x4b1103cba6670840 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.444346:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e37f8cc8/0x4b1103cba6670840 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.444364:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.444366:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.444368:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263471.446497:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.446536:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044fa1725/0x4b1103cba6670847 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.446550:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.446554:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.446559:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044fa1725/0x4b1103cba6670847 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.446643:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044fa1725/0x4b1103cba6670847 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.446675:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044fa1725/0x4b1103cba6670847 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.446696:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044fa1725/0x4b1103cba6670847 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.446728:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263471.446739:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263471.446769:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044fa1725/0x4b1103cba6670847 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.446777:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9200 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263471.446808:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044fa1725/0x4b1103cba6670847 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.446818:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044fa1725/0x4b1103cba6670847 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.446833:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044fa1725/0x4b1103cba6670847 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.446865:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044fa1725/0x4b1103cba6670847 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.447000:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.447009:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.447011:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263471.448305:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.448314:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001696bfd9/0x4b1103cba667084e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.448326:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.448331:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.448337:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001696bfd9/0x4b1103cba667084e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.448439:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001696bfd9/0x4b1103cba667084e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.448451:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001696bfd9/0x4b1103cba667084e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.448458:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001696bfd9/0x4b1103cba667084e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.448531:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788263471.449276:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.449284:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9c30f41/0x4b1103cba6670855 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.449295:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.449298:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.449303:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9c30f41/0x4b1103cba6670855 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.449321:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9c30f41/0x4b1103cba6670855 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.449330:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9c30f41/0x4b1103cba6670855 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.449338:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9c30f41/0x4b1103cba6670855 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788263471.450701:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263471.450710:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071efd468/0x4b1103cba667085c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.450723:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1788263471.450726:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263471.450731:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071efd468/0x4b1103cba667085c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.450744:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071efd468/0x4b1103cba667085c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.450760:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071efd468/0x4b1103cba667085c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.450768:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071efd468/0x4b1103cba667085c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.458042:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788263471.458573:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788263471.458618:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788263471.458627:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001696bfd9/0x4b1103cba667084e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.458641:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9800 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263471.458646:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001696bfd9/0x4b1103cba667084e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.458657:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001696bfd9/0x4b1103cba667084e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.458676:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001696bfd9/0x4b1103cba667084e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.458684:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001696bfd9/0x4b1103cba667084e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.458716:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788263471.458720:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9c30f41/0x4b1103cba6670855 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.458728:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e8400 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263471.458731:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9c30f41/0x4b1103cba6670855 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.458738:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9c30f41/0x4b1103cba6670855 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.458749:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9c30f41/0x4b1103cba6670855 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.458755:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9c30f41/0x4b1103cba6670855 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.459012:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263471.459017:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071efd468/0x4b1103cba667085c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.459024:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381680000 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263471.459028:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071efd468/0x4b1103cba667085c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.459047:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071efd468/0x4b1103cba667085c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.459186:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071efd468/0x4b1103cba667085c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.459194:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071efd468/0x4b1103cba667085c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.459222:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.459224:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.459226:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788263471.459533:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263471.459541:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000005c5c2a/0x4b1103cba6670863 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.459553:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1788263471.459557:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263471.459566:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000005c5c2a/0x4b1103cba6670863 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.459603:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000005c5c2a/0x4b1103cba6670863 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.459611:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000005c5c2a/0x4b1103cba6670863 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.459618:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000005c5c2a/0x4b1103cba6670863 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.459646:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263471.460436:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263471.460443:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000005c5c2a/0x4b1103cba6670863 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.460452:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381680600 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263471.460456:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000005c5c2a/0x4b1103cba6670863 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.460464:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000005c5c2a/0x4b1103cba6670863 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.460479:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000005c5c2a/0x4b1103cba6670863 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.460500:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000005c5c2a/0x4b1103cba6670863 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.460518:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.460520:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.460522:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788263471.460705:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263471.460711:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba667086a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.460720:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1788263471.460723:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263471.460728:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba667086a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.460739:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba667086a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.460757:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba667086a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788263471.461004:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.461009:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022645927/0x4b1103cba6670871 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.461018:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.461020:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.461024:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022645927/0x4b1103cba6670871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.461032:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022645927/0x4b1103cba6670871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.461039:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022645927/0x4b1103cba6670871 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.461046:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022645927/0x4b1103cba6670871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.461125:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba667086a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.461144:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788263471.461154:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263471.461158:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba667086a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.461164:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381680200 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:1.0:1788263471.461175:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba667086a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.461182:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba667086a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.461193:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba667086a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.461199:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba667086a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.461222:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263471.461224:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263471.461225:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.461420:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788263471.462493:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.462511:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045ef98f0/0x4b1103cba6670878 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.462523:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.462527:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.462532:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045ef98f0/0x4b1103cba6670878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.462543:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045ef98f0/0x4b1103cba6670878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.462551:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045ef98f0/0x4b1103cba6670878 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.462558:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045ef98f0/0x4b1103cba6670878 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.462568:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788263471.463044:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788263471.463057:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022645927/0x4b1103cba6670871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.463066:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9c00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:1.0:1788263471.463071:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022645927/0x4b1103cba6670871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.463080:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022645927/0x4b1103cba6670871 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.463094:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022645927/0x4b1103cba6670871 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.463109:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022645927/0x4b1103cba6670871 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.463126:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263471.463129:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045ef98f0/0x4b1103cba6670878 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.463135:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e8800 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:1.0:1788263471.463138:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045ef98f0/0x4b1103cba6670878 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.463144:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045ef98f0/0x4b1103cba6670878 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.463153:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045ef98f0/0x4b1103cba6670878 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.463159:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045ef98f0/0x4b1103cba6670878 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.463171:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263471.463173:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263471.463175:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788263471.464231:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263471.464242:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002562f008/0x4b1103cba667087f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.464275:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1788263471.464279:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263471.464302:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002562f008/0x4b1103cba667087f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.464314:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002562f008/0x4b1103cba667087f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.464323:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002562f008/0x4b1103cba667087f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.464329:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002562f008/0x4b1103cba667087f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.464357:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788263471.464370:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263471.464375:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002562f008/0x4b1103cba667087f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.464382:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff2823ede00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:1.0:1788263471.464403:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002562f008/0x4b1103cba667087f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.464426:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002562f008/0x4b1103cba667087f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.464498:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002562f008/0x4b1103cba667087f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.464506:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002562f008/0x4b1103cba667087f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.464536:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263471.464538:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263471.464540:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263471.465064:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.465071:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068edeed6/0x4b1103cba6670886 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.465080:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.465083:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.465087:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068edeed6/0x4b1103cba6670886 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.465096:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068edeed6/0x4b1103cba6670886 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.465111:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068edeed6/0x4b1103cba6670886 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.465118:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068edeed6/0x4b1103cba6670886 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.465151:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263471.465161:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263471.465165:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068edeed6/0x4b1103cba6670886 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.465171:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9400 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263471.465175:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068edeed6/0x4b1103cba6670886 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.465183:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068edeed6/0x4b1103cba6670886 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.465194:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068edeed6/0x4b1103cba6670886 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.465200:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068edeed6/0x4b1103cba6670886 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.465229:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.465236:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.465238:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263471.467159:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.467170:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fba29a29/0x4b1103cba667088d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.467186:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.467189:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.467194:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fba29a29/0x4b1103cba667088d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.467206:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fba29a29/0x4b1103cba667088d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.467239:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fba29a29/0x4b1103cba667088d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.467248:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fba29a29/0x4b1103cba667088d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.467296:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263471.467310:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263471.467315:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fba29a29/0x4b1103cba667088d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.467322:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b68c00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263471.467326:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fba29a29/0x4b1103cba667088d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.467345:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fba29a29/0x4b1103cba667088d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.467382:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fba29a29/0x4b1103cba667088d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.467391:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fba29a29/0x4b1103cba667088d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.467434:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.467436:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.467438:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.467744:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.467750:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788263471.467842:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263471.467858:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cf2a3d2/0x4b1103cba6670894 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.467867:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1788263471.467870:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263471.467874:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cf2a3d2/0x4b1103cba6670894 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.467882:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cf2a3d2/0x4b1103cba6670894 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.467889:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cf2a3d2/0x4b1103cba6670894 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.467896:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cf2a3d2/0x4b1103cba6670894 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.468154:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788263471.469141:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263471.469151:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019473479/0x4b1103cba667089b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.469163:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1788263471.469167:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263471.469172:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019473479/0x4b1103cba667089b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.469185:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019473479/0x4b1103cba667089b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.469193:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019473479/0x4b1103cba667089b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.469200:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019473479/0x4b1103cba667089b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.469734:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788263471.471126:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788263471.471138:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cf2a3d2/0x4b1103cba6670894 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.471150:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff2823ec200 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263471.471155:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cf2a3d2/0x4b1103cba6670894 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.471164:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cf2a3d2/0x4b1103cba6670894 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.471183:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cf2a3d2/0x4b1103cba6670894 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.471207:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cf2a3d2/0x4b1103cba6670894 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.471242:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263471.471246:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019473479/0x4b1103cba667089b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.471252:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff2823ecc00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263471.471255:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019473479/0x4b1103cba667089b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.471262:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019473479/0x4b1103cba667089b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.471272:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019473479/0x4b1103cba667089b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.471278:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019473479/0x4b1103cba667089b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.471289:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.471291:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.471293:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788263471.471551:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263471.471559:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059813ee6/0x4b1103cba66708a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.471570:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1788263471.472515:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263471.474663:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263471.474674:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059813ee6/0x4b1103cba66708a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.474694:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059813ee6/0x4b1103cba66708a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.474704:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059813ee6/0x4b1103cba66708a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.474710:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059813ee6/0x4b1103cba66708a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.474733:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788263471.476751:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263471.477220:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f964b678/0x4b1103cba66708a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.477238:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1788263471.477242:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263471.477248:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f964b678/0x4b1103cba66708a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.477261:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f964b678/0x4b1103cba66708a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.477271:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f964b678/0x4b1103cba66708a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.477289:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f964b678/0x4b1103cba66708a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.477315:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788263471.477459:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788263471.477466:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059813ee6/0x4b1103cba66708a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.477480:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff2823ec000 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263471.477484:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059813ee6/0x4b1103cba66708a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.477493:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059813ee6/0x4b1103cba66708a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.477509:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059813ee6/0x4b1103cba66708a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.477515:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059813ee6/0x4b1103cba66708a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.477533:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263471.477536:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f964b678/0x4b1103cba66708a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.477542:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff2823ed600 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263471.477545:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f964b678/0x4b1103cba66708a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.477552:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f964b678/0x4b1103cba66708a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.477562:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f964b678/0x4b1103cba66708a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.477575:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f964b678/0x4b1103cba66708a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.477724:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.478034:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.478036:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.478038:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263471.478538:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.478545:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba66708b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.478556:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.478559:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.478564:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba66708b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.478574:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba66708b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.479478:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba66708b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.479488:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba66708b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.479509:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263471.479658:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263471.479665:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba66708b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.479675:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b68400 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263471.479687:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba66708b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.479696:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba66708b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.479713:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba66708b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.479720:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba66708b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.479739:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.479740:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.479742:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788263471.480343:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263471.480425:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007eae65fd/0x4b1103cba66708b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.480436:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1788263471.480440:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263471.480446:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007eae65fd/0x4b1103cba66708b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.480457:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007eae65fd/0x4b1103cba66708b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.480465:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007eae65fd/0x4b1103cba66708b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.480472:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007eae65fd/0x4b1103cba66708b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.480493:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788263471.480617:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263471.480622:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007eae65fd/0x4b1103cba66708b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.480636:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff2823ec600 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:1.0:1788263471.480639:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007eae65fd/0x4b1103cba66708b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.480646:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007eae65fd/0x4b1103cba66708b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.480658:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007eae65fd/0x4b1103cba66708b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.480664:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007eae65fd/0x4b1103cba66708b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.480679:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263471.480680:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263471.480682:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263471.481531:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.481548:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba66708be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.481560:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.481563:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.481568:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba66708be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.481615:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba66708be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.481624:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba66708be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.481631:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba66708be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.481647:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263471.481902:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263471.481909:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba66708be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.481918:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381680200 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263471.481923:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba66708be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.481932:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba66708be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.481947:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba66708be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.481961:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba66708be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.481979:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.481981:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.481983:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788263471.482141:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263471.482147:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002562f008/0x4b1103cba66708c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.482155:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1788263471.482158:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263471.482162:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002562f008/0x4b1103cba66708c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.482510:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002562f008/0x4b1103cba66708c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.482525:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002562f008/0x4b1103cba66708c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.482532:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002562f008/0x4b1103cba66708c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.482556:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263471.483336:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263471.483344:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002562f008/0x4b1103cba66708c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.483471:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff2823ede00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263471.483475:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002562f008/0x4b1103cba66708c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.483483:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002562f008/0x4b1103cba66708c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.483501:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002562f008/0x4b1103cba66708c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.483508:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002562f008/0x4b1103cba66708c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.483525:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.483527:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.483529:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263471.484837:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.484859:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000005c5c2a/0x4b1103cba66708cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.484872:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.484875:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.484881:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000005c5c2a/0x4b1103cba66708cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.484892:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000005c5c2a/0x4b1103cba66708cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.484919:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000005c5c2a/0x4b1103cba66708cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.484927:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000005c5c2a/0x4b1103cba66708cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.484953:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788263471.485823:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263471.485832:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007eae65fd/0x4b1103cba66708d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.485843:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1788263471.485847:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263471.485852:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007eae65fd/0x4b1103cba66708d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.485862:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007eae65fd/0x4b1103cba66708d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.485869:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007eae65fd/0x4b1103cba66708d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.485877:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007eae65fd/0x4b1103cba66708d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.485915:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788263471.486462:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788263471.486471:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000005c5c2a/0x4b1103cba66708cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.486479:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381680600 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263471.486483:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000005c5c2a/0x4b1103cba66708cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.486492:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000005c5c2a/0x4b1103cba66708cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.486507:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000005c5c2a/0x4b1103cba66708cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.486514:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000005c5c2a/0x4b1103cba66708cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.486533:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263471.486536:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007eae65fd/0x4b1103cba66708d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.486543:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff2823ec600 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263471.486546:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007eae65fd/0x4b1103cba66708d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.486553:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007eae65fd/0x4b1103cba66708d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.486595:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007eae65fd/0x4b1103cba66708d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.486604:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007eae65fd/0x4b1103cba66708d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.486618:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.486620:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.486622:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.486628:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788263471.488748:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263471.488767:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d3d5f13/0x4b1103cba66708da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.488781:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1788263471.488786:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263471.488793:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d3d5f13/0x4b1103cba66708da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.488806:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d3d5f13/0x4b1103cba66708da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.488816:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d3d5f13/0x4b1103cba66708da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.488823:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d3d5f13/0x4b1103cba66708da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.488845:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788263471.489114:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.489121:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071efd468/0x4b1103cba66708e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.489129:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.489131:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.489135:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071efd468/0x4b1103cba66708e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.489146:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071efd468/0x4b1103cba66708e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.489154:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071efd468/0x4b1103cba66708e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.489161:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071efd468/0x4b1103cba66708e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.489187:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788263471.489197:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788263471.489203:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d3d5f13/0x4b1103cba66708da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.489210:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff2823ece00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263471.489225:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d3d5f13/0x4b1103cba66708da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.489233:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d3d5f13/0x4b1103cba66708da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.489249:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d3d5f13/0x4b1103cba66708da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.489260:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d3d5f13/0x4b1103cba66708da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.489279:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263471.489282:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.489283:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071efd468/0x4b1103cba66708e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.489292:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381680000 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263471.489296:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071efd468/0x4b1103cba66708e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.489316:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071efd468/0x4b1103cba66708e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.489327:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071efd468/0x4b1103cba66708e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.489334:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071efd468/0x4b1103cba66708e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.489360:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.489362:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.489364:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263471.490043:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.490051:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba66708e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.490060:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.490063:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.490068:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba66708e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.490076:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba66708e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.490084:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba66708e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.490098:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba66708e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.490118:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263471.490155:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263471.490171:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba66708e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.490182:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff381680200 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263471.490186:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba66708e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.490196:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba66708e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.490210:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba66708e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.490227:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d06da7a5/0x4b1103cba66708e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.490248:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.490250:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.490252:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788263471.490360:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263471.490366:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008750285b/0x4b1103cba66708ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.490374:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1788263471.490383:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263471.490387:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008750285b/0x4b1103cba66708ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.490396:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008750285b/0x4b1103cba66708ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.490403:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008750285b/0x4b1103cba66708ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.490409:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008750285b/0x4b1103cba66708ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.490428:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263471.490744:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263471.490750:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008750285b/0x4b1103cba66708ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.490767:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff2823eca00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263471.490771:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008750285b/0x4b1103cba66708ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.490777:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008750285b/0x4b1103cba66708ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.490788:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008750285b/0x4b1103cba66708ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.490794:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008750285b/0x4b1103cba66708ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.490807:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.490808:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.490810:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263471.491142:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.491155:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba66708f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.491165:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.491168:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.491172:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba66708f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.491182:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba66708f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.491190:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba66708f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.491197:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba66708f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.491221:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263471.491263:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263471.491270:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba66708f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.491278:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b68400 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263471.491282:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba66708f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.491290:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba66708f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.491301:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba66708f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.491309:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006527733a/0x4b1103cba66708f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.491324:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.491326:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.491328:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788263471.491666:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263471.491672:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc1279bf/0x4b1103cba66708fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.491681:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1788263471.491684:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263471.491689:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc1279bf/0x4b1103cba66708fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.491698:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc1279bf/0x4b1103cba66708fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.491707:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc1279bf/0x4b1103cba66708fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.491720:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc1279bf/0x4b1103cba66708fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.491736:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263471.493203:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263471.493221:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc1279bf/0x4b1103cba66708fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.493232:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff2823edc00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263471.493236:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc1279bf/0x4b1103cba66708fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.493244:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc1279bf/0x4b1103cba66708fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.493269:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc1279bf/0x4b1103cba66708fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.493276:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc1279bf/0x4b1103cba66708fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.493294:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.493296:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.493297:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788263471.493614:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263471.493621:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8386e26/0x4b1103cba6670904 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.493632:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1788263471.493635:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263471.493641:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8386e26/0x4b1103cba6670904 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.493652:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8386e26/0x4b1103cba6670904 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.493659:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8386e26/0x4b1103cba6670904 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.493666:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8386e26/0x4b1103cba6670904 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.493678:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263471.494134:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263471.494141:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8386e26/0x4b1103cba6670904 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.494161:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff2823ec400 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263471.494165:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8386e26/0x4b1103cba6670904 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.494173:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8386e26/0x4b1103cba6670904 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.494185:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8386e26/0x4b1103cba6670904 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.494191:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8386e26/0x4b1103cba6670904 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.494208:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.494209:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.494211:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263471.494279:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.494284:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fba29a29/0x4b1103cba667090b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.494292:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.494295:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.494299:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fba29a29/0x4b1103cba667090b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.494308:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fba29a29/0x4b1103cba667090b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.494315:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fba29a29/0x4b1103cba667090b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.494321:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fba29a29/0x4b1103cba667090b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.494357:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263471.494731:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263471.494737:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fba29a29/0x4b1103cba667090b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.494745:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b68c00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263471.494749:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fba29a29/0x4b1103cba667090b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.494756:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fba29a29/0x4b1103cba667090b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.494779:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fba29a29/0x4b1103cba667090b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.494786:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fba29a29/0x4b1103cba667090b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.494801:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.494803:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.494805:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263471.495707:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.495715:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068edeed6/0x4b1103cba6670912 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.495727:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.495731:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.495736:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068edeed6/0x4b1103cba6670912 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.495747:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068edeed6/0x4b1103cba6670912 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.495756:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068edeed6/0x4b1103cba6670912 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.495768:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068edeed6/0x4b1103cba6670912 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.495783:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788263471.496317:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263471.496325:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0476a85/0x4b1103cba6670919 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.496340:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1788263471.496343:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263471.496359:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0476a85/0x4b1103cba6670919 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.496372:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0476a85/0x4b1103cba6670919 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.496388:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0476a85/0x4b1103cba6670919 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.496395:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0476a85/0x4b1103cba6670919 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.496409:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788263471.496555:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788263471.496561:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068edeed6/0x4b1103cba6670912 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.496568:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9400 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263471.496571:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068edeed6/0x4b1103cba6670912 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.496593:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068edeed6/0x4b1103cba6670912 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.496608:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068edeed6/0x4b1103cba6670912 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.496615:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068edeed6/0x4b1103cba6670912 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.496644:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263471.496648:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0476a85/0x4b1103cba6670919 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.496653:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff2823ec800 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263471.496656:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0476a85/0x4b1103cba6670919 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.496663:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0476a85/0x4b1103cba6670919 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.496672:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0476a85/0x4b1103cba6670919 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.496679:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0476a85/0x4b1103cba6670919 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.496690:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.496692:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.496693:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.496699:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263471.497286:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.497294:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045ef98f0/0x4b1103cba6670920 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.497304:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.497313:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.497319:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045ef98f0/0x4b1103cba6670920 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.497330:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045ef98f0/0x4b1103cba6670920 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.497338:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045ef98f0/0x4b1103cba6670920 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.497355:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045ef98f0/0x4b1103cba6670920 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.497375:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263471.497617:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263471.497622:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045ef98f0/0x4b1103cba6670920 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.497630:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e8800 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263471.497638:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045ef98f0/0x4b1103cba6670920 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.497647:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045ef98f0/0x4b1103cba6670920 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.497660:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045ef98f0/0x4b1103cba6670920 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.497667:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045ef98f0/0x4b1103cba6670920 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.497682:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.497684:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.497685:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263471.498470:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.498478:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022645927/0x4b1103cba6670927 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.498489:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.498492:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.498497:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022645927/0x4b1103cba6670927 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.498508:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022645927/0x4b1103cba6670927 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.498516:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022645927/0x4b1103cba6670927 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.498529:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022645927/0x4b1103cba6670927 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.498547:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263471.498709:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263471.498715:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022645927/0x4b1103cba6670927 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.498723:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9c00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263471.498726:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022645927/0x4b1103cba6670927 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.498735:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022645927/0x4b1103cba6670927 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.498748:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022645927/0x4b1103cba6670927 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.498760:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022645927/0x4b1103cba6670927 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.498775:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.498777:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.498778:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788263471.499130:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263471.499137:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4adc93a/0x4b1103cba667092e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.499146:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1788263471.499149:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263471.499155:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4adc93a/0x4b1103cba667092e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.499164:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4adc93a/0x4b1103cba667092e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.499182:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4adc93a/0x4b1103cba667092e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.499189:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4adc93a/0x4b1103cba667092e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.499205:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263471.499395:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263471.499401:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4adc93a/0x4b1103cba667092e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.499408:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff2823eda00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263471.499411:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4adc93a/0x4b1103cba667092e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.499418:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4adc93a/0x4b1103cba667092e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.499429:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4adc93a/0x4b1103cba667092e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.499437:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4adc93a/0x4b1103cba667092e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.499451:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.499453:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.499455:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263471.499743:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.499749:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e37f8cc8/0x4b1103cba6670935 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.499758:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.499762:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.499766:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e37f8cc8/0x4b1103cba6670935 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.499775:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e37f8cc8/0x4b1103cba6670935 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.499782:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e37f8cc8/0x4b1103cba6670935 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.499789:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e37f8cc8/0x4b1103cba6670935 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.499804:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263471.500056:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263471.500062:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e37f8cc8/0x4b1103cba6670935 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.500069:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9600 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263471.500073:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e37f8cc8/0x4b1103cba6670935 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.500080:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e37f8cc8/0x4b1103cba6670935 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.500091:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e37f8cc8/0x4b1103cba6670935 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.500097:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e37f8cc8/0x4b1103cba6670935 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.500112:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.500114:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.500115:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263471.501187:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.501196:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9c30f41/0x4b1103cba667093c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.501224:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.501228:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.501233:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9c30f41/0x4b1103cba667093c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.501245:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9c30f41/0x4b1103cba667093c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.501254:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9c30f41/0x4b1103cba667093c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.501262:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9c30f41/0x4b1103cba667093c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.501282:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788263471.501505:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788263471.501512:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043df5537/0x4b1103cba6670943 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.501520:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1788263471.501523:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263471.501527:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043df5537/0x4b1103cba6670943 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.501548:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043df5537/0x4b1103cba6670943 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.501557:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043df5537/0x4b1103cba6670943 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.501564:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043df5537/0x4b1103cba6670943 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.501606:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788263471.501789:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788263471.501796:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9c30f41/0x4b1103cba667093c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.501803:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e8400 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:1.0:1788263471.501807:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9c30f41/0x4b1103cba667093c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.501815:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9c30f41/0x4b1103cba667093c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.501830:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9c30f41/0x4b1103cba667093c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.501837:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9c30f41/0x4b1103cba667093c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.501864:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263471.501874:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043df5537/0x4b1103cba6670943 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.501881:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765600 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:1.0:1788263471.501884:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043df5537/0x4b1103cba6670943 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.501892:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043df5537/0x4b1103cba6670943 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.501913:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043df5537/0x4b1103cba6670943 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.501920:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043df5537/0x4b1103cba6670943 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.501933:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263471.501935:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263471.501936:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263471.502633:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788263471.502688:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788263471.502695:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001696bfd9/0x4b1103cba667094a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.502705:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=480s v=(0 0) 00010000:00010000:0.0:1788263471.502708:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263471.502714:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001696bfd9/0x4b1103cba667094a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.502724:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001696bfd9/0x4b1103cba667094a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.502739:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001696bfd9/0x4b1103cba667094a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.502746:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001696bfd9/0x4b1103cba667094a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.502762:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788263471.503077:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263471.503083:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073027011/0x4b1103cba6670951 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.503090:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1788263471.503093:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263471.503096:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073027011/0x4b1103cba6670951 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.503115:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073027011/0x4b1103cba6670951 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.503122:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073027011/0x4b1103cba6670951 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.503130:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073027011/0x4b1103cba6670951 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.503142:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788263471.503413:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788263471.503419:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001696bfd9/0x4b1103cba667094a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.503427:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9800 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263471.503431:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001696bfd9/0x4b1103cba667094a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.503454:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001696bfd9/0x4b1103cba667094a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.503468:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001696bfd9/0x4b1103cba667094a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.503475:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001696bfd9/0x4b1103cba667094a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.503498:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263471.503502:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073027011/0x4b1103cba6670951 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.503509:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff2823ed000 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263471.503512:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073027011/0x4b1103cba6670951 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.503519:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073027011/0x4b1103cba6670951 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.503528:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073027011/0x4b1103cba6670951 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.503534:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073027011/0x4b1103cba6670951 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.503545:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.503546:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.503548:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788263471.504525:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263471.504535:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f79a69a2/0x4b1103cba6670958 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.504547:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1788263471.504550:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263471.504554:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f79a69a2/0x4b1103cba6670958 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.504564:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f79a69a2/0x4b1103cba6670958 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.504573:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f79a69a2/0x4b1103cba6670958 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.504607:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f79a69a2/0x4b1103cba6670958 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.504625:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263471.504878:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263471.504886:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f79a69a2/0x4b1103cba6670958 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.504893:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff2823ed800 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263471.504914:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f79a69a2/0x4b1103cba6670958 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.504923:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f79a69a2/0x4b1103cba6670958 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.504936:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f79a69a2/0x4b1103cba6670958 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.504943:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f79a69a2/0x4b1103cba6670958 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.504960:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.504962:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.504964:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788263471.506561:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263471.506570:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f8a1b3f/0x4b1103cba667095f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.506600:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1788263471.506604:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263471.506610:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f8a1b3f/0x4b1103cba667095f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.506622:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f8a1b3f/0x4b1103cba667095f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.506630:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f8a1b3f/0x4b1103cba667095f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.506638:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f8a1b3f/0x4b1103cba667095f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.506670:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788263471.507241:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263471.507248:0:19151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d54019/0x4b1103cba6670966 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.507263:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1788263471.507266:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263471.507270:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d54019/0x4b1103cba6670966 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.507279:0:19151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d54019/0x4b1103cba6670966 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.507286:0:19151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d54019/0x4b1103cba6670966 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.507293:0:19151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d54019/0x4b1103cba6670966 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.507301:0:19151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:1.0:1788263471.507332:0:19151:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:1.0:1788263471.507432:0:19151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17090:x1875129709830144:12345-0@lo:5:osp-pre-0-0.0 Request processed in 94588us (94748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263471.507441:0:19151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788263471.507495:0:17090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398741500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17090:1875129709830144:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788263471.507510:0:17090:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:1.0:1788263471.507551:0:17090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff284148000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17090:1875129709831040:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788263471.507602:0:17090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263471.507625:0:17090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2810e0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788263471.507681:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709831040 00000100:00100000:1.0:1788263471.507688:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709831040 00000100:00100000:1.0:1788263471.507726:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788263471.507735:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17090:x1875129709831040:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788263471.507818:0:18573:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:3.0:1788263471.512256:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788263471.512269:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f8a1b3f/0x4b1103cba667095f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.512283:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff2823ed400 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263471.512288:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f8a1b3f/0x4b1103cba667095f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.512298:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f8a1b3f/0x4b1103cba667095f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.512320:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f8a1b3f/0x4b1103cba667095f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.512336:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f8a1b3f/0x4b1103cba667095f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.512369:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263471.512373:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d54019/0x4b1103cba6670966 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.512379:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff2823ed200 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263471.512382:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d54019/0x4b1103cba6670966 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.512389:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d54019/0x4b1103cba6670966 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.512399:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d54019/0x4b1103cba6670966 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.512405:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d54019/0x4b1103cba6670966 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.512415:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.512417:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.512418:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788263471.512486:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788263471.512493:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f75ee65/0x4b1103cba667096d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.512509:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1788263471.512514:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263471.512520:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f75ee65/0x4b1103cba667096d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.512533:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f75ee65/0x4b1103cba667096d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.512542:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f75ee65/0x4b1103cba667096d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.512550:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f75ee65/0x4b1103cba667096d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.512568:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263471.512595:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263471.512600:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f75ee65/0x4b1103cba667096d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.512607:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765400 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263471.512610:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f75ee65/0x4b1103cba667096d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.512617:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f75ee65/0x4b1103cba667096d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.512639:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f75ee65/0x4b1103cba667096d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.512646:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f75ee65/0x4b1103cba667096d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.512659:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.512661:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.512662:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788263471.515017:0:18568:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:3.0:1788263471.515065:0:18568:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788263471.515203:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284149880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17090:x1875129709831040:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7464us (7595us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788263471.515222:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788263471.515560:0:17090:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1788263471.515568:0:17090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff284148000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17090:1875129709831040:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788263471.515605:0:17090:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00002000:00010000:1.0:1788263471.515706:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263471.515714:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4adc93a/0x4b1103cba6670974 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.515728:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1788263471.515732:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263471.515738:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4adc93a/0x4b1103cba6670974 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.515749:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4adc93a/0x4b1103cba6670974 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.515757:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4adc93a/0x4b1103cba6670974 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.515764:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4adc93a/0x4b1103cba6670974 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.515782:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788263471.516469:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263471.516477:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0476a85/0x4b1103cba667097b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.516486:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1788263471.516488:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263471.516493:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0476a85/0x4b1103cba667097b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.516502:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0476a85/0x4b1103cba667097b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.516509:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0476a85/0x4b1103cba667097b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.516516:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0476a85/0x4b1103cba667097b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.516524:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788263471.516791:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788263471.516798:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4adc93a/0x4b1103cba6670974 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.516807:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff2823eda00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263471.516812:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4adc93a/0x4b1103cba6670974 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.516820:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4adc93a/0x4b1103cba6670974 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.516836:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4adc93a/0x4b1103cba6670974 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.517032:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4adc93a/0x4b1103cba6670974 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.517112:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263471.517116:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0476a85/0x4b1103cba667097b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.517124:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff2823ec800 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263471.517127:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0476a85/0x4b1103cba667097b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.517134:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0476a85/0x4b1103cba667097b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.517146:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0476a85/0x4b1103cba667097b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.517153:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0476a85/0x4b1103cba667097b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.517167:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.517169:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.517170:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788263471.517483:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263471.517489:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc1279bf/0x4b1103cba6670982 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.517498:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1788263471.517501:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263471.517506:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc1279bf/0x4b1103cba6670982 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.517527:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc1279bf/0x4b1103cba6670982 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.517535:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc1279bf/0x4b1103cba6670982 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.517542:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc1279bf/0x4b1103cba6670982 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.517566:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263471.517795:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263471.517801:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc1279bf/0x4b1103cba6670982 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.517840:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff2823edc00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263471.517844:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc1279bf/0x4b1103cba6670982 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.518203:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc1279bf/0x4b1103cba6670982 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.518225:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc1279bf/0x4b1103cba6670982 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.518232:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc1279bf/0x4b1103cba6670982 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263471.518251:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.518254:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.518255:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788263471.518780:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788263471.518787:0:19604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008750285b/0x4b1103cba6670989 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.518797:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1788263471.518801:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263471.518806:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008750285b/0x4b1103cba6670989 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.518821:0:19604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008750285b/0x4b1103cba6670989 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.518829:0:19604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008750285b/0x4b1103cba6670989 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.519279:0:19604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008750285b/0x4b1103cba6670989 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.519429:0:19604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788263471.519472:0:19604:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:1.0:1788263471.519559:0:19604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28414bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17092:x1875129709830656:12345-0@lo:5:osp-pre-1-0.0 Request processed in 104484us (105729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263471.519567:0:19604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788263471.519636:0:17092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff284149180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17092:1875129709830656:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788263471.519651:0:17092:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1788263471.519694:0:17092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff284149180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17092:1875129709831168:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788263471.519727:0:17092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263471.519748:0:17092:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2810e0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788263471.519763:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709831168 00000100:00100000:1.0:1788263471.519769:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709831168 00000100:00100000:1.0:1788263471.519803:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788263471.519811:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17092:x1875129709831168:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788263471.519871:0:18574:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:0.0:1788263471.523229:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263471.523241:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008750285b/0x4b1103cba6670989 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.523254:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff2823eca00 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263471.523260:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008750285b/0x4b1103cba6670989 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.523271:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008750285b/0x4b1103cba6670989 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.523292:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008750285b/0x4b1103cba6670989 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263471.523300:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008750285b/0x4b1103cba6670989 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263471.524614:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263471.524620:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263471.524622:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263471.524822:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788263471.527573:0:19385:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00080000:0.0:1788263471.527710:0:19385:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1788263471.527739:0:19385:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788263471.527742:0:19385:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788263471.528227:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17809:x1875129709830912:12345-0@lo:5:osp-pre-1-1.0 Request processed in 97828us (97890us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788263471.528238:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788263471.528269:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284148000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17092:x1875129709831168:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8458us (8541us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788263471.528277:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788263471.528312:0:17092:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1788263471.528320:0:17092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff284149180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17092:1875129709831168:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788263471.528335:0:17092:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:0.0:1788263471.528426:0:17809:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788263471.528432:0:17809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398663800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17809:1875129709830912:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788263471.528440:0:17809:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788263471.528487:0:17809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283ae9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17809:1875129709831296:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788263471.528524:0:17809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263471.528553:0:17809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff282e093c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263471.529138:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709831296 00000100:00100000:3.0:1788263471.529146:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709831296 00000100:00100000:3.0:1788263471.529255:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788263471.529264:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17809:x1875129709831296:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788263471.529323:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17809:x1875129709831296:12345-0@lo:900:osp-pre-1-1.0 Request processed in 61us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263471.529330:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788263471.529394:0:17809:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff283ae9880 x1875129709831296/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788263487 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263471.529405:0:17809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283ae9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17809:1875129709831296:0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1788263472.369509:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263472.691245:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff284149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709831424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788263472.691312:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263472.691369:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709831424 00000100:00100000:1.0:1788263472.691377:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709831424 00000100:00100000:1.0:1788263472.691422:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788263472.691432:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284149500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709831424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788263472.691453:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788263472.691494:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284149500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709831424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263472.691500:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788263472.691541:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff284149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709831424:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788263473.391693:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263473.713337:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283ae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709831552:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788263473.713406:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263473.713616:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788263473.713623:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff284149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709831680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788263473.713651:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263473.724208:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709831552 00000100:00100000:0.0:1788263473.724223:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709831552 00000100:00100000:0.0:1788263473.724272:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709831680 00000100:00100000:0.0:1788263473.724275:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709831680 00000100:00100000:0.0:1788263473.724294:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788263473.724304:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709831552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788263473.724338:0:17071:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788263473.725537:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709831552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1229us (12126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263473.725549:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788263473.725591:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788263473.725601:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709831680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788263473.725624:0:17071:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788263473.726164:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709831680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 564us (12510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263473.726172:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788263473.726235:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff284149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709831680:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788263473.726252:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283ae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709831552:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1788263473.846884:0:19743:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788263474.415977:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788263474.756136:0:19796:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788263474.756515:0:19796:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788263475.439767:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788263475.646831:0:19846:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788263475.647706:0:19846:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788263475.958733:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263475.958838:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699258112 00000100:00100000:0.0:1788263475.958849:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699258112 00000100:00100000:0.0:1788263475.958903:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 113 00000100:00100000:0.0:1788263475.958912:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2385:x1875129699258112:12345-192.168.203.26@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788263475.958941:0:17059:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9bf1ef74-3c48-413f-a47c-361d3a16ebf9@192.168.203.26@tcp t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:0.0:1788263475.958971:0:17059:0:(genops.c:1385:class_connect()) connect: client 9bf1ef74-3c48-413f-a47c-361d3a16ebf9, cookie 0x4b1103cba6670990 00000100:00080000:0.0:1788263475.959153:0:17059:0:(import.c:65:import_set_state_nolock()) ffff9ff282f60000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263475.959388:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+5:2385:x1875129699258112:12345-192.168.203.26@tcp:250:mount.lustre.0 Request processed in 474us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263475.959396:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 113 00000100:00100000:0.0:1788263475.967721:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263475.967896:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699258240 00000100:00100000:1.0:1788263475.967912:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699258240 00000100:00100000:1.0:1788263475.968005:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 114 00000100:00100000:1.0:1788263475.968016:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+5:14858:x1875129699258240:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788263475.968042:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263475.968059:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff2823ec200/0x4b1103cba6670997 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd405f293d11701b2 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263475.968085:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff2823ec200/0x4b1103cba6670997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11701b2 expref: 6 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263475.968096:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff2823ec200/0x4b1103cba6670997 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11701b2 expref: 6 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263475.968105:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff2823ec200, rc 0) 00000100:00100000:1.0:1788263475.968165:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+6:14858:x1875129699258240:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 150us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263475.968195:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 114 00000100:00100000:2.0:1788263475.979963:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263475.980052:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699258368 00000100:00100000:0.0:1788263475.980061:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699258368 00000100:00100000:0.0:1788263475.980116:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 115 00000100:00100000:0.0:1788263475.980126:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+6:14858:x1875129699258368:12345-192.168.203.26@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788263475.980263:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+6:14858:x1875129699258368:12345-192.168.203.26@tcp:501:mount.lustre.0 Request processed in 138us (307us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788263475.980271:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 115 00000100:00100000:3.0:1788263475.986033:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263475.988854:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699258496 00000100:00100000:2.0:1788263475.988868:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699258496 00000100:00100000:2.0:1788263475.989046:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 116 00000100:00100000:2.0:1788263475.989058:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+6:14858:x1875129699258496:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788263475.989074:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263475.989092:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3bf6d0e00/0x4b1103cba667099e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd405f293d11701b9 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263475.989375:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3bf6d0e00/0x4b1103cba667099e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11701b9 expref: 7 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263475.989401:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3bf6d0e00/0x4b1103cba667099e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11701b9 expref: 7 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263475.989411:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d0e00, rc 0) 00000100:00100000:2.0:1788263475.989501:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+7:14858:x1875129699258496:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 445us (3486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263475.989517:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 116 00000100:00100000:2.0:1788263475.994934:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263475.996282:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699258624 00000100:00100000:1.0:1788263475.996366:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699258624 00000100:00100000:1.0:1788263475.996426:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 117 00000100:00100000:1.0:1788263475.996438:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+7:14858:x1875129699258624:12345-192.168.203.26@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788263475.996627:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+8:14858:x1875129699258624:12345-192.168.203.26@tcp:501:mount.lustre.0 Request processed in 190us (1701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263475.996635:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 117 00000100:00100000:1.0:1788263475.998961:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263475.999175:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699258752 00000100:00100000:2.0:1788263475.999193:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699258752 00000100:00100000:2.0:1788263475.999248:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 118 00000100:00100000:2.0:1788263475.999258:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+8:14858:x1875129699258752:12345-192.168.203.26@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788263475.999452:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+8:14858:x1875129699258752:12345-192.168.203.26@tcp:503:mount.lustre.0 Request processed in 195us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263475.999460:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 118 00000100:00100000:3.0:1788263476.014955:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263476.016621:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699258880 00000100:00100000:1.0:1788263476.016633:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699258880 00000100:00100000:1.0:1788263476.016693:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 119 00000100:00100000:1.0:1788263476.016702:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+8:14877:x1875129699258880:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788263476.016850:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+8:14877:x1875129699258880:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 148us (1903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263476.016858:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 119 00000100:00100000:3.0:1788263476.044051:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263476.044461:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699259008 00000100:00100000:0.0:1788263476.044471:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699259008 00000100:00100000:0.0:1788263476.044537:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 120 00000100:00100000:0.0:1788263476.044547:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+8:14877:x1875129699259008:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788263476.044750:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+8:14877:x1875129699259008:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 203us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263476.044759:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 120 00000100:00100000:3.0:1788263476.065284:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263476.067360:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699259136 00000100:00100000:2.0:1788263476.067373:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699259136 00000100:00100000:2.0:1788263476.067481:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 121 00000100:00100000:2.0:1788263476.067493:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+8:14877:x1875129699259136:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788263476.067657:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+8:14877:x1875129699259136:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 166us (2383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263476.067665:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 121 00000100:00100000:3.0:1788263476.072039:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263476.072227:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699259264 00000100:00100000:1.0:1788263476.072240:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699259264 00000100:00100000:1.0:1788263476.072294:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 122 00000100:00100000:1.0:1788263476.072305:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+8:14858:x1875129699259264:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788263476.072321:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263476.072354:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff2823ec000/0x4b1103cba66709a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd405f293d11701ea expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263476.072383:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff2823ec000/0x4b1103cba66709a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11701ea expref: 9 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263476.072405:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff2823ec000/0x4b1103cba66709a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11701ea expref: 9 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263476.072415:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff2823ec000, rc 0) 00000100:00100000:1.0:1788263476.072485:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+9:14858:x1875129699259264:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 182us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263476.072493:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 122 00000100:00100000:3.0:1788263476.075327:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263476.075535:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699259392 00000100:00100000:2.0:1788263476.075546:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699259392 00000100:00100000:2.0:1788263476.075624:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 123 00000100:00100000:2.0:1788263476.075647:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+9:14858:x1875129699259392:12345-192.168.203.26@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788263476.075668:0:17058:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788263476.075683:0:17058:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788263476.075687:0:17058:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788263476.075690:0:17058:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788263476.075693:0:17058:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788263476.075695:0:17058:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788263476.078771:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384264050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+9:14858:x1875129699259392:12345-192.168.203.26@tcp:256:mount.lustre.0 Request processed in 3115us (3442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263476.078786:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 123 00000100:00100000:3.0:1788263476.083751:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263476.086602:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699259520 00000100:00100000:0.0:1788263476.086617:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699259520 00000100:00100000:0.0:1788263476.086680:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 124 00000100:00100000:0.0:1788263476.086691:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+9:14858:x1875129699259520:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788263476.086705:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263476.086725:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3829e8600/0x4b1103cba66709ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd405f293d11701f1 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263476.086753:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3829e8600/0x4b1103cba66709ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11701f1 expref: 10 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263476.086775:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3829e8600/0x4b1103cba66709ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11701f1 expref: 10 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263476.086786:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3829e8600, rc 0) 00000100:00100000:0.0:1788263476.086864:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+10:14858:x1875129699259520:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 174us (3123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263476.086871:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 124 00000100:00100000:3.0:1788263476.092687:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263476.093259:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699259648 00000100:00100000:1.0:1788263476.093268:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699259648 00000100:00100000:1.0:1788263476.093319:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 125 00000100:00100000:1.0:1788263476.093330:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+10:14858:x1875129699259648:12345-192.168.203.26@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788263476.093507:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+10:14858:x1875129699259648:12345-192.168.203.26@tcp:501:mount.lustre.0 Request processed in 178us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263476.093516:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 125 00000100:00100000:3.0:1788263476.096639:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263476.096958:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699259776 00000100:00100000:1.0:1788263476.096967:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699259776 00000100:00100000:1.0:1788263476.097009:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 126 00000100:00100000:1.0:1788263476.097018:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+10:14858:x1875129699259776:12345-192.168.203.26@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788263476.097168:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+10:14858:x1875129699259776:12345-192.168.203.26@tcp:503:mount.lustre.0 Request processed in 149us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263476.097176:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 126 00000100:00100000:3.0:1788263476.104051:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263476.104171:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699259904 00000100:00100000:1.0:1788263476.104189:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699259904 00000100:00100000:1.0:1788263476.104254:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 127 00000100:00100000:1.0:1788263476.104264:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff384264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+10:14883:x1875129699259904:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788263476.104423:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff384264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+10:14883:x1875129699259904:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 160us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263476.104432:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 127 00000100:00100000:2.0:1788263476.110996:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263476.111534:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699260032 00000100:00100000:0.0:1788263476.111544:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699260032 00000100:00100000:0.0:1788263476.111637:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 128 00000100:00100000:0.0:1788263476.111647:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+10:14883:x1875129699260032:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788263476.111846:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283949450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+10:14883:x1875129699260032:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 199us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263476.111854:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 128 00000100:00100000:1.0:1788263476.117491:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263476.117575:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699260160 00000100:00100000:3.0:1788263476.117606:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699260160 00000100:00100000:3.0:1788263476.117658:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:3.0:1788263476.117667:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28414a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2385:x1875129699260160:12345-192.168.203.26@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788263476.117701:0:17067:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6218fa09-9d3e-4029-b371-f2f7a141bebe@192.168.203.26@tcp t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:3.0:1788263476.117761:0:17067:0:(genops.c:1385:class_connect()) connect: client 6218fa09-9d3e-4029-b371-f2f7a141bebe, cookie 0x4b1103cba66709b3 00000004:00100000:3.0:1788263476.117784:0:17067:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788263476.117987:0:17067:0:(import.c:65:import_set_state_nolock()) ffff9ff282c76000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788263476.118049:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28414a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+6:2385:x1875129699260160:12345-192.168.203.26@tcp:38:mount.lustre.0 Request processed in 382us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263476.118057:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:0.0:1788263476.118499:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263476.118552:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699260416 00000100:00100000:3.0:1788263476.118557:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699260416 00000100:00100000:3.0:1788263476.118609:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00100000:3.0:1788263476.118614:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2385:x1875129699260416:12345-192.168.203.26@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788263476.118630:0:17066:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 6218fa09-9d3e-4029-b371-f2f7a141bebe@192.168.203.26@tcp t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:3.0:1788263476.118663:0:17066:0:(genops.c:1385:class_connect()) connect: client 6218fa09-9d3e-4029-b371-f2f7a141bebe, cookie 0x4b1103cba66709ba 00000004:00100000:3.0:1788263476.118677:0:17066:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788263476.118802:0:17066:0:(import.c:65:import_set_state_nolock()) ffff9ff282c73000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788263476.118830:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+6:2385:x1875129699260416:12345-192.168.203.26@tcp:38:mount.lustre.0 Request processed in 214us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263476.118836:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00100000:2.0:1788263476.125279:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263476.125359:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263476.125451:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263476.125556:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699260672 00000100:00100000:3.0:1788263476.125567:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699260672 00000100:00100000:3.0:1788263476.125648:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699260288 00000100:00100000:3.0:1788263476.125652:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699260288 00000100:00100000:3.0:1788263476.125676:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:3.0:1788263476.125686:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+7:14858:x1875129699260672:12345-192.168.203.26@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788263476.125722:0:17067:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788263476.125836:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+7:14858:x1875129699260672:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 151us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263476.125857:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:3.0:1788263476.125877:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:3.0:1788263476.125883:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+6:0:x1875129699260288:12345-192.168.203.26@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788263476.125895:0:17067:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788263476.125927:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+6:0:x1875129699260288:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 43us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263476.125934:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00080000:1.0:1788263476.126017:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263476.126888:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699260544 00000100:00100000:0.0:1788263476.126895:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699260544 00000100:00080000:0.0:1788263476.127010:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788263476.127094:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:3.0:1788263476.127112:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+6:0:x1875129699260544:12345-192.168.203.26@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788263476.127138:0:17067:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788263476.127220:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+6:0:x1875129699260544:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 117us (1768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263476.127227:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:0.0:1788263476.129830:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263476.129919:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699260800 00000100:00100000:3.0:1788263476.129927:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699260800 00000100:00100000:3.0:1788263476.130029:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:3.0:1788263476.130039:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+6:14858:x1875129699260800:12345-192.168.203.26@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788263476.130125:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+6:14858:x1875129699260800:12345-192.168.203.26@tcp:40:mount.lustre.0 Request processed in 88us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263476.130132:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:2.0:1788263476.135925:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263476.135969:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263476.136004:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263476.136099:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699260928 00000100:00100000:3.0:1788263476.136109:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699260928 00000100:00100000:3.0:1788263476.136152:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699261056 00000100:00100000:3.0:1788263476.136156:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699261056 00000100:00100000:3.0:1788263476.136201:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:3.0:1788263476.136208:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2385:x1875129699260928:12345-192.168.203.26@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788263476.136243:0:18573:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6218fa09-9d3e-4029-b371-f2f7a141bebe@192.168.203.26@tcp t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:3.0:1788263476.136275:0:18573:0:(genops.c:1385:class_connect()) connect: client 6218fa09-9d3e-4029-b371-f2f7a141bebe, cookie 0x4b1103cba66709c1 00002000:00100000:3.0:1788263476.136288:0:18573:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6218fa09-9d3e-4029-b371-f2f7a141bebe/ffff9ff283212800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788263476.136307:0:18573:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788263476.136474:0:18573:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788263476.136504:0:18573:0:(import.c:65:import_set_state_nolock()) ffff9ff283214800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788263476.136562:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+6:2385:x1875129699260928:12345-192.168.203.26@tcp:8:mount.lustre.0 Request processed in 353us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263476.136569:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:3.0:1788263476.136613:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:3.0:1788263476.136619:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398743100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2385:x1875129699261056:12345-192.168.203.26@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788263476.136636:0:18573:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6218fa09-9d3e-4029-b371-f2f7a141bebe@192.168.203.26@tcp t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:3.0:1788263476.136668:0:18573:0:(genops.c:1385:class_connect()) connect: client 6218fa09-9d3e-4029-b371-f2f7a141bebe, cookie 0x4b1103cba66709c8 00002000:00100000:3.0:1788263476.136674:0:18573:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6218fa09-9d3e-4029-b371-f2f7a141bebe/ffff9ff3bd98b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788263476.136685:0:18573:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788263476.136790:0:18573:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788263476.136806:0:18573:0:(import.c:65:import_set_state_nolock()) ffff9ff3bd98c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788263476.136832:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398743100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+6:2385:x1875129699261056:12345-192.168.203.26@tcp:8:mount.lustre.0 Request processed in 211us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263476.136839:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:1.0:1788263476.138701:0:17077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699261184 00000100:00100000:1.0:1788263476.138711:0:17077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699261184 00000100:00100000:1.0:1788263476.138766:0:17077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:1.0:1788263476.138775:0:17077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6218fa09-9d3e-4029-b371-f2f7a141bebe+6:14858:x1875129699261184:12345-192.168.203.26@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788263476.138843:0:17077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6218fa09-9d3e-4029-b371-f2f7a141bebe+6:14858:x1875129699261184:12345-192.168.203.26@tcp:900:mount.lustre.0 Request processed in 69us (2927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263476.138850:0:17077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:2.0:1788263476.141491:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263476.141623:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699261312 00000100:00100000:1.0:1788263476.141632:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699261312 00000100:00100000:1.0:1788263476.141678:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:1.0:1788263476.141687:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28398b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+6:14858:x1875129699261312:12345-192.168.203.26@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788263476.146335:0:17068:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4573us 00000004:00200000:3.0:1788263476.169266:0:17068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788263476.169449:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28398b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+6:14858:x1875129699261312:12345-192.168.203.26@tcp:33:mount.lustre.0 Request processed in 27747us (27950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263476.169476:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:0.0:1788263476.364959:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263476.365378:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699261440 00000100:00100000:3.0:1788263476.365388:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699261440 00000100:00100000:3.0:1788263476.365451:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:3.0:1788263476.365462:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6218fa09-9d3e-4029-b371-f2f7a141bebe+6:14906:x1875129699261440:12345-192.168.203.26@tcp:101:mkdir.0 00010000:00010000:3.0:1788263476.365483:0:18294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263476.365507:0:18294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764a00/0x4b1103cba66709cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170222 expref: -99 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263476.365573:0:18294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba66709d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263476.365627:0:18294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba66709d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263476.365642:0:18294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba66709d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263476.365687:0:18294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788263476.365691:0:18294:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788263476.365746:0:18294:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba66709d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263476.365782:0:18294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764a00/0x4b1103cba66709cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170222 expref: 8 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263476.365802:0:18294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba66709d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170222 expref: 7 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263476.365823:0:18294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff28212b300) 00010000:00010000:3.0:1788263476.365826:0:18294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788263476.365830:0:18294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae765400, rc 0) 00000100:00100000:3.0:1788263476.365895:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6218fa09-9d3e-4029-b371-f2f7a141bebe+7:14906:x1875129699261440:12345-192.168.203.26@tcp:101:mkdir.0 Request processed in 435us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263476.365903:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 13 00010000:00010000:3.0:1788263476.464782:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263476.784284:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709831936:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788263476.784365:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263476.784436:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788263476.784443:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28414b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709831808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788263476.784466:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263476.784604:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709831936 00000100:00100000:0.0:1788263476.784612:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709831936 00000100:00100000:0.0:1788263476.784659:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709831808 00000100:00100000:0.0:1788263476.784662:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709831808 00000100:00100000:0.0:1788263476.784678:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788263476.784687:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709831936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788263476.784708:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788263476.784769:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709831936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263476.784776:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788263476.784792:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788263476.784799:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709831808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788263476.784809:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788263476.784837:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709831808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263476.784843:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788263476.784897:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28414b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709831808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263476.784910:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709831936:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788263476.785267:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788263476.785272:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788263476.785690:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788263476.785703:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28414b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709832064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263476.785766:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263476.785937:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709832064 00000100:00100000:1.0:1788263476.785943:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709832064 00000100:00100000:1.0:1788263476.785989:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788263476.785997:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709832064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788263476.786024:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788263476.786064:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709832064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263476.786070:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788263476.786116:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28414b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709832064:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788263476.786234:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788263476.787515:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fb36e90-c209-4884-91f2-1155be4ad295:3621:1875129709832192:0@lo:400:kworker.0 00000100:00100000:2.0:1788263476.787574:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263476.787623:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709832704:0@lo:400:kworker.0 00000100:00100000:2.0:1788263476.787649:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263476.787664:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875129709833216:0@lo:400:kworker.0 00000100:00100000:2.0:1788263476.787686:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263476.787709:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788263476.787714:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709832576:0@lo:400:kworker.0 00000100:00100000:1.0:1788263476.787952:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709832448:0@lo:400:kworker.0 00000100:00100000:1.0:1788263476.787981:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263476.787998:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875129709832960:0@lo:400:kworker.0 00000100:00100000:1.0:1788263476.788029:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263476.788047:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788263476.788052:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709832320:0@lo:400:kworker.0 00000100:00100000:1.0:1788263476.788074:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263476.788093:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709832832:0@lo:400:kworker.0 00000100:00100000:1.0:1788263476.788113:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263476.788128:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709833344:0@lo:400:kworker.0 00000100:00100000:1.0:1788263476.788148:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263476.788172:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709832320 00000100:00100000:1.0:1788263476.788188:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709832320 00000100:00100000:1.0:1788263476.788230:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788263476.788238:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709832320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263476.788289:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709832320:12345-0@lo:400:kworker.0 Request processed in 50us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263476.788296:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788263476.788331:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709832320:0@lo:400:kworker.0 00000100:00100000:1.0:1788263476.788355:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709833216 00000100:00100000:1.0:1788263476.788359:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709833216 00000100:00100000:1.0:1788263476.788386:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709832448 00000100:00100000:1.0:1788263476.788388:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709832448 00000100:00100000:1.0:1788263476.788397:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709832960 00000100:00100000:1.0:1788263476.788399:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709832960 00000100:00100000:1.0:1788263476.788421:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709832832 00000100:00100000:1.0:1788263476.788424:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709832832 00000100:00100000:1.0:1788263476.788432:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709833344 00000100:00100000:1.0:1788263476.788434:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709833344 00000100:00100000:1.0:1788263476.788447:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788263476.788452:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875129709833216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263476.788484:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875129709833216:12345-0@lo:400:kworker.0 Request processed in 32us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263476.788490:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788263476.788514:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788263476.788521:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28414b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709832448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263476.788550:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28414b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709832448:12345-0@lo:400:kworker.0 Request processed in 30us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263476.788556:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788263476.788567:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788263476.788573:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875129709832960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263476.788622:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875129709832960:12345-0@lo:400:kworker.0 Request processed in 50us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263476.788628:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788263476.788638:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788263476.788644:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff284149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709832832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263476.788667:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff284149f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875129709832832:12345-0@lo:400:kworker.0 Request processed in 23us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263476.788672:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788263476.788682:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788263476.788688:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28414a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875129709833344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263476.788728:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28414a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875129709833344:12345-0@lo:400:kworker.0 Request processed in 41us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263476.788734:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788263476.788981:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263476.789004:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875129709833088:0@lo:400:kworker.0 00000100:00100000:2.0:1788263476.789152:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263476.789184:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875129709833216:0@lo:400:kworker.0 00000100:00100000:2.0:1788263476.789213:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709832192 00000100:00100000:2.0:1788263476.789217:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709832192 00000100:00100000:2.0:1788263476.789248:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788263476.789254:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+24:3621:x1875129709832192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263476.789288:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+24:3621:x1875129709832192:12345-0@lo:400:kworker.0 Request processed in 34us (1716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263476.789294:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788263476.789316:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709833088 00000100:00100000:2.0:1788263476.789319:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709833088 00000100:00100000:3.0:1788263476.789528:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709832704 00000100:00100000:3.0:1788263476.789533:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709832704 00000100:00100000:3.0:1788263476.789562:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788263476.789569:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709832704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263476.789620:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709832704:12345-0@lo:400:kworker.0 Request processed in 52us (1971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263476.789626:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788263476.789663:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788263476.789666:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788263476.789668:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263476.789675:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709832576 00000100:00100000:3.0:1788263476.789678:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709832576 00000100:00100000:3.0:1788263476.789693:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788263476.789697:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709832576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263476.789723:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709832576:12345-0@lo:400:kworker.0 Request processed in 26us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263476.789728:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788263476.790113:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709832576:0@lo:400:kworker.0 00000100:00100000:3.0:1788263476.790124:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fb36e90-c209-4884-91f2-1155be4ad295:3621:1875129709832192:0@lo:400:kworker.0 00000100:00100000:3.0:1788263476.790147:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709832704:0@lo:400:kworker.0 00000100:00100000:1.0:1788263476.790698:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875129709832832:0@lo:400:kworker.0 00010000:00080000:1.0:1788263476.790713:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28381e300 x1875129709833344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263476.790724:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1875129709833344:0@lo:400:kworker.0 00000100:00080000:3.0:1788263476.791221:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788263476.791441:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788263476.791452:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875129709833088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263476.791904:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709832448:0@lo:400:kworker.0 00000100:00100000:1.0:1788263476.791933:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875129709832960:0@lo:400:kworker.0 00000100:00100000:2.0:1788263476.792149:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875129709833088:12345-0@lo:400:kworker.0 Request processed in 700us (2996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263476.792157:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788263476.792436:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28381c380 x1875129709833088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263476.792448:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875129709833088:0@lo:400:kworker.0 00010000:00010000:2.0:1788263477.488057:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263477.813157:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788263477.813188:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28414b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709833472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788263477.813256:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263477.813301:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709833472 00000100:00100000:1.0:1788263477.813308:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709833472 00000100:00100000:1.0:1788263477.813352:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788263477.813361:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28414b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709833472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788263477.813393:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788263477.813437:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28414b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709833472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263477.813444:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788263477.813485:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28414b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709833472:0@lo:13:osp-pre-0-1.0 00000001:00100000:2.0:1788263477.816909:0:19385:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6218fa09-9d3e-4029-b371-f2f7a141bebe 00000001:00100000:3.0:1788263477.817046:0:18568:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6218fa09-9d3e-4029-b371-f2f7a141bebe 00000100:00100000:1.0:1788263478.478087:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263478.478300:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699261568 00000100:00100000:3.0:1788263478.478310:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699261568 00000100:00100000:3.0:1788263478.478383:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:3.0:1788263478.478394:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28414b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6218fa09-9d3e-4029-b371-f2f7a141bebe+7:14959:x1875129699261568:12345-192.168.203.26@tcp:41:lfs.0 00000004:00000024:3.0:1788263478.478429:0:18294:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788263478.478517:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28414b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6218fa09-9d3e-4029-b371-f2f7a141bebe+7:14959:x1875129699261568:12345-192.168.203.26@tcp:41:lfs.0 Request processed in 126us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263478.478525:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00080000:2.0:1788263478.478709:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263478.481713:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263478.481887:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699261696 00000100:00100000:0.0:1788263478.481896:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699261696 00000100:00100000:0.0:1788263478.481976:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00100000:0.0:1788263478.481987:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+6:14959:x1875129699261696:12345-192.168.203.26@tcp:41:lfs.0 00000004:00000024:0.0:1788263478.482034:0:17065:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788263478.482274:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+6:14959:x1875129699261696:12345-192.168.203.26@tcp:41:lfs.0 Request processed in 289us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263478.482283:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00080000:2.0:1788263478.482480:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788263478.486390:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263478.486519:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699261824 00000100:00100000:1.0:1788263478.486533:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699261824 00000100:00100000:1.0:1788263478.486688:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:1.0:1788263478.486700:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6218fa09-9d3e-4029-b371-f2f7a141bebe+5:14959:x1875129699261824:12345-192.168.203.26@tcp:13:lfs.0 00002000:00000024:1.0:1788263478.486743:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788263478.486867:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6218fa09-9d3e-4029-b371-f2f7a141bebe+5:14959:x1875129699261824:12345-192.168.203.26@tcp:13:lfs.0 Request processed in 169us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263478.486875:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00080000:2.0:1788263478.487113:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263478.490978:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263478.493930:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699261952 00000100:00100000:2.0:1788263478.493951:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699261952 00000100:00100000:2.0:1788263478.494083:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:2.0:1788263478.494097:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28414aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6218fa09-9d3e-4029-b371-f2f7a141bebe+5:14959:x1875129699261952:12345-192.168.203.26@tcp:13:lfs.0 00002000:00000024:2.0:1788263478.494140:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788263478.494804:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28414aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6218fa09-9d3e-4029-b371-f2f7a141bebe+5:14959:x1875129699261952:12345-192.168.203.26@tcp:13:lfs.0 Request processed in 706us (3834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263478.494815:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00080000:3.0:1788263478.495983:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788263478.513898:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263478.717840:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263478.717959:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699262080 00000100:00100000:1.0:1788263478.717972:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699262080 00000100:00100000:1.0:1788263478.718047:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 130 00000100:00100000:1.0:1788263478.718060:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+10:14992:x1875129699262080:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788263478.718083:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263478.718106:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff2823ec400/0x4b1103cba66709dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xd405f293d1170229 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263478.718143:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff2823ec400/0x4b1103cba66709dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170229 expref: 11 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263478.718155:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff2823ec400/0x4b1103cba66709dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170229 expref: 11 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263478.718178:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff2823ec400, rc 0) 00000100:00100000:1.0:1788263478.718256:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+11:14992:x1875129699262080:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 198us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263478.718264:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 130 00000100:00100000:0.0:1788263478.729340:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263478.729543:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699262208 00000100:00100000:3.0:1788263478.729558:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699262208 00000100:00100000:3.0:1788263478.729673:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 131 00000100:00100000:3.0:1788263478.729687:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+11:14992:x1875129699262208:12345-192.168.203.26@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788263478.730043:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+11:14992:x1875129699262208:12345-192.168.203.26@tcp:501:mount.lustre.0 Request processed in 357us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263478.730052:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 131 00000100:00100000:0.0:1788263478.737147:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263478.737281:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699262336 00000100:00100000:2.0:1788263478.737295:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699262336 00000100:00100000:2.0:1788263478.737371:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 132 00000100:00100000:2.0:1788263478.737384:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+11:14992:x1875129699262336:12345-192.168.203.26@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788263478.737624:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+11:14992:x1875129699262336:12345-192.168.203.26@tcp:503:mount.lustre.0 Request processed in 241us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263478.737633:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 132 00000100:00100000:0.0:1788263478.746768:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263478.747211:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699262464 00000100:00100000:3.0:1788263478.747226:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699262464 00000100:00100000:3.0:1788263478.747304:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 133 00000100:00100000:3.0:1788263478.747317:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+11:14998:x1875129699262464:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788263478.747544:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+11:14998:x1875129699262464:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 228us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263478.747560:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 133 00000040:00080000:1.0:1788263478.768334:0:17101:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788263478.792765:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263478.792876:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699262592 00000100:00100000:1.0:1788263478.792907:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699262592 00000100:00100000:1.0:1788263478.792983:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 134 00000100:00100000:1.0:1788263478.792995:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+11:14998:x1875129699262592:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788263478.793197:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+11:14998:x1875129699262592:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 203us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263478.793205:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 134 00000100:00100000:0.0:1788263478.797334:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263478.797652:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699262720 00000100:00100000:2.0:1788263478.797665:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699262720 00000100:00100000:2.0:1788263478.797750:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 135 00000100:00100000:2.0:1788263478.797760:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+11:14998:x1875129699262720:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788263478.797939:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+11:14998:x1875129699262720:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 179us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263478.797947:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 135 00000100:00100000:0.0:1788263478.803551:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263478.803761:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699262848 00000100:00100000:3.0:1788263478.803774:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699262848 00000100:00100000:3.0:1788263478.803844:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 136 00000100:00100000:3.0:1788263478.803858:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+11:14992:x1875129699262848:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788263478.803880:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263478.803904:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3ae764a00/0x4b1103cba66709e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd405f293d117025a expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263478.803943:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3ae764a00/0x4b1103cba66709e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117025a expref: 12 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263478.803957:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3ae764a00/0x4b1103cba66709e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117025a expref: 12 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263478.803967:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae764a00, rc 0) 00000100:00100000:3.0:1788263478.804054:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+12:14992:x1875129699262848:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 200us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263478.804063:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 136 00000100:00100000:0.0:1788263478.808477:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263478.809529:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699262976 00000100:00100000:1.0:1788263478.809544:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699262976 00000100:00100000:1.0:1788263478.809672:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 137 00000100:00100000:1.0:1788263478.809683:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2832be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+12:14992:x1875129699262976:12345-192.168.203.26@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788263478.809715:0:17058:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788263478.809743:0:17058:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788263478.809748:0:17058:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788263478.809751:0:17058:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788263478.809754:0:17058:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788263478.809757:0:17058:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1788263478.816702:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2832be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+12:14992:x1875129699262976:12345-192.168.203.26@tcp:256:mount.lustre.0 Request processed in 7004us (8221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263478.816721:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 137 00000100:00100000:0.0:1788263478.819770:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263478.819881:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699263104 00000100:00100000:2.0:1788263478.819894:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699263104 00000100:00100000:2.0:1788263478.819963:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 138 00000100:00100000:2.0:1788263478.819975:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+12:14992:x1875129699263104:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788263478.819996:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263478.820032:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3bf6d1000/0x4b1103cba66709eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd405f293d1170261 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263478.820065:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3bf6d1000/0x4b1103cba66709eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170261 expref: 13 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263478.820077:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3bf6d1000/0x4b1103cba66709eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170261 expref: 13 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263478.820087:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d1000, rc 0) 00000100:00100000:2.0:1788263478.820203:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+13:14992:x1875129699263104:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 230us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263478.820211:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 138 00000100:00100000:0.0:1788263478.825746:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263478.826539:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699263232 00000100:00100000:1.0:1788263478.826554:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699263232 00000100:00100000:1.0:1788263478.826669:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 139 00000100:00100000:1.0:1788263478.826682:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+13:14992:x1875129699263232:12345-192.168.203.26@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788263478.826889:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+13:14992:x1875129699263232:12345-192.168.203.26@tcp:501:mount.lustre.0 Request processed in 208us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263478.826899:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 139 00000100:00100000:0.0:1788263478.830805:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263478.830917:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699263360 00000100:00100000:3.0:1788263478.830930:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699263360 00000100:00100000:3.0:1788263478.831070:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 140 00000100:00100000:3.0:1788263478.831084:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+13:14992:x1875129699263360:12345-192.168.203.26@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788263478.831284:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+13:14992:x1875129699263360:12345-192.168.203.26@tcp:503:mount.lustre.0 Request processed in 203us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263478.831294:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 140 00000100:00100000:2.0:1788263478.833567:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709833600:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788263478.833670:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263478.833737:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709833600 00000100:00100000:2.0:1788263478.833746:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709833600 00000100:00100000:2.0:1788263478.833821:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788263478.833831:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709833600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788263478.833866:0:17070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788263478.833917:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709833600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263478.833925:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788263478.833979:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709833600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788263478.837305:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709833728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788263478.837415:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263478.838905:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709833728 00000100:00100000:3.0:1788263478.838923:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709833728 00000100:00100000:3.0:1788263478.839010:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788263478.839023:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709833728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788263478.839063:0:17070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788263478.839157:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709833728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (1741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263478.839175:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788263478.839797:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263478.840265:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699263488 00000100:00100000:3.0:1788263478.840274:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699263488 00000100:00100000:3.0:1788263478.840325:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 141 00000100:00100000:3.0:1788263478.840335:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+13:15000:x1875129699263488:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788263478.840634:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+13:15000:x1875129699263488:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 299us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263478.840643:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 141 00000100:00100000:0.0:1788263478.843487:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709833728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788263478.849823:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263478.849927:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699263616 00000100:00100000:1.0:1788263478.849941:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699263616 00000100:00100000:1.0:1788263478.850011:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 142 00000100:00100000:1.0:1788263478.850021:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+13:15000:x1875129699263616:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788263478.850228:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+13:15000:x1875129699263616:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 207us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263478.850237:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 142 00000100:00100000:3.0:1788263478.865015:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263478.865072:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263478.865431:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699263744 00000100:00100000:0.0:1788263478.865445:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699263744 00000100:00100000:0.0:1788263478.865499:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699264000 00000100:00100000:0.0:1788263478.865503:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699264000 00000100:00100000:0.0:1788263478.865535:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:0.0:1788263478.865545:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2385:x1875129699263744:12345-192.168.203.26@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788263478.865617:0:18294:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6cba8b7b-8f99-4a54-a27b-6ee8a0068215@192.168.203.26@tcp t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:0.0:1788263478.865671:0:18294:0:(genops.c:1385:class_connect()) connect: client 6cba8b7b-8f99-4a54-a27b-6ee8a0068215, cookie 0x4b1103cba66709f2 00000004:00100000:0.0:1788263478.865704:0:18294:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788263478.865822:0:18294:0:(import.c:65:import_set_state_nolock()) ffff9ff282f61000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263478.865913:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:2385:x1875129699263744:12345-192.168.203.26@tcp:38:mount.lustre.0 Request processed in 367us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263478.865921:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:0.0:1788263478.865942:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:0.0:1788263478.865948:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2385:x1875129699264000:12345-192.168.203.26@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788263478.865965:0:18294:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 6cba8b7b-8f99-4a54-a27b-6ee8a0068215@192.168.203.26@tcp t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:0.0:1788263478.865990:0:18294:0:(genops.c:1385:class_connect()) connect: client 6cba8b7b-8f99-4a54-a27b-6ee8a0068215, cookie 0x4b1103cba66709f9 00000004:00100000:0.0:1788263478.866354:0:18294:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788263478.866416:0:18294:0:(import.c:65:import_set_state_nolock()) ffff9ff282f63000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263478.866457:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:2385:x1875129699264000:12345-192.168.203.26@tcp:38:mount.lustre.0 Request processed in 507us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263478.866484:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:3.0:1788263478.878728:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263478.878833:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699264256 00000100:00100000:0.0:1788263478.878847:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699264256 00000100:00100000:0.0:1788263478.878936:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:0.0:1788263478.878947:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:14992:x1875129699264256:12345-192.168.203.26@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788263478.878986:0:17065:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788263478.879086:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:14992:x1875129699264256:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 141us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263478.879093:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00080000:3.0:1788263478.880527:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263478.880916:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263478.881002:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699264384 00000100:00100000:2.0:1788263478.881013:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699264384 00000100:00100000:2.0:1788263478.881066:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:2.0:1788263478.881076:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:14992:x1875129699264384:12345-192.168.203.26@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788263478.881157:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:14992:x1875129699264384:12345-192.168.203.26@tcp:40:mount.lustre.0 Request processed in 82us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263478.881179:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:2.0:1788263478.883180:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263478.883290:0:17077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699264768 00000100:00100000:1.0:1788263478.883300:0:17077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699264768 00000100:00100000:1.0:1788263478.883363:0:17077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:1.0:1788263478.883372:0:17077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:14992:x1875129699264768:12345-192.168.203.26@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788263478.885762:0:17077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:14992:x1875129699264768:12345-192.168.203.26@tcp:900:mount.lustre.0 Request processed in 2372us (2584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263478.885778:0:17077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:2.0:1788263478.888358:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263478.888601:0:19151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699264512 00000100:00100000:0.0:1788263478.888615:0:19151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699264512 00000100:00100000:0.0:1788263478.888717:0:19151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:0.0:1788263478.888727:0:19151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2385:x1875129699264512:12345-192.168.203.26@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788263478.888774:0:19151:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6cba8b7b-8f99-4a54-a27b-6ee8a0068215@192.168.203.26@tcp t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:0.0:1788263478.888821:0:19151:0:(genops.c:1385:class_connect()) connect: client 6cba8b7b-8f99-4a54-a27b-6ee8a0068215, cookie 0x4b1103cba6670a00 00002000:00100000:0.0:1788263478.888837:0:19151:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6cba8b7b-8f99-4a54-a27b-6ee8a0068215/ffff9ff28383c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788263478.888851:0:19151:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788263478.889042:0:19151:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788263478.889086:0:19151:0:(import.c:65:import_set_state_nolock()) ffff9ff39ab1d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263478.889246:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263478.889459:0:19604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699264640 00000100:00100000:1.0:1788263478.889466:0:19604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699264640 00000100:00100000:1.0:1788263478.889502:0:19604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:1.0:1788263478.889509:0:19604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2385:x1875129699264640:12345-192.168.203.26@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788263478.889535:0:19604:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6cba8b7b-8f99-4a54-a27b-6ee8a0068215@192.168.203.26@tcp t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:1.0:1788263478.889559:0:19604:0:(genops.c:1385:class_connect()) connect: client 6cba8b7b-8f99-4a54-a27b-6ee8a0068215, cookie 0x4b1103cba6670a07 00002000:00100000:1.0:1788263478.889566:0:19604:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6cba8b7b-8f99-4a54-a27b-6ee8a0068215/ffff9ff2833d0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788263478.889575:0:19604:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788263478.889660:0:19604:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788263478.889690:0:19604:0:(import.c:65:import_set_state_nolock()) ffff9ff2833d6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788263478.889744:0:19604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:2385:x1875129699264640:12345-192.168.203.26@tcp:8:mount.lustre.0 Request processed in 233us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263478.889752:0:19604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:2.0:1788263478.890174:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263478.890249:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263478.890280:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699264128 00000100:00100000:2.0:1788263478.890284:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699264128 00000100:00100000:2.0:1788263478.890328:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699263872 00000100:00100000:2.0:1788263478.890331:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699263872 00000100:00100000:2.0:1788263478.890352:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:2.0:1788263478.890361:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:0:x1875129699264128:12345-192.168.203.26@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788263478.890398:0:18294:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788263478.890450:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:0:x1875129699264128:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 90us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263478.890456:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:2.0:1788263478.890471:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:2.0:1788263478.890478:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:0:x1875129699263872:12345-192.168.203.26@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788263478.890492:0:18294:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788263478.890519:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:0:x1875129699263872:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 42us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263478.890525:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00080000:2.0:1788263478.890544:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788263478.894449:0:19151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:2385:x1875129699264512:12345-192.168.203.26@tcp:8:mount.lustre.0 Request processed in 5702us (6086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263478.894469:0:19151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:3.0:1788263478.894810:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263478.895036:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699264896 00000100:00100000:2.0:1788263478.895049:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699264896 00000100:00100000:2.0:1788263478.895152:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1 00000100:00100000:2.0:1788263478.895174:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:14992:x1875129699264896:12345-192.168.203.26@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788263478.895487:0:17069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788263478.895625:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:14992:x1875129699264896:12345-192.168.203.26@tcp:33:mount.lustre.0 Request processed in 463us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263478.895633:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1 00000100:00100000:0.0:1788263479.044286:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263479.044638:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699265024 00000100:00100000:2.0:1788263479.044653:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699265024 00000100:00100000:2.0:1788263479.044736:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:2.0:1788263479.044750:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:15023:x1875129699265024:12345-192.168.203.26@tcp:101:mkdir.0 00010000:00010000:2.0:1788263479.044776:0:18294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263479.044809:0:18294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba6670a0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170292 expref: -99 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263479.044922:0:18294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba6670a15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263479.044938:0:18294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba6670a15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263479.044954:0:18294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba6670a15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263479.045019:0:18294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788263479.045023:0:18294:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788263479.045049:0:18294:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba6670a15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263479.045081:0:18294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1a00/0x4b1103cba6670a0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170292 expref: 8 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263479.045103:0:18294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba6670a15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170292 expref: 7 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263479.045113:0:18294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff28212b300) 00010000:00010000:2.0:1788263479.045116:0:18294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788263479.045120:0:18294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d1800, rc 0) 00000100:00100000:2.0:1788263479.045217:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+7:15023:x1875129699265024:12345-192.168.203.26@tcp:101:mkdir.0 Request processed in 469us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263479.045225:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 22 00010000:00010000:2.0:1788263479.535757:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788263479.728352:0:17817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788263480.562649:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263481.583721:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263481.915046:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fb36e90-c209-4884-91f2-1155be4ad295:3618:1875129709833856:0@lo:400:kworker.0 00000100:00100000:1.0:1788263481.915171:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263481.915249:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709834368:0@lo:400:kworker.0 00000100:00100000:1.0:1788263481.915283:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263481.915322:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709834880:0@lo:400:kworker.0 00000100:00100000:1.0:1788263481.915345:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263481.915381:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709835392:0@lo:400:kworker.0 00000100:00100000:1.0:1788263481.915935:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263481.916036:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788263481.916048:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709833984:0@lo:400:kworker.0 00000100:00100000:1.0:1788263481.916083:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263481.916106:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709834496:0@lo:400:kworker.0 00000100:00100000:1.0:1788263481.916127:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263481.916155:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709835008:0@lo:400:kworker.0 00000100:00100000:1.0:1788263481.916177:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263481.916223:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709834240:0@lo:400:kworker.0 00000100:00100000:1.0:1788263481.916251:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263481.916272:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709834752:0@lo:400:kworker.0 00000100:00100000:1.0:1788263481.916291:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263481.916308:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875129709835264:0@lo:400:kworker.0 00000100:00100000:1.0:1788263481.916330:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263481.917133:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788263481.917163:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709834112:0@lo:400:kworker.0 00000100:00100000:1.0:1788263481.917216:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263481.917221:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709834368 00000100:00100000:2.0:1788263481.917238:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709834368 00000100:00100000:1.0:1788263481.917248:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709834624:0@lo:400:kworker.0 00000100:00100000:1.0:1788263481.917284:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263481.917310:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709834880 00000100:00100000:1.0:1788263481.917316:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875129709835136:0@lo:400:kworker.0 00000100:00100000:2.0:1788263481.917318:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709834880 00000100:00100000:2.0:1788263481.917353:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709835392 00000100:00100000:2.0:1788263481.917358:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709835392 00000100:00100000:2.0:1788263481.917390:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709835008 00000100:00100000:2.0:1788263481.917392:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709835008 00000100:00100000:2.0:1788263481.917404:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709835264 00000100:00100000:2.0:1788263481.917406:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709835264 00000100:00100000:2.0:1788263481.917510:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788263481.917520:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709834368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263481.917637:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875129709834368:12345-0@lo:400:kworker.0 Request processed in 118us (2353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263481.917645:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788263481.917667:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788263481.917676:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709834880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263481.917710:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875129709834880:12345-0@lo:400:kworker.0 Request processed in 37us (2364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263481.917715:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788263481.917730:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788263481.917740:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875129709835392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263481.917775:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875129709835392:12345-0@lo:400:kworker.0 Request processed in 39us (1842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263481.917781:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788263481.917792:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788263481.917798:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709835008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263481.917823:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709835008:12345-0@lo:400:kworker.0 Request processed in 26us (1645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263481.917843:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788263481.917855:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788263481.917861:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875129709835264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263481.917893:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875129709835264:12345-0@lo:400:kworker.0 Request processed in 33us (1562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263481.917899:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788263481.917958:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709835648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263481.917993:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263481.918789:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263481.918858:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875129709835264:0@lo:400:kworker.0 00000100:00100000:1.0:1788263481.918937:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709833856 00000100:00100000:1.0:1788263481.918944:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709833856 00000100:00100000:1.0:1788263481.919006:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788263481.919015:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+24:3618:x1875129709833856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263481.919069:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+24:3618:x1875129709833856:12345-0@lo:400:kworker.0 Request processed in 56us (3899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263481.919077:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788263481.919116:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709835136 00000100:00100000:1.0:1788263481.919121:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709835136 00000100:00080000:2.0:1788263481.919159:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263481.919168:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1788263481.919173:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788263481.919182:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875129709835136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263481.919199:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709835648 00000100:00100000:2.0:1788263481.919209:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709835648 00000100:00100000:1.0:1788263481.919223:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875129709835136:12345-0@lo:400:kworker.0 Request processed in 45us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263481.919232:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788263481.919283:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709833984 00000100:00100000:2.0:1788263481.919288:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788263481.919290:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709833984 00000100:00100000:2.0:1788263481.919302:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709835648:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263481.919320:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709834496 00000100:00100000:1.0:1788263481.919326:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709834496 00002000:00000024:2.0:1788263481.919336:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788263481.919349:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788263481.919397:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709835648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263481.919404:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788263481.919948:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709835648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263481.919970:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788263481.919979:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2838cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709835776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788263481.920015:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263481.920810:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709833984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263481.920890:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709833984:12345-0@lo:400:kworker.0 Request processed in 91us (4807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263481.920899:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788263481.920931:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788263481.920938:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709834496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263481.920969:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709834496:12345-0@lo:400:kworker.0 Request processed in 32us (4841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263481.920975:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788263481.921028:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709834240 00000100:00100000:1.0:1788263481.921035:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709834240 00000100:00100000:1.0:1788263481.921078:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709834752 00000100:00100000:1.0:1788263481.921081:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709834752 00000100:00100000:1.0:1788263481.921099:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709834112 00000100:00100000:1.0:1788263481.921102:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709834112 00000100:00100000:1.0:1788263481.921117:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709834624 00000100:00100000:1.0:1788263481.921120:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709834624 00000100:00100000:1.0:1788263481.921135:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788263481.921153:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709834240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263481.921189:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709834240:12345-0@lo:400:kworker.0 Request processed in 48us (4937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263481.921196:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788263481.921208:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788263481.921213:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709834752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263481.921243:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709834752:12345-0@lo:400:kworker.0 Request processed in 30us (4950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263481.921249:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788263481.921270:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788263481.921278:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709834112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263481.921324:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709834112:12345-0@lo:400:kworker.0 Request processed in 48us (4107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263481.921331:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788263481.921349:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788263481.921370:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263481.921373:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709834624:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788263481.921380:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788263481.925114:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709834624:12345-0@lo:400:kworker.0 Request processed in 3729us (7814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263481.925133:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788263481.926119:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709835520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788263481.926205:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263481.931327:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709833984:0@lo:400:kworker.0 00000100:00100000:0.0:1788263481.932163:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709834496:0@lo:400:kworker.0 00000100:00100000:0.0:1788263481.932181:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709835008:0@lo:400:kworker.0 00000100:00100000:0.0:1788263481.932193:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fb36e90-c209-4884-91f2-1155be4ad295:3618:1875129709833856:0@lo:400:kworker.0 00000100:00100000:0.0:1788263481.932207:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875129709834368:0@lo:400:kworker.0 00000100:00100000:0.0:1788263481.932221:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875129709834880:0@lo:400:kworker.0 00010000:00080000:0.0:1788263481.932248:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28312e680 x1875129709835392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263481.932260:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1875129709835392:0@lo:400:kworker.0 00000100:00100000:0.0:1788263481.932774:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709834112:0@lo:400:kworker.0 00000100:00100000:0.0:1788263481.932797:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709834624:0@lo:400:kworker.0 00010000:00080000:0.0:1788263481.932812:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff28312f100 x1875129709835136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263481.932823:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1875129709835136:0@lo:400:kworker.0 00000100:00100000:0.0:1788263481.932838:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709834240:0@lo:400:kworker.0 00000100:00100000:0.0:1788263481.932851:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709834752:0@lo:400:kworker.0 00000001:00100000:0.0:1788263481.939155:0:17798:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6cba8b7b-8f99-4a54-a27b-6ee8a0068215 00000001:00100000:0.0:1788263481.939170:0:17798:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6218fa09-9d3e-4029-b371-f2f7a141bebe 00000100:00100000:2.0:1788263481.940198:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709835776 00000100:00100000:2.0:1788263481.940279:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709835776 00000100:00100000:2.0:1788263481.940332:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709835520 00000100:00100000:2.0:1788263481.940335:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709835520 00000100:00100000:2.0:1788263481.940351:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788263481.940361:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709835776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788263481.940392:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788263481.940464:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709835776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (20449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263481.940471:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788263481.940486:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788263481.940492:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709835520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788263481.940500:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788263481.940523:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709835520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (14319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263481.940528:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788263481.944178:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2838cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709835776:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788263481.945243:0:17045:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6cba8b7b-8f99-4a54-a27b-6ee8a0068215 00000001:00100000:3.0:1788263481.945252:0:17045:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6218fa09-9d3e-4029-b371-f2f7a141bebe 00000100:00100000:1.0:1788263481.949288:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709835520:0@lo:13:osp-pre-1-1.0 00000001:02000400:1.0:1788263482.110475:0:19944:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788263482.608201:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263482.943314:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788263482.943337:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709835904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788263482.943421:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263482.943676:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709835904 00000100:00100000:2.0:1788263482.943684:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709835904 00000100:00100000:1.0:1788263482.943947:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788263482.943958:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709835904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788263482.943990:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788263482.944043:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709835904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263482.944050:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788263482.944094:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709835904:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788263483.634508:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263483.951804:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263483.951826:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709836032:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788263483.951889:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263483.951950:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709836032 00000100:00100000:0.0:1788263483.951957:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709836032 00000100:00100000:0.0:1788263483.952000:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788263483.952010:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709836032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788263483.952042:0:17070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788263483.952086:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709836032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263483.952093:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788263483.952149:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709836032:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788263483.952233:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709836160:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788263483.952262:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263483.952288:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709836160 00000100:00100000:2.0:1788263483.952291:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709836160 00000100:00100000:2.0:1788263483.952312:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788263483.952317:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709836160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788263483.952332:0:17070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788263483.952359:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709836160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 42us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263483.952365:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788263483.952396:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709836160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788263484.019216:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263484.019274:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263484.019308:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263484.019332:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263484.019354:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263484.019376:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263484.019395:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263484.019416:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263484.019441:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263484.019472:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699265408 00000100:00100000:3.0:1788263484.019481:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699265408 00000100:00100000:3.0:1788263484.019530:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699265920 00000100:00100000:3.0:1788263484.019534:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699265920 00000100:00100000:3.0:1788263484.019546:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699265280 00000100:00100000:3.0:1788263484.019548:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699265280 00000100:00100000:3.0:1788263484.019557:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699265792 00000100:00100000:3.0:1788263484.019559:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699265792 00000100:00100000:3.0:1788263484.019573:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 40 00000100:00100000:3.0:1788263484.019608:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+5:2387:x1875129699265408:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263484.019675:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+5:2387:x1875129699265408:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 70us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263484.019683:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 40 00000100:00100000:3.0:1788263484.019698:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:3.0:1788263484.019704:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+5:2387:x1875129699265920:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263484.019857:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699265152 00000100:00100000:2.0:1788263484.019862:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699265152 00000100:00100000:2.0:1788263484.019894:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 144 00000100:00100000:2.0:1788263484.019902:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+13:2387:x1875129699265152:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263484.019929:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+13:2387:x1875129699265152:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 29us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263484.019936:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 144 00000100:00100000:3.0:1788263484.019997:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+5:2387:x1875129699265920:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 293us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263484.020004:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:3.0:1788263484.020031:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:3.0:1788263484.020039:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+6:2387:x1875129699265280:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263484.020063:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+6:2387:x1875129699265280:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 28us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263484.020069:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:3.0:1788263484.020079:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 43 00000100:00100000:3.0:1788263484.020084:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:2387:x1875129699265792:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263484.020102:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:2387:x1875129699265792:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 18us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263484.020107:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 43 00000100:00100000:3.0:1788263484.020124:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699265664 00000100:00100000:3.0:1788263484.020140:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699265664 00000100:00100000:3.0:1788263484.020173:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699266176 00000100:00100000:3.0:1788263484.020177:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699266176 00000100:00100000:3.0:1788263484.020190:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699265536 00000100:00100000:3.0:1788263484.020193:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699265536 00000100:00100000:3.0:1788263484.020203:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699266048 00000100:00100000:3.0:1788263484.020206:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699266048 00000100:00100000:3.0:1788263484.020217:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:3.0:1788263484.020224:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+5:2387:x1875129699265664:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263484.020247:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+5:2387:x1875129699265664:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 24us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263484.020253:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:3.0:1788263484.020275:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00100000:3.0:1788263484.020281:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:2387:x1875129699266176:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263484.020302:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:2387:x1875129699266176:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 22us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263484.020315:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00100000:3.0:1788263484.020327:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:3.0:1788263484.020332:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+5:2387:x1875129699265536:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263484.020356:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+5:2387:x1875129699265536:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 24us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263484.020361:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:3.0:1788263484.020371:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:3.0:1788263484.020378:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:2387:x1875129699266048:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263484.020395:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:2387:x1875129699266048:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 19us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263484.020400:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00080000:3.0:1788263484.020435:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788263484.020439:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788263484.020442:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788263484.020443:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788263484.655824:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788263484.977139:0:18568:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6cba8b7b-8f99-4a54-a27b-6ee8a0068215 00000001:00100000:2.0:1788263484.986986:0:19385:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6cba8b7b-8f99-4a54-a27b-6ee8a0068215 00000020:00000080:0.0:1788263485.589453:0:20091:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcaed0dfd0 20000000:00000080:0.0:1788263485.589471:0:20091:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ff385f76800 uarg=0000000000000000 20000000:01000000:0.0:1788263485.589516:0:20091:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788263485.589522:0:20091:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788263485.589527:0:20091:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788263485.590131:0:20092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788263485.590290:0:20091:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788263485.600433:0:20091:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788263485.600464:0:20091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ff3829e9000/0x4b1103cba6670a1c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.600484:0:20091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff283b68200/0x4b1103cba66706b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba66706aa expref: 23 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.600492:0:20091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff381680c00/0x4b1103cba66706bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba66706b8 expref: 23 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.600498:0:20091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff283b68000/0x4b1103cba66706fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba66706f7 expref: 23 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.600524:0:20091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff381681a00/0x4b1103cba6670798 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670791 expref: 23 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.600534:0:20091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff3829e8600/0x4b1103cba66709ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11701f1 expref: 12 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.600541:0:20091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ff3bf6d1000/0x4b1103cba66709eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170261 expref: 12 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.600548:0:20091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ff3829e9000/0x4b1103cba6670a1c lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.600624:0:20091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff3bf6d1000/0x4b1103cba66709eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170261 expref: 12 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.600640:0:20091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ff3bf6d1000/0x4b1103cba66709eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170261 expref: 12 pid: 17060 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263485.600655:0:20091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283327800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20091:1875129709836288:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788263485.601176:0:20091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff3829e8600/0x4b1103cba66709ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11701f1 expref: 12 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.601185:0:20091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ff3829e8600/0x4b1103cba66709ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11701f1 expref: 12 pid: 17059 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263485.601195:0:20091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283326a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20091:1875129709836416:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788263485.601244:0:20091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff381681a00/0x4b1103cba6670798 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba6670791 expref: 23 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.601264:0:20091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ff381681a00/0x4b1103cba6670798 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba6670791 expref: 23 pid: 17058 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263485.601273:0:20091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2833e1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20091:1875129709836544:0@lo:104: 00000100:00100000:0.0:1788263485.601313:0:20091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788263485.601363:0:20091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff283b68000/0x4b1103cba66706fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba66706f7 expref: 23 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.601371:0:20091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ff283b68000/0x4b1103cba66706fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba66706f7 expref: 23 pid: 17060 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263485.601380:0:20091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3b5471880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20091:1875129709836672:0@lo:104: 00000100:00100000:0.0:1788263485.601400:0:20091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788263485.601420:0:20091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff381680c00/0x4b1103cba66706bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba66706b8 expref: 23 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.601429:0:20091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ff381680c00/0x4b1103cba66706bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba66706b8 expref: 23 pid: 17059 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263485.601436:0:20091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b70380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20091:1875129709836800:0@lo:104: 00000100:00100000:0.0:1788263485.601454:0:20091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788263485.601470:0:20091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ff283b68200/0x4b1103cba66706b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b1103cba66706aa expref: 23 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.601478:0:20091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ff283b68200/0x4b1103cba66706b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b1103cba66706aa expref: 23 pid: 17059 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263485.601486:0:20091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b71c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20091:1875129709836928:0@lo:104: 00000100:00100000:0.0:1788263485.601515:0:20091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263485.601526:0:20091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2810e0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788263485.601644:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709836544 00000100:00100000:1.0:1788263485.601652:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709836544 00000100:00100000:1.0:1788263485.601685:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709836672 00000100:00100000:1.0:1788263485.601688:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709836672 00000100:00100000:1.0:1788263485.601697:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709836800 00000100:00100000:1.0:1788263485.601699:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709836800 00000100:00100000:1.0:1788263485.601707:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709836928 00000100:00100000:1.0:1788263485.601709:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709836928 00000100:00100000:1.0:1788263485.601720:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788263485.601729:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fb36e90-c209-4884-91f2-1155be4ad295+6:20091:x1875129709836544:12345-0@lo:104: 00010000:00010000:1.0:1788263485.601741:0:17049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba6670791 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba6670798 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.601802:0:17049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788263485.601809:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fb36e90-c209-4884-91f2-1155be4ad295+6:20091:x1875129709836544:12345-0@lo:104: Request processed in 81us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263485.601816:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788263485.601831:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788263485.601837:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5471f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fb36e90-c209-4884-91f2-1155be4ad295+5:20091:x1875129709836672:12345-0@lo:104: 00010000:00010000:1.0:1788263485.601844:0:17049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff38150ea00/0x4b1103cba66706f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba66706fe expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.601892:0:17049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788263485.601898:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5471f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fb36e90-c209-4884-91f2-1155be4ad295+5:20091:x1875129709836672:12345-0@lo:104: Request processed in 62us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263485.601904:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788263485.601915:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788263485.601921:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fb36e90-c209-4884-91f2-1155be4ad295+4:20091:x1875129709836800:12345-0@lo:104: 00010000:00010000:1.0:1788263485.601927:0:17049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba66706b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba66706bf expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.601960:0:17049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788263485.601965:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fb36e90-c209-4884-91f2-1155be4ad295+4:20091:x1875129709836800:12345-0@lo:104: Request processed in 45us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263485.601971:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788263485.601983:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788263485.601988:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fb36e90-c209-4884-91f2-1155be4ad295+3:20091:x1875129709836928:12345-0@lo:104: 00010000:00010000:1.0:1788263485.601995:0:17049:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba66706aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba66706b1 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602019:0:17049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788263485.602023:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fb36e90-c209-4884-91f2-1155be4ad295+3:20091:x1875129709836928:12345-0@lo:104: Request processed in 36us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263485.602029:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788263485.602046:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788263485.602051:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba6670791 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba6670798 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602059:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150e000 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:1.0:1788263485.602063:0:17054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba6670791 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba6670798 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602072:0:17054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba6670791 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba6670798 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263485.602079:0:17054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba6670791 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba6670798 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263485.602084:0:17054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788263485.602134:0:17054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba6670791 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba6670798 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602142:0:17054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263485.602161:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba6670791 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba6670798 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602168:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff38150e000/0x4b1103cba6670791 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba6670798 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602181:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788263485.602185:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff38150ea00/0x4b1103cba66706f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba66706fe expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602190:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff38150ea00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:1.0:1788263485.602198:0:17054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff38150ea00/0x4b1103cba66706f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba66706fe expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602204:0:17054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff38150ea00/0x4b1103cba66706f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba66706fe expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263485.602210:0:17054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff38150ea00/0x4b1103cba66706f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba66706fe expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263485.602215:0:17054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788263485.602238:0:17054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff38150ea00/0x4b1103cba66706f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba66706fe expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602244:0:17054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263485.602259:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff38150ea00/0x4b1103cba66706f7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba66706fe expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602275:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff38150ea00/0x4b1103cba66706f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba66706fe expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602285:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788263485.602288:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba66706b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba66706bf expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602293:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b69200 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:1.0:1788263485.602296:0:17054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba66706b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba66706bf expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602302:0:17054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba66706b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba66706bf expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263485.602308:0:17054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba66706b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba66706bf expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263485.602313:0:17054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788263485.602326:0:17054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba66706b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba66706bf expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602332:0:17054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263485.602337:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba66706b8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba66706bf expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602344:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff283b69200/0x4b1103cba66706b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba66706bf expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602351:0:17054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263485.602360:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba66706aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b1103cba66706b1 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602366:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0c00 already unused, calling callback (ffffffffc12d0c20) 10000000:00010000:1.0:1788263485.602368:0:17054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba66706aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b1103cba66706b1 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602375:0:17054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba66706aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b1103cba66706b1 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788263485.602381:0:17054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba66706aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b1103cba66706b1 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263485.602385:0:17054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788263485.602397:0:17054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba66706aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba66706b1 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602403:0:17054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788263485.602409:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba66706aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba66706b1 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602415:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0c00/0x4b1103cba66706aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b1103cba66706b1 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602427:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263485.602428:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263485.602430:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263485.602442:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2838cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fb36e90-c209-4884-91f2-1155be4ad295:3621:1875129709837056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788263485.602471:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263485.602497:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788263485.602503:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2838cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fb36e90-c209-4884-91f2-1155be4ad295:3621:1875129709837440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788263485.602530:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263485.602555:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2838cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fb36e90-c209-4884-91f2-1155be4ad295:3618:1875129709837184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788263485.602573:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263485.602607:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788263485.602611:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2838cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fb36e90-c209-4884-91f2-1155be4ad295:3618:1875129709837312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788263485.602627:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263485.602648:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709837056 00000100:00100000:1.0:1788263485.602652:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709837056 00010000:00010000:1.0:1788263485.602668:0:17050:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff381681a00/0x4b1103cba6670798 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba6670791 expref: 24 pid: 17058 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263485.602682:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709837440 00000100:00100000:1.0:1788263485.602684:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709837440 00010000:00010000:1.0:1788263485.602693:0:17050:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff283b68200/0x4b1103cba66706b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba66706aa expref: 25 pid: 17059 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263485.602702:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709837184 00000100:00100000:1.0:1788263485.602704:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709837184 00010000:00010000:1.0:1788263485.602712:0:17050:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff283b68000/0x4b1103cba66706fe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba66706f7 expref: 26 pid: 17060 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263485.602721:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709837312 00000100:00100000:1.0:1788263485.602723:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709837312 00010000:00010000:1.0:1788263485.602731:0:17050:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff381680c00/0x4b1103cba66706bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba66706b8 expref: 27 pid: 17059 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263485.602744:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788263485.602749:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fb36e90-c209-4884-91f2-1155be4ad295+27:3621:x1875129709837056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788263485.602757:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263485.602769:0:17050:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff381681a00/0x4b1103cba6670798 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba6670791 expref: 27 pid: 17058 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602777:0:17050:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff381681a00/0x4b1103cba6670798 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba6670791 expref: 27 pid: 17058 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602791:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263485.602819:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fb36e90-c209-4884-91f2-1155be4ad295+27:3621:x1875129709837056:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263485.602825:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788263485.602839:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788263485.602845:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fb36e90-c209-4884-91f2-1155be4ad295+26:3621:x1875129709837440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788263485.602852:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263485.602856:0:17050:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff283b68200/0x4b1103cba66706b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba66706aa expref: 26 pid: 17059 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602865:0:17050:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff283b68200/0x4b1103cba66706b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba66706aa expref: 26 pid: 17059 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602874:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263485.602894:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fb36e90-c209-4884-91f2-1155be4ad295+26:3621:x1875129709837440:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263485.602900:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788263485.602910:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788263485.602916:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fb36e90-c209-4884-91f2-1155be4ad295+25:3618:x1875129709837184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788263485.602923:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263485.602927:0:17050:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff283b68000/0x4b1103cba66706fe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba66706f7 expref: 25 pid: 17060 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602944:0:17050:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff283b68000/0x4b1103cba66706fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba66706f7 expref: 25 pid: 17060 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.602954:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263485.602980:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fb36e90-c209-4884-91f2-1155be4ad295+25:3618:x1875129709837184:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263485.602985:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788263485.602996:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788263485.603002:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fb36e90-c209-4884-91f2-1155be4ad295+24:3618:x1875129709837312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788263485.603009:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263485.603013:0:17050:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff381680c00/0x4b1103cba66706bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b1103cba66706b8 expref: 24 pid: 17059 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.603021:0:17050:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff381680c00/0x4b1103cba66706bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b1103cba66706b8 expref: 24 pid: 17059 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263485.603029:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263485.603048:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fb36e90-c209-4884-91f2-1155be4ad295+24:3618:x1875129709837312:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263485.603054:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788263485.603087:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2838cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fb36e90-c209-4884-91f2-1155be4ad295:3618:1875129709837312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788263485.603095:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2838cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fb36e90-c209-4884-91f2-1155be4ad295:3618:1875129709837184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788263485.603125:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2838cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fb36e90-c209-4884-91f2-1155be4ad295:3621:1875129709837440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788263485.603133:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2838cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fb36e90-c209-4884-91f2-1155be4ad295:3621:1875129709837056:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788263485.603494:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263485.603527:0:20091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff381681a00/0x4b1103cba6670798 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba6670791 expref: 23 pid: 17058 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263485.603538:0:20091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2833e1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20091:1875129709836544:0@lo:104: 00010000:00010000:2.0:1788263485.603547:0:20091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff283b68000/0x4b1103cba66706fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba66706f7 expref: 22 pid: 17060 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263485.603555:0:20091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3b5471880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20091:1875129709836672:0@lo:104: 00010000:00010000:2.0:1788263485.603562:0:20091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff381680c00/0x4b1103cba66706bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba66706b8 expref: 21 pid: 17059 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263485.603570:0:20091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b70380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20091:1875129709836800:0@lo:104: 00010000:00010000:2.0:1788263485.603663:0:20091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff283b68200/0x4b1103cba66706b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b1103cba66706aa expref: 20 pid: 17059 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263485.603673:0:20091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b71c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20091:1875129709836928:0@lo:104: 00000100:00100000:2.0:1788263485.609105:0:20091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283327800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20091:1875129709836288:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788263485.609147:0:20091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283326a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20091:1875129709836416:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788263485.609186:0:20091:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ff3829e9000/0x4b1103cba6670a1c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263485.610022:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263485.610091:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263485.610247:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699266304 00000100:00100000:0.0:1788263485.610255:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699266304 00010000:00010000:0.0:1788263485.610286:0:17052:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff3bf6d1000/0x4b1103cba66709eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170261 expref: 13 pid: 17060 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263485.610322:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699266432 00000100:00100000:0.0:1788263485.610325:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699266432 00010000:00010000:0.0:1788263485.610336:0:17052:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ff3829e8600/0x4b1103cba66709ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11701f1 expref: 14 pid: 17059 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263485.610349:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:0.0:1788263485.610356:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b54ba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+14:2386:x1875129699266304:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263485.610370:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263485.610375:0:17052:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff3bf6d1000/0x4b1103cba66709eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170261 expref: 14 pid: 17060 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.610386:0:17052:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff3bf6d1000/0x4b1103cba66709eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170261 expref: 14 pid: 17060 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.610404:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3bf6d1000/0x4b1103cba66709eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170261 expref: 14 pid: 17060 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.610417:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263485.610459:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b54ba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+13:2386:x1875129699266304:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 102us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263485.610466:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:0.0:1788263485.610505:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:0.0:1788263485.610522:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+12:2386:x1875129699266432:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263485.610533:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263485.610537:0:17052:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ff3829e8600/0x4b1103cba66709ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11701f1 expref: 12 pid: 17059 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.610545:0:17052:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ff3829e8600/0x4b1103cba66709ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11701f1 expref: 12 pid: 17059 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.610554:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3829e8600/0x4b1103cba66709ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11701f1 expref: 12 pid: 17059 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.610564:0:17052:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ff3829e9000/0x4b1103cba6670a1c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.610572:0:17052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3829e9000/0x4b1103cba6670a1c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.610611:0:17052:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff3829e9000/0x4b1103cba6670a1c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.610618:0:17052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ff3829e9000/0x4b1103cba6670a1c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.610625:0:17052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ff3829e9000/0x4b1103cba6670a1c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.610632:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ff3829e9000/0x4b1103cba6670a1c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.610639:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9000 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:0.0:1788263485.610643:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ff3829e9000/0x4b1103cba6670a1c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.610655:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ff3829e9000/0x4b1103cba6670a1c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.610668:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ff3829e9000/0x4b1103cba6670a1c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263485.610678:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263485.610698:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+11:2386:x1875129699266432:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 177us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263485.610705:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 14 00010000:00010000:2.0:1788263485.610814:0:20091:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ff3829e9000/0x4b1103cba6670a1c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263485.610823:0:20091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ff3829e9000/0x4b1103cba6670a1c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263485.610830:0:20091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ff3829e9000/0x4b1103cba6670a1c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263485.679748:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263486.706794:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263486.712955:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263486.713078:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699266560 00000100:00100000:3.0:1788263486.713089:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699266560 00000100:00100000:3.0:1788263486.713184:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 145 00000100:00100000:3.0:1788263486.713195:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+11:14872:x1875129699266560:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263486.713211:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263486.713231:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3ae764600/0x4b1103cba6670a23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd405f293d1170299 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263486.713282:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3ae764600/0x4b1103cba6670a23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170299 expref: 12 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263486.713294:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3ae764600/0x4b1103cba6670a23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170299 expref: 12 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263486.713303:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae764600, rc 0) 00000100:00100000:3.0:1788263486.713357:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+12:14872:x1875129699266560:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 164us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263486.713364:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 145 00000100:00100000:3.0:1788263486.715557:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263486.726545:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699266688 00000100:00100000:2.0:1788263486.726559:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699266688 00000100:00100000:2.0:1788263486.726638:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 146 00000100:00100000:2.0:1788263486.726649:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+12:14872:x1875129699266688:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263486.726818:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+12:14872:x1875129699266688:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 171us (11269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263486.726827:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 146 00000100:00100000:3.0:1788263486.736542:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263486.736985:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699266816 00000100:00100000:0.0:1788263486.736994:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699266816 00000100:00100000:0.0:1788263486.737046:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 147 00000100:00100000:0.0:1788263486.737067:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+12:14872:x1875129699266816:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263486.737210:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+12:14872:x1875129699266816:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 155us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263486.737218:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 147 00000100:00100000:0.0:1788263486.755097:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263486.755154:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699266944 00000100:00100000:0.0:1788263486.755165:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699266944 00000100:00100000:0.0:1788263486.755237:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 148 00000100:00100000:0.0:1788263486.755887:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3ae6b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+12:14872:x1875129699266944:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263486.755904:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263486.755921:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3829e8a00/0x4b1103cba6670a2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd405f293d11702a0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263486.755962:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3829e8a00/0x4b1103cba6670a2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702a0 expref: 13 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263486.755974:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3829e8a00/0x4b1103cba6670a2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702a0 expref: 13 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263486.755983:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3829e8a00, rc 0) 00000100:00100000:0.0:1788263486.756041:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3ae6b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+13:14872:x1875129699266944:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 163us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263486.756049:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 148 00000100:00100000:2.0:1788263486.757975:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263486.758043:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699267072 00000100:00100000:0.0:1788263486.758052:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699267072 00000100:00100000:0.0:1788263486.758103:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 149 00000100:00100000:0.0:1788263486.758123:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+13:14872:x1875129699267072:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263486.758263:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+13:14872:x1875129699267072:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 141us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263486.758272:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 149 00000100:00100000:0.0:1788263486.761776:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263486.761837:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699267200 00000100:00100000:2.0:1788263486.761856:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699267200 00000100:00100000:2.0:1788263486.761923:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 150 00000100:00100000:2.0:1788263486.761935:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+13:14872:x1875129699267200:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263486.763165:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+13:14872:x1875129699267200:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 1226us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263486.763177:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 150 00000100:00100000:2.0:1788263487.023719:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28381d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709837568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263487.023785:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263487.023840:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709837568 00000100:00100000:2.0:1788263487.023847:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709837568 00000100:00100000:2.0:1788263487.023898:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788263487.023907:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709837568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788263487.023934:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788263487.023977:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709837568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263487.023984:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788263487.024005:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788263487.024037:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28381d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709837568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263487.025291:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709837696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788263487.025345:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263487.027131:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709837824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788263487.027184:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263487.032877:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709837696 00000100:00100000:2.0:1788263487.032890:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709837696 00000100:00100000:2.0:1788263487.032943:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709837824 00000100:00100000:2.0:1788263487.032947:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709837824 00000100:00100000:2.0:1788263487.032966:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788263487.032975:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709837696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788263487.033012:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788263487.033093:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709837696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (7747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263487.033101:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788263487.033129:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788263487.033143:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709837824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788263487.033161:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788263487.033195:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709837824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (6012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263487.033201:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788263487.033248:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709837824:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788263487.033274:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788263487.033278:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788263487.033299:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709837696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788263487.035991:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fb36e90-c209-4884-91f2-1155be4ad295:3620:1875129709837952:0@lo:400:kworker.0 00000100:00100000:2.0:1788263487.036061:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263487.036350:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709838464:0@lo:400:kworker.0 00000100:00100000:2.0:1788263487.036381:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263487.036405:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf77ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875129709838976:0@lo:400:kworker.0 00000100:00100000:2.0:1788263487.036427:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263487.036451:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788263487.036458:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709838080:0@lo:400:kworker.0 00000100:00100000:2.0:1788263487.036479:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263487.036493:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709838592:0@lo:400:kworker.0 00000100:00100000:2.0:1788263487.036510:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263487.036525:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf77f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875129709839104:0@lo:400:kworker.0 00000100:00100000:2.0:1788263487.036541:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263487.036596:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709838464 00000100:00100000:2.0:1788263487.036602:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709838464 00000100:00100000:2.0:1788263487.036657:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788263487.036665:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709838464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263487.036712:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875129709838464:12345-0@lo:400:kworker.0 Request processed in 48us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263487.036719:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788263487.036739:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709838976 00000100:00100000:2.0:1788263487.036742:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709838976 00000100:00100000:2.0:1788263487.036764:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709838592 00000100:00100000:2.0:1788263487.036767:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709838592 00000100:00100000:2.0:1788263487.036778:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709839104 00000100:00100000:2.0:1788263487.036780:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709839104 00000100:00100000:2.0:1788263487.036793:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788263487.036799:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875129709838976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263487.036829:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875129709838976:12345-0@lo:400:kworker.0 Request processed in 31us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263487.036835:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788263487.036847:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788263487.036853:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709838592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263487.036878:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875129709838592:12345-0@lo:400:kworker.0 Request processed in 25us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263487.036883:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788263487.036894:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788263487.036900:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875129709839104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263487.036924:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875129709839104:12345-0@lo:400:kworker.0 Request processed in 25us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263487.036930:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788263487.036946:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709838080 00000100:00100000:2.0:1788263487.036954:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709838080 00000100:00100000:2.0:1788263487.036979:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788263487.036985:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28381f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709838080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263487.037027:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28381f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709838080:12345-0@lo:400:kworker.0 Request processed in 42us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263487.037033:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788263487.037081:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709838080:0@lo:400:kworker.0 00000100:00100000:2.0:1788263487.037091:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875129709838592:0@lo:400:kworker.0 00010000:00080000:2.0:1788263487.037103:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf77f480 x1875129709839104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263487.037124:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf77f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3620:1875129709839104:0@lo:400:kworker.0 00000100:00100000:2.0:1788263487.037134:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1875129709838464:0@lo:400:kworker.0 00000100:00100000:2.0:1788263487.037142:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf77ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1875129709838976:0@lo:400:kworker.0 00000100:00100000:2.0:1788263487.037171:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709838336:0@lo:400:kworker.0 00000100:00100000:2.0:1788263487.037194:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263487.037210:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875129709838848:0@lo:400:kworker.0 00000100:00100000:2.0:1788263487.037229:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263487.037244:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788263487.037250:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709838208:0@lo:400:kworker.0 00000100:00100000:2.0:1788263487.037266:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263487.037279:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875129709838720:0@lo:400:kworker.0 00000100:00100000:2.0:1788263487.037295:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263487.037313:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709838848 00000100:00100000:2.0:1788263487.037321:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709838848 00000100:00100000:2.0:1788263487.037342:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709838208 00000100:00100000:2.0:1788263487.037345:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709838208 00000100:00100000:2.0:1788263487.037356:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709838720 00000100:00100000:2.0:1788263487.037357:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709838720 00000100:00100000:2.0:1788263487.037369:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788263487.037374:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875129709838848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263487.037407:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875129709838848:12345-0@lo:400:kworker.0 Request processed in 33us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263487.037413:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788263487.037423:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788263487.037429:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709838208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263487.037459:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875129709838208:12345-0@lo:400:kworker.0 Request processed in 31us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263487.037464:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788263487.037474:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788263487.037479:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b5471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875129709838720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263487.037502:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b5471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875129709838720:12345-0@lo:400:kworker.0 Request processed in 24us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263487.037507:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1788263487.037526:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788263487.037530:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788263487.037532:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263487.037542:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709838336 00000100:00100000:2.0:1788263487.037545:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709838336 00000100:00100000:2.0:1788263487.037565:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788263487.037570:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709838336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263487.037622:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709838336:12345-0@lo:400:kworker.0 Request processed in 51us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263487.037635:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788263487.037663:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875129709838208:0@lo:400:kworker.0 00000100:00100000:2.0:1788263487.037671:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1875129709838720:0@lo:400:kworker.0 00000100:00100000:2.0:1788263487.037679:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709838336:0@lo:400:kworker.0 00010000:00080000:2.0:1788263487.037687:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff2831f3480 x1875129709838848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263487.037696:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1875129709838848:0@lo:400:kworker.0 00000100:00100000:0.0:1788263487.039675:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709837952 00000100:00100000:0.0:1788263487.039686:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709837952 00000100:00100000:0.0:1788263487.039725:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788263487.039733:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+20:3620:x1875129709837952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263487.039801:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+20:3620:x1875129709837952:12345-0@lo:400:kworker.0 Request processed in 70us (3740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263487.039814:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788263487.039864:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fb36e90-c209-4884-91f2-1155be4ad295:3620:1875129709837952:0@lo:400:kworker.0 10000000:01000000:1.0:1788263487.416034:0:17062:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788263487.416047:0:17062:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff3bc204800 from 13 10000000:01000000:1.0:1788263487.416053:0:17062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788263487.416097:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff2823ece00/0x4b1103cba6670a31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263487.416121:0:17062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff2823ece00/0x4b1103cba6670a31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263487.416133:0:17062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff2823ece00/0x4b1103cba6670a31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263487.416158:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2838cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709839232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788263487.416223:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263487.416302:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2810a8300 going to sleep for 11 seconds 00000100:00100000:2.0:1788263487.423674:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709839232 00000100:00100000:2.0:1788263487.423687:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709839232 00000100:00100000:2.0:1788263487.423741:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788263487.423749:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+20:17062:x1875129709839232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263487.423767:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263487.423783:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3bf6d1a00/0x4b1103cba6670a38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba6670a31 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263487.423809:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3bf6d1a00/0x4b1103cba6670a38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba6670a31 expref: 21 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263487.423820:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3bf6d1a00/0x4b1103cba6670a38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670a31 expref: 21 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263487.423828:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d1a00, rc 0) 00000100:00100000:2.0:1788263487.423909:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+21:17062:x1875129709839232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (7686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263487.423916:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788263487.424514:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2838cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709839232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263487.424532:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff2823ece00/0x4b1103cba6670a31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670a38 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263487.424542:0:17062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff2823ece00/0x4b1103cba6670a31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba6670a38 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263487.424652:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf77fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709839360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263487.424693:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263487.424726:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384fa8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263487.424852:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709839360 00000100:00100000:0.0:1788263487.424857:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709839360 00000100:00100000:0.0:1788263487.424893:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788263487.424900:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+21:17062:x1875129709839360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263487.425019:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+21:17062:x1875129709839360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263487.425026:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788263487.425058:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf77fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709839360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263487.425088:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709839488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263487.425140:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263487.425155:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3c05d7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788263487.425167:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709839488 00000100:00100000:0.0:1788263487.425171:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709839488 00000100:00100000:0.0:1788263487.425192:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788263487.425198:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+21:17062:x1875129709839488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263487.425268:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+21:17062:x1875129709839488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263487.425275:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788263487.425318:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709839488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788263487.443139:0:20164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788263487.443492:0:17062:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788263487.443518:0:17062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788263487.443528:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff2823ece00/0x4b1103cba6670a31 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670a38 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263487.443539:0:17062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff2823ece00/0x4b1103cba6670a31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670a38 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263487.443548:0:17062:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788263487.443550:0:17062:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff38760a800 from 13 10000000:01000000:2.0:1788263487.443552:0:17062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788263487.443608:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0800/0x4b1103cba6670a3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263487.443615:0:17062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0800/0x4b1103cba6670a3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263487.443625:0:17062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0800/0x4b1103cba6670a3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263487.443647:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709839616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788263487.443708:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263487.443748:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2810e0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788263487.443808:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709839616 00000100:00100000:0.0:1788263487.443815:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709839616 00000100:00100000:0.0:1788263487.443873:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788263487.443883:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+21:17062:x1875129709839616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263487.443895:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263487.443907:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3829e9600/0x4b1103cba6670a46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba6670a3f expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263487.443927:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3829e9600/0x4b1103cba6670a46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba6670a3f expref: 22 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263487.443936:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3829e9600/0x4b1103cba6670a46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670a3f expref: 22 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263487.443953:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3829e9600, rc 0) 00000100:00100000:0.0:1788263487.443992:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+22:17062:x1875129709839616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263487.443999:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788263487.444128:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709839616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263487.444141:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0800/0x4b1103cba6670a3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670a46 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263487.444148:0:17062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0800/0x4b1103cba6670a3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba6670a46 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263487.444203:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709839744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263487.444226:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263487.444248:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2810e0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788263487.444286:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709839744 00000100:00100000:0.0:1788263487.444290:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709839744 00000100:00100000:0.0:1788263487.444320:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788263487.444327:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+22:17062:x1875129709839744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263487.444638:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+22:17062:x1875129709839744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263487.444645:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788263487.453175:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709839744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263487.453316:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709839872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263487.453406:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263487.453455:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3c05d7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263487.453610:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709839872 00000100:00100000:2.0:1788263487.453617:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709839872 00000100:00100000:2.0:1788263487.453658:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788263487.453665:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+22:17062:x1875129709839872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263487.453760:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+22:17062:x1875129709839872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263487.453767:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788263487.453845:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709839872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788263487.455656:0:20165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788263487.455922:0:17062:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788263487.455953:0:17062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788263487.455964:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0800/0x4b1103cba6670a3f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670a46 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263487.455975:0:17062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d0800/0x4b1103cba6670a3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670a46 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263487.455984:0:17062:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788263487.455987:0:17062:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff283349800 from 13 10000000:01000000:2.0:1788263487.455990:0:17062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788263487.456023:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1e00/0x4b1103cba6670a4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263487.456030:0:17062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1e00/0x4b1103cba6670a4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263487.456052:0:17062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1e00/0x4b1103cba6670a4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263487.456074:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709840000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788263487.456141:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263487.456173:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2810e0780 going to sleep for 11 seconds 00000100:00100000:0.0:1788263487.456282:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709840000 00000100:00100000:0.0:1788263487.456288:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709840000 00000100:00100000:0.0:1788263487.456332:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788263487.456344:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+22:17062:x1875129709840000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263487.456411:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263487.456424:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3829e9c00/0x4b1103cba6670a54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba6670a4d expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263487.456509:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3829e9c00/0x4b1103cba6670a54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba6670a4d expref: 23 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263487.456519:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3829e9c00/0x4b1103cba6670a54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670a4d expref: 23 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263487.456528:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3829e9c00, rc 0) 00000100:00100000:0.0:1788263487.456569:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+23:17062:x1875129709840000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 230us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263487.456596:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788263487.456678:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709840000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263487.456691:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1e00/0x4b1103cba6670a4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670a54 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263487.456700:0:17062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1e00/0x4b1103cba6670a4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba6670a54 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263487.456748:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709840128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263487.456771:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263487.456794:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2810e0780 going to sleep for 11 seconds 00000100:00100000:0.0:1788263487.457492:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709840128 00000100:00100000:0.0:1788263487.457499:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709840128 00000100:00100000:0.0:1788263487.457537:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788263487.457544:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+23:17062:x1875129709840128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263487.457681:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+23:17062:x1875129709840128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263487.457688:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788263487.457766:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709840128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263487.457799:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709840256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263487.457838:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263487.457871:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2810e0780 going to sleep for 11 seconds 00000100:00100000:3.0:1788263487.458007:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709840256 00000100:00100000:3.0:1788263487.458017:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709840256 00000100:00100000:3.0:1788263487.458045:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788263487.458051:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+23:17062:x1875129709840256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263487.458135:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+23:17062:x1875129709840256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263487.458141:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788263487.458216:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709840256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788263487.461498:0:20166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788263487.462076:0:17062:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788263487.462098:0:17062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788263487.462119:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1e00/0x4b1103cba6670a4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670a54 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263487.462131:0:17062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3bf6d1e00/0x4b1103cba6670a4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670a54 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263487.462140:0:17062:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788263487.462143:0:17062:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ff28389c800 from 13 10000000:01000000:3.0:1788263487.462145:0:17062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788263487.462175:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764e00/0x4b1103cba6670a5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263487.462183:0:17062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764e00/0x4b1103cba6670a5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263487.462192:0:17062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764e00/0x4b1103cba6670a5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263487.462214:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf77d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709840384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788263487.462275:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263487.462310:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709840384 00000100:00100000:3.0:1788263487.462328:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709840384 00000100:00100000:3.0:1788263487.463055:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788263487.463069:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398c96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+23:17062:x1875129709840384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263487.463084:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263487.463098:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ff3ae765200/0x4b1103cba6670a62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b1103cba6670a5b expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263487.463134:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ff3ae765200/0x4b1103cba6670a62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b1103cba6670a5b expref: 24 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263487.463144:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ff3ae765200/0x4b1103cba6670a62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b1103cba6670a5b expref: 24 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263487.463153:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae765200, rc 0) 00000100:00100000:3.0:1788263487.463194:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398c96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fb36e90-c209-4884-91f2-1155be4ad295+24:17062:x1875129709840384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263487.463201:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788263487.463242:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384fa80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263487.463261:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf77d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709840384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263487.463275:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764e00/0x4b1103cba6670a5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670a62 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263487.463285:0:17062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764e00/0x4b1103cba6670a5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b1103cba6670a62 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263487.463348:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf77d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709840512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263487.465878:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263487.465921:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff384fa80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263487.466036:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709840512 00000100:00100000:0.0:1788263487.466043:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709840512 00000100:00100000:0.0:1788263487.466113:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788263487.466123:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+24:17062:x1875129709840512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263487.466250:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+24:17062:x1875129709840512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263487.466258:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788263487.468055:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf77d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709840512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263487.468120:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709840640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263487.468180:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263487.468208:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2810e0300 going to sleep for 11 seconds 00000100:00100000:3.0:1788263487.469486:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709840640 00000100:00100000:3.0:1788263487.469496:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709840640 00000100:00100000:3.0:1788263487.469550:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788263487.469557:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+24:17062:x1875129709840640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263487.469694:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fb36e90-c209-4884-91f2-1155be4ad295+24:17062:x1875129709840640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263487.469702:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788263487.470055:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fb36e90-c209-4884-91f2-1155be4ad295:17062:1875129709840640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788263487.471706:0:20167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788263487.471866:0:17062:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788263487.471891:0:17062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788263487.471901:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764e00/0x4b1103cba6670a5b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670a62 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263487.471912:0:17062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9ff3ae764e00/0x4b1103cba6670a5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b1103cba6670a62 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263487.728737:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263488.050393:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788263488.050417:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2838cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709840768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788263488.050485:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263488.051915:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709840768 00000100:00100000:0.0:1788263488.051927:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709840768 00000100:00100000:0.0:1788263488.052041:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788263488.052053:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709840768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788263488.052078:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788263488.052172:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709840768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (1686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263488.052179:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788263488.052273:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2838cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709840768:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788263488.752760:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788263489.008272:0:17101:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788263489.079107:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2831f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709841024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788263489.079120:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf77e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709840896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788263489.087221:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263489.087332:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709841024 00000100:00100000:0.0:1788263489.087340:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709841024 00000100:00100000:0.0:1788263489.087386:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788263489.087395:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709841024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788263489.087430:0:17070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788263489.087477:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709841024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263489.091777:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2831f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709841024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788263489.091921:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263489.092301:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788263489.092335:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709840896 00000100:00100000:0.0:1788263489.092350:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709840896 00000100:00100000:0.0:1788263489.092387:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788263489.092408:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709840896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788263489.093967:0:17070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788263489.094077:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875129709840896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1679us (2153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263489.094087:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788263489.094510:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf77e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1875129709840896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788263489.138828:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263489.138888:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263489.138913:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263489.138945:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263489.138983:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263489.139054:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699267456 00000100:00100000:1.0:1788263489.139064:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699267456 00000100:00100000:3.0:1788263489.139125:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699267712 00000100:00100000:3.0:1788263489.139139:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699267712 00000100:00100000:1.0:1788263489.139149:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699267968 00000100:00100000:1.0:1788263489.139155:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699267968 00000100:00100000:1.0:1788263489.139195:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 50 00000100:00100000:1.0:1788263489.139207:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+6:2387:x1875129699267456:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263489.139212:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699268224 00000100:00100000:3.0:1788263489.139219:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699268224 00000100:00100000:3.0:1788263489.139263:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:3.0:1788263489.139276:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+5:2387:x1875129699267712:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263489.139296:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+6:2387:x1875129699267456:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 89us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263489.139307:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 50 00000100:00100000:1.0:1788263489.139332:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 51 00000100:00100000:1.0:1788263489.139343:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:2387:x1875129699267968:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263489.139355:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+5:2387:x1875129699267712:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 80us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263489.139382:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:1.0:1788263489.139416:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:2387:x1875129699267968:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 73us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263489.139423:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:1.0:1788263489.139438:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 51 00000100:00100000:3.0:1788263489.139455:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2833e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+5:2387:x1875129699268224:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263489.139543:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2833e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+5:2387:x1875129699268224:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 105us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263489.139559:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:0.0:1788263489.139633:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699267328 00000100:00100000:0.0:1788263489.139641:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699267328 00000100:00080000:3.0:1788263489.139658:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788263489.139666:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263489.139686:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 164 00000100:00100000:0.0:1788263489.139703:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+13:2387:x1875129699267328:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788263489.139740:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+13:2387:x1875129699267328:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 45us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263489.140031:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263489.140058:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263489.140075:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263489.140106:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263489.140137:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699267584 00000100:00100000:2.0:1788263489.140141:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699267584 00000100:00100000:2.0:1788263489.140167:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699268096 00000100:00100000:2.0:1788263489.140170:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699268096 00000100:00100000:2.0:1788263489.140197:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:2.0:1788263489.140203:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+5:2387:x1875129699267584:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263489.140233:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+5:2387:x1875129699267584:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 30us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263489.140239:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:2.0:1788263489.140253:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:2.0:1788263489.140259:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+5:2387:x1875129699268096:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263489.140282:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+5:2387:x1875129699268096:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 24us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263489.140288:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:2.0:1788263489.140303:0:19604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699267840 00000100:00100000:2.0:1788263489.140306:0:19604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699267840 00000100:00100000:2.0:1788263489.140326:0:19604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699268352 00000100:00100000:2.0:1788263489.140329:0:19604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699268352 00000100:00080000:3.0:1788263489.140359:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788263489.140361:0:19604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00080000:3.0:1788263489.140367:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788263489.140376:0:19604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6218fa09-9d3e-4029-b371-f2f7a141bebe+5:2387:x1875129699267840:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263489.140395:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00100000:2.0:1788263489.140410:0:19604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6218fa09-9d3e-4029-b371-f2f7a141bebe+5:2387:x1875129699267840:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 37us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263489.140413:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+5:2387:x1875129699268352:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788263489.140429:0:19604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:3.0:1788263489.140479:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+5:2387:x1875129699268352:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 73us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263489.140489:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00100000:0.0:1788263489.140559:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 164 00000100:00100000:0.0:1788263489.157348:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263489.157441:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699268480 00000100:00100000:2.0:1788263489.157451:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699268480 00000100:00100000:2.0:1788263489.157506:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:2.0:1788263489.157516:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+6:15538:x1875129699268480:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788263489.157535:0:17065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263489.157555:0:17065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba6670a69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11702a7 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.157667:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0c00/0x4b1103cba6670a70 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.157682:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0c00/0x4b1103cba6670a70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.157697:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0c00/0x4b1103cba6670a70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.157710:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670a77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.157717:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670a77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.157723:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670a77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.157797:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba6670a7e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.157804:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba6670a7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.157810:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba6670a7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263489.157836:0:17065:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788263489.157839:0:17065:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788263489.157873:0:17065:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba6670a7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.157894:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0c00/0x4b1103cba6670a70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.157900:0:17065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0c00/0x4b1103cba6670a70 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.157906:0:17065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0c00/0x4b1103cba6670a70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.157912:0:17065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0c00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263489.157916:0:17065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0c00/0x4b1103cba6670a70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.157923:0:17065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0c00/0x4b1103cba6670a70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.157946:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff28212b300) 00010000:00010000:2.0:1788263489.157950:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263489.157954:0:17065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0c00/0x4b1103cba6670a70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.157960:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0c00/0x4b1103cba6670a70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.157974:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670a77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.157979:0:17065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670a77 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.157985:0:17065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670a77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.158301:0:17065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1000 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263489.158305:0:17065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670a77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.158311:0:17065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670a77 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.158320:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ff28227a800) 00010000:00010000:2.0:1788263489.158323:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263489.158326:0:17065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670a77 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.158332:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670a77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.158368:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba6670a69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702a7 expref: 8 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.158381:0:17065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1400/0x4b1103cba6670a7e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702a7 expref: 7 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.158388:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ff28227a200) 00010000:00010000:2.0:1788263489.158390:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788263489.158393:0:17065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3bf6d1400, rc 0) 00000100:00100000:2.0:1788263489.158450:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+7:15538:x1875129699268480:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 934us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263489.158457:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:0.0:1788263489.168085:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263489.168266:0:17077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699268608 00000100:00100000:1.0:1788263489.168281:0:17077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699268608 00000100:00100000:1.0:1788263489.168357:0:17077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:1.0:1788263489.168369:0:17077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6218fa09-9d3e-4029-b371-f2f7a141bebe+7:15538:x1875129699268608:12345-192.168.203.26@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788263489.168461:0:17077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6218fa09-9d3e-4029-b371-f2f7a141bebe+7:15538:x1875129699268608:12345-192.168.203.26@tcp:900:lhsmtool_posix.0 Request processed in 95us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263489.168469:0:17077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:0.0:1788263489.178150:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263489.178302:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699268864 00000100:00100000:2.0:1788263489.178336:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699268864 00000100:00100000:2.0:1788263489.178417:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:2.0:1788263489.178429:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+7:15538:x1875129699268864:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788263489.178450:0:17066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263489.178471:0:17066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba6670a85 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11702ae expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.178547:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670a8c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.178562:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670a8c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.178573:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670a8c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.178670:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0c00/0x4b1103cba6670a93 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.178678:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0c00/0x4b1103cba6670a93 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.178685:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0c00/0x4b1103cba6670a93 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.178796:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec800/0x4b1103cba6670a9a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.178804:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec800/0x4b1103cba6670a9a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.178810:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec800/0x4b1103cba6670a9a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263489.178827:0:17066:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788263489.178975:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670a8c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.178984:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670a8c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.178990:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670a8c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.178996:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d1000 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263489.179001:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670a8c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.179009:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670a8c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.179021:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ff28227a200) 00010000:00010000:2.0:1788263489.179025:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263489.179029:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670a8c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.179036:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1000/0x4b1103cba6670a8c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.179049:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0c00/0x4b1103cba6670a93 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.179055:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0c00/0x4b1103cba6670a93 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.179072:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0c00/0x4b1103cba6670a93 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.179077:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3bf6d0c00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263489.179080:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0c00/0x4b1103cba6670a93 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.179086:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0c00/0x4b1103cba6670a93 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.179109:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ff28227a800) 00010000:00010000:2.0:1788263489.179121:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263489.179125:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0c00/0x4b1103cba6670a93 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.179131:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d0c00/0x4b1103cba6670a93 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.179964:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1200/0x4b1103cba6670a85 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702ae expref: 10 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.179984:0:17066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec800/0x4b1103cba6670a9a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702ae expref: 9 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.179992:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ff28227aa00) 00010000:00010000:2.0:1788263489.179995:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263489.179997:0:17066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eec800, rc 0) 00000100:00100000:2.0:1788263489.180070:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+9:15538:x1875129699268864:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 1643us (1936us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788263489.180088:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:0.0:1788263489.186835:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263489.187106:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699268992 00000100:00100000:3.0:1788263489.187120:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699268992 00000100:00100000:3.0:1788263489.187218:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:3.0:1788263489.187233:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+9:15538:x1875129699268992:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788263489.187381:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+9:15538:x1875129699268992:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 Request processed in 151us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263489.187389:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:1.0:1788263489.200362:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263489.200465:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699269120 00000100:00100000:0.0:1788263489.200475:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699269120 00000100:00100000:0.0:1788263489.200533:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00100000:0.0:1788263489.200544:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+5:15538:x1875129699269120:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1788263489.205153:0:17067:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4526us 00000100:00100000:0.0:1788263489.249702:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263489.249795:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699269248 00000100:00100000:1.0:1788263489.249805:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699269248 00000100:00100000:1.0:1788263489.249854:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:1.0:1788263489.249863:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+9:15544:x1875129699269248:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1788263489.249895:0:17065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263489.249915:0:17065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823eda00/0x4b1103cba6670aa8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11702b5 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.249971:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ed200/0x4b1103cba6670aaf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.249984:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ed200/0x4b1103cba6670aaf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.249996:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ed200/0x4b1103cba6670aaf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.250022:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ed400/0x4b1103cba6670ab6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.250030:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ed400/0x4b1103cba6670ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.250037:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ed400/0x4b1103cba6670ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.250074:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ed200/0x4b1103cba6670aaf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.250080:0:17065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ed200/0x4b1103cba6670aaf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.250087:0:17065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ed200/0x4b1103cba6670aaf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.250104:0:17065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff2823ed200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263489.250109:0:17065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ed200/0x4b1103cba6670aaf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.250124:0:17065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ed200/0x4b1103cba6670aaf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.250135:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff28212b300) 00010000:00010000:1.0:1788263489.250138:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263489.250142:0:17065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ed200/0x4b1103cba6670aaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.250149:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ed200/0x4b1103cba6670aaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.250166:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ed400/0x4b1103cba6670ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.250173:0:17065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ed400/0x4b1103cba6670ab6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.250179:0:17065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ed400/0x4b1103cba6670ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.250184:0:17065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff2823ed400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263489.250187:0:17065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ed400/0x4b1103cba6670ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.250193:0:17065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ed400/0x4b1103cba6670ab6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.250199:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ff3bc653500) 00010000:00010000:1.0:1788263489.250202:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263489.250204:0:17065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ed400/0x4b1103cba6670ab6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.250210:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ed400/0x4b1103cba6670ab6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.250239:0:17065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823eda00/0x4b1103cba6670aa8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702b5 expref: 10 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.250249:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff28212b300) 00010000:00010000:1.0:1788263489.250251:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263489.250259:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823eda00/0x4b1103cba6670aa8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702b5 expref: 10 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.250269:0:17065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff2823eda00, rc 0) 00000100:00100000:1.0:1788263489.250323:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+9:15544:x1875129699269248:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 461us (631us total) trans 0 rc 301/301 00000100:00100000:1.0:1788263489.250330:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:1.0:1788263489.252201:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+5:15538:x1875129699269120:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 Request processed in 51653us (51841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263489.252214:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00100000:1.0:1788263489.263372:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263489.263487:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699269376 00000100:00100000:2.0:1788263489.263496:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699269376 00000100:00100000:2.0:1788263489.263540:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:2.0:1788263489.263549:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6218fa09-9d3e-4029-b371-f2f7a141bebe+9:15544:x1875129699269376:12345-192.168.203.26@tcp:700:lfs.0 00000100:00100000:2.0:1788263489.263645:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6218fa09-9d3e-4029-b371-f2f7a141bebe+9:15544:x1875129699269376:12345-192.168.203.26@tcp:700:lfs.0 Request processed in 97us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263489.263652:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:1.0:1788263489.267551:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263489.267663:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699269632 00000100:00100000:2.0:1788263489.267673:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699269632 00000100:00100000:2.0:1788263489.267730:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:2.0:1788263489.267740:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+9:15544:x1875129699269632:12345-192.168.203.26@tcp:36:lfs.0 00010000:00010000:2.0:1788263489.267806:0:17066:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263489.267832:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba66709d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170222 expref: 9 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.267849:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff28212b300) 00010000:00010000:2.0:1788263489.267855:0:17066:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788263489.268295:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec400/0x4b1103cba6670abd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.268311:0:17066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba6670a15 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170292 expref: 5 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.268319:0:17066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec400/0x4b1103cba6670abd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.268367:0:17066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba6670a15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170292 expref: 5 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.268381:0:17066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba6670a15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170292 expref: 5 pid: 18294 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263489.268394:0:17066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bc225180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17066:1875129709841152:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788263489.269503:0:17066:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2810e0780 going to sleep for 11 seconds 00000100:00100000:3.0:1788263489.271899:0:17066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bc225180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17066:1875129709841152:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263489.271934:0:17066:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec400/0x4b1103cba6670abd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263489.272400:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263489.272772:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699269760 00000100:00100000:3.0:1788263489.272780:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699269760 00010000:00010000:1.0:1788263489.272941:0:17052:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba6670a15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170292 expref: 6 pid: 18294 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263489.272980:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00100000:1.0:1788263489.272991:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:2387:x1875129699269760:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263489.273005:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263489.273012:0:17052:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba6670a15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170292 expref: 6 pid: 18294 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.273024:0:17052:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba6670a15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170292 expref: 6 pid: 18294 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.273045:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3bf6d1800/0x4b1103cba6670a15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170292 expref: 6 pid: 18294 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.273078:0:17052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff28212b300) 00010000:00010000:1.0:1788263489.273083:0:17052:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec400/0x4b1103cba6670abd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.273101:0:17052:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec400/0x4b1103cba6670abd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.273109:0:17052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec400/0x4b1103cba6670abd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.273186:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263489.273234:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+5:2387:x1875129699269760:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 244us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263489.273242:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 15 00010000:00010000:3.0:1788263489.273735:0:17066:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec400/0x4b1103cba6670abd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.273744:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec400/0x4b1103cba6670abd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.273773:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765800/0x4b1103cba6670ac4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.273783:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765800/0x4b1103cba6670ac4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.273792:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765800/0x4b1103cba6670ac4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.281078:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764000/0x4b1103cba6670acb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.281112:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764000/0x4b1103cba6670acb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.281124:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764000/0x4b1103cba6670acb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788263489.281143:0:17066:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000296f9f17 reply state 000000001f4a9120 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764000/0x4b1103cba6670acb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.281154:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764000/0x4b1103cba6670acb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.281161:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ff39868a100) 00010000:00010000:3.0:1788263489.281163:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788263489.281167:0:17066:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788263489.281172:0:17066:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788263489.281180:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec400/0x4b1103cba6670abd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.281187:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec400/0x4b1103cba6670abd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.281199:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec400/0x4b1103cba6670abd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.281205:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eec400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263489.281210:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec400/0x4b1103cba6670abd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.281218:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec400/0x4b1103cba6670abd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.281229:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff28212b300) 00010000:00010000:3.0:1788263489.281231:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263489.281234:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec400/0x4b1103cba6670abd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.281241:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec400/0x4b1103cba6670abd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788263489.281259:0:17066:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000296f9f17 reply state 000000001f4a9120 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765800/0x4b1103cba6670ac4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.281267:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765800/0x4b1103cba6670ac4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.281272:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ff39868ad00) 00010000:00010000:3.0:1788263489.281274:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788263489.281276:0:17066:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788263489.281403:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+10:15544:x1875129699269632:12345-192.168.203.26@tcp:36:lfs.0 Request processed in 13661us (13857us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788263489.281412:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:1.0:1788263489.376236:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263489.376320:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699269888 00000100:00100000:3.0:1788263489.376330:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699269888 00000100:00100000:3.0:1788263489.376383:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:3.0:1788263489.376392:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+10:15552:x1875129699269888:12345-192.168.203.26@tcp:101:lctl.0 00010000:00010000:3.0:1788263489.376416:0:17065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263489.376439:0:17065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764200/0x4b1103cba6670ad2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11702bc expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.376854:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765e00/0x4b1103cba6670ad9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.376935:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765e00/0x4b1103cba6670ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.377004:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765e00/0x4b1103cba6670ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263489.377049:0:17065:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788263489.377053:0:17065:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788263489.377100:0:17065:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765e00/0x4b1103cba6670ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.377126:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764200/0x4b1103cba6670ad2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702bc expref: 12 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.377145:0:17065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765e00/0x4b1103cba6670ad9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702bc expref: 11 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.377154:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff39868ac00) 00010000:00010000:3.0:1788263489.377157:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788263489.377173:0:17065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae765e00, rc 0) 00000100:00100000:3.0:1788263489.377227:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+11:15552:x1875129699269888:12345-192.168.203.26@tcp:101:lctl.0 Request processed in 836us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263489.377235:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:1.0:1788263489.407780:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263489.408423:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699270016 00000100:00100000:3.0:1788263489.408433:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699270016 00000100:00100000:3.0:1788263489.408545:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 30 00000100:00100000:3.0:1788263489.408557:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+5:15553:x1875129699270016:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788263489.408616:0:18294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263489.408637:0:18294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764200/0x4b1103cba6670ae0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11702c3 expref: -99 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.408700:0:18294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765000/0x4b1103cba6670ae7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.408715:0:18294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765000/0x4b1103cba6670ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.408726:0:18294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765000/0x4b1103cba6670ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263489.408765:0:18294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788263489.408769:0:18294:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788263489.408788:0:18294:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765000/0x4b1103cba6670ae7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.408812:0:18294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764200/0x4b1103cba6670ae0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702c3 expref: 7 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.408831:0:18294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765000/0x4b1103cba6670ae7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702c3 expref: 6 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.408854:0:18294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff39868ac00) 00010000:00010000:3.0:1788263489.408857:0:18294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788263489.408860:0:18294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae765000, rc 0) 00000100:00100000:3.0:1788263489.411206:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:15553:x1875129699270016:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 2641us (3423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263489.411219:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 30 00000100:00100000:0.0:1788263489.418433:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263489.418551:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699270144 00000100:00100000:3.0:1788263489.418560:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699270144 00000100:00100000:3.0:1788263489.418652:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 31 00000100:00100000:3.0:1788263489.418662:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:15553:x1875129699270144:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788263489.418682:0:17065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263489.418702:0:17065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba6670aee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11702ca expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.418768:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670af5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.418782:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670af5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.418793:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670af5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.418804:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670afc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.418811:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670afc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.418837:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670afc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.418935:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba6670b03 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.418945:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba6670b03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.418952:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba6670b03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263489.418986:0:17065:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788263489.418990:0:17065:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788263489.419008:0:17065:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba6670b03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.419021:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670af5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.419026:0:17065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670af5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.419033:0:17065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670af5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.419038:0:17065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765c00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263489.419043:0:17065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670af5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.419050:0:17065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670af5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.419193:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff39868ac00) 00010000:00010000:3.0:1788263489.419196:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263489.419201:0:17065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670af5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.419207:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670af5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.419220:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670afc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.419225:0:17065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670afc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.419230:0:17065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670afc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.419235:0:17065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765a00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263489.419239:0:17065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670afc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.419245:0:17065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670afc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.419252:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ff39868ad00) 00010000:00010000:3.0:1788263489.419254:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263489.419258:0:17065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670afc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.419263:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670afc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.419299:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba6670aee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702ca expref: 8 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.419312:0:17065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba6670b03 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702ca expref: 7 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.419319:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ff39868a100) 00010000:00010000:3.0:1788263489.419321:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788263489.419323:0:17065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae765400, rc 0) 00000100:00100000:3.0:1788263489.419403:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+7:15553:x1875129699270144:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 742us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263489.419411:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 31 00000100:00100000:1.0:1788263489.421924:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263489.422181:0:17077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699270272 00000100:00100000:2.0:1788263489.422190:0:17077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699270272 00000100:00100000:2.0:1788263489.422244:0:17077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:2.0:1788263489.422255:0:17077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+5:15553:x1875129699270272:12345-192.168.203.26@tcp:900:lfs.0 00000100:00100000:2.0:1788263489.422429:0:17077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+5:15553:x1875129699270272:12345-192.168.203.26@tcp:900:lfs.0 Request processed in 175us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263489.422437:0:17077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:2.0:1788263489.434297:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263489.437256:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699270528 00000100:00100000:3.0:1788263489.437271:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699270528 00000100:00100000:2.0:1788263489.441414:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 32 00000100:00100000:2.0:1788263489.441429:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+7:15553:x1875129699270528:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788263489.441449:0:17066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263489.441468:0:17066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed400/0x4b1103cba6670b0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11702d1 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263489.441566:0:17066:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788263489.441689:0:17066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed400/0x4b1103cba6670b0a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702d1 expref: 9 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.441723:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff39868ac00) 00010000:00010000:2.0:1788263489.441726:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788263489.441732:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed400/0x4b1103cba6670b0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702d1 expref: 9 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.441745:0:17066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eed400, rc 0) 00000100:00100000:2.0:1788263489.441812:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+8:15553:x1875129699270528:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 387us (7522us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788263489.441820:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 32 00000100:00100000:2.0:1788263489.447267:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263489.448318:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699270784 00000100:00100000:3.0:1788263489.448330:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699270784 00000100:00100000:3.0:1788263489.448394:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:3.0:1788263489.448405:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+8:15553:x1875129699270784:12345-192.168.203.26@tcp:36:lfs.0 00010000:00010000:3.0:1788263489.448458:0:17065:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263489.448484:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba6670b03 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702ca expref: 8 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.448504:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ff39868a100) 00010000:00010000:3.0:1788263489.448508:0:17065:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263489.448530:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba6670b18 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.448561:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba6670b18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.448571:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba6670b18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788263489.448792:0:17065:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000835cb9c2 reply state 000000005ff9202f transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba6670b18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.448806:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba6670b18 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.448812:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ff39868a100) 00010000:00010000:3.0:1788263489.448814:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1788263489.448817:0:17065:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788263489.448824:0:17065:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788263489.448917:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+9:15553:x1875129699270784:12345-192.168.203.26@tcp:36:lfs.0 Request processed in 513us (1657us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788263489.448925:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:1.0:1788263489.451403:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263489.451513:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699271040 00000100:00100000:2.0:1788263489.451522:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699271040 00000100:00100000:2.0:1788263489.451694:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:2.0:1788263489.451707:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+9:15553:x1875129699271040:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:2.0:1788263489.451915:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+10:15553:x1875129699271040:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 209us (519us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788263489.451922:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:2.0:1788263489.457550:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263489.457799:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699271296 00000100:00100000:3.0:1788263489.457810:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699271296 00000100:00100000:3.0:1788263489.457871:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:3.0:1788263489.457893:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+10:15553:x1875129699271296:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788263489.457915:0:18294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263489.457940:0:18294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba6670b1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11702d8 expref: -99 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.458011:0:18294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670b26 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.458039:0:18294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670b26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.458051:0:18294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670b26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.458079:0:18294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670b2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.458096:0:18294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670b2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.458104:0:18294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670b2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263489.458205:0:18294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788263489.458274:0:18294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670b26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.458282:0:18294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670b26 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.458288:0:18294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670b26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.458294:0:18294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765a00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263489.458298:0:18294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670b26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.458306:0:18294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670b26 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.458329:0:18294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff39868ac00) 00010000:00010000:3.0:1788263489.458332:0:18294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263489.458337:0:18294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670b26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.458342:0:18294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670b26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.458354:0:18294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670b2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.458360:0:18294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670b2d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.458366:0:18294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670b2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.458372:0:18294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765c00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263489.458375:0:18294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670b2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.458381:0:18294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670b2d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.458388:0:18294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ff39868ad00) 00010000:00010000:3.0:1788263489.458390:0:18294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263489.458393:0:18294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670b2d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.458399:0:18294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670b2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.458441:0:18294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba6670b1f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702d8 expref: 12 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.458452:0:18294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff39868ac00) 00010000:00010000:3.0:1788263489.458454:0:18294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788263489.458457:0:18294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba6670b1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702d8 expref: 12 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.458465:0:18294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae765400, rc 0) 00000100:00100000:3.0:1788263489.459008:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+11:15553:x1875129699271296:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1114us (1464us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788263489.459017:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:0.0:1788263489.467610:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263489.468412:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699271424 00000100:00100000:3.0:1788263489.468423:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699271424 00000100:00100000:3.0:1788263489.468489:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00100000:3.0:1788263489.468500:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+11:15553:x1875129699271424:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788263489.468525:0:17065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263489.468546:0:17065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba6670b3b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11702df expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.468699:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670b42 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.468714:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670b42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.468726:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670b42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263489.468773:0:17065:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788263489.468777:0:17065:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788263489.468796:0:17065:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670b42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.468822:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba6670b3b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702df expref: 13 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.468840:0:17065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670b42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702df expref: 12 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.468850:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ff39868a100) 00010000:00010000:3.0:1788263489.468853:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788263489.468857:0:17065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae765c00, rc 0) 00000100:00100000:3.0:1788263489.468926:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+12:15553:x1875129699271424:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 427us (1359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263489.468934:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00100000:1.0:1788263489.472931:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263489.473015:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699271552 00000100:00100000:3.0:1788263489.473033:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699271552 00000100:00100000:3.0:1788263489.473129:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:3.0:1788263489.473142:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+12:15553:x1875129699271552:12345-192.168.203.26@tcp:37:lfs.0 00000100:00100000:2.0:1788263489.484013:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+12:15553:x1875129699271552:12345-192.168.203.26@tcp:37:lfs.0 Request processed in 10858us (11076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263489.484030:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:0.0:1788263489.488189:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263489.488426:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699271808 00000100:00100000:2.0:1788263489.488439:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699271808 00000100:00100000:2.0:1788263489.488518:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:2.0:1788263489.488531:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc4df050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+12:15553:x1875129699271808:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1788263489.495647:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc4df050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+13:15553:x1875129699271808:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 7101us (7456us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788263489.495664:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:1.0:1788263489.557747:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263489.558316:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699271936 00000100:00100000:2.0:1788263489.558331:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699271936 00000100:00100000:2.0:1788263489.558518:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 36 00000100:00100000:2.0:1788263489.558532:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+11:15559:x1875129699271936:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:2.0:1788263489.558560:0:17066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263489.558621:0:17066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba6670b49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11702e6 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.558711:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba6670b50 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.558742:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba6670b50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.558758:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba6670b50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.558772:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba6670b57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.558781:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba6670b57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.558789:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba6670b57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.558908:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba6670b5e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.558919:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba6670b5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.559108:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba6670b5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263489.559159:0:17066:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788263489.559163:0:17066:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788263489.562014:0:17066:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba6670b5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.562053:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba6670b50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.562062:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba6670b50 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.562071:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba6670b50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.562078:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eed600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263489.562084:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba6670b50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.562104:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba6670b50 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.562126:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff39868ac00) 00010000:00010000:2.0:1788263489.562130:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263489.562136:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba6670b50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.562144:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba6670b50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.562193:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba6670b57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.562200:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba6670b57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.563863:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba6670b57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.563873:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eec200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263489.563879:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba6670b57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.563889:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba6670b57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.563910:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ff39868ad00) 00010000:00010000:2.0:1788263489.563913:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263489.563918:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba6670b57 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.564461:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba6670b57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.564540:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba6670b49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702e6 expref: 13 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.564558:0:17066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eeca00/0x4b1103cba6670b5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702e6 expref: 12 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.564623:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ff39868a100) 00010000:00010000:2.0:1788263489.564625:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788263489.564628:0:17066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eeca00, rc 0) 00000100:00100000:0.0:1788263489.565266:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+12:15559:x1875129699271936:12345-192.168.203.26@tcp:101:bash.0 Request processed in 6393us (7199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263489.565281:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 36 00000100:00100000:2.0:1788263489.572196:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263489.572436:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699272064 00000100:00100000:0.0:1788263489.572449:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699272064 00000100:00100000:0.0:1788263489.572519:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:0.0:1788263489.572531:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6218fa09-9d3e-4029-b371-f2f7a141bebe+5:15559:x1875129699272064:12345-192.168.203.26@tcp:900:bash.0 00000100:00100000:0.0:1788263489.572665:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6218fa09-9d3e-4029-b371-f2f7a141bebe+5:15559:x1875129699272064:12345-192.168.203.26@tcp:900:bash.0 Request processed in 135us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263489.572675:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:3.0:1788263489.576133:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263489.576435:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699272320 00000100:00100000:1.0:1788263489.576448:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699272320 00000100:00100000:1.0:1788263489.576557:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 37 00000100:00100000:1.0:1788263489.576570:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+12:15559:x1875129699272320:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1788263489.576636:0:17065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263489.576662:0:17065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ed000/0x4b1103cba6670b65 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11702ed expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.576825:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823eca00/0x4b1103cba6670b6c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.576844:0:17065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670b42 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702df expref: 12 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.576855:0:17065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823eca00/0x4b1103cba6670b6c lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.576897:0:17065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670b42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11702df expref: 12 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263489.576914:0:17065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670b42 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11702df expref: 12 pid: 17065 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263489.576942:0:17065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff2838cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17065:1875129709841280:192.168.203.26@tcp:104: 00000100:00100000:1.0:1788263489.577055:0:17065:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2810a8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788263489.585119:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263489.585157:0:17065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff2838cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17065:1875129709841280:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788263489.585193:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699272448 00010000:00010000:3.0:1788263489.585197:0:17065:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823eca00/0x4b1103cba6670b6c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263489.585203:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699272448 00010000:00010000:0.0:1788263489.585256:0:17050:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670b42 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11702df expref: 13 pid: 17065 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263489.585304:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:0.0:1788263489.585315:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+13:2386:x1875129699272448:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263489.585334:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263489.585343:0:17050:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670b42 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11702df expref: 13 pid: 17065 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263489.585357:0:17050:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670b42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11702df expref: 13 pid: 17065 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263489.585388:0:17050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670b42 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11702df expref: 13 pid: 17065 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263489.585407:0:17050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ff39868a100) 00010000:00010000:0.0:1788263489.585413:0:17050:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823eca00/0x4b1103cba6670b6c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263489.585445:0:17050:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823eca00/0x4b1103cba6670b6c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263489.585454:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823eca00/0x4b1103cba6670b6c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263489.585479:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263489.585550:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+12:2386:x1875129699272448:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 235us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263489.585559:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 16 00010000:00010000:3.0:1788263489.585748:0:17065:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823eca00/0x4b1103cba6670b6c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.585764:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823eca00/0x4b1103cba6670b6c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.585792:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba6670b73 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.585804:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba6670b73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.585813:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba6670b73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.586454:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670b7a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.586465:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670b7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.586473:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670b7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263489.586485:0:17065:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788263489.586516:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823eca00/0x4b1103cba6670b6c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.586524:0:17065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823eca00/0x4b1103cba6670b6c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.586532:0:17065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823eca00/0x4b1103cba6670b6c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.586538:0:17065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff2823eca00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263489.586552:0:17065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823eca00/0x4b1103cba6670b6c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.586561:0:17065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823eca00/0x4b1103cba6670b6c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.586575:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ff39868a100) 00010000:00010000:3.0:1788263489.586605:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263489.586610:0:17065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823eca00/0x4b1103cba6670b6c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.586616:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823eca00/0x4b1103cba6670b6c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788263489.586631:0:17065:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001e31981 reply state 0000000097ac78a9 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba6670b73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.586644:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba6670b73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.586651:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9ff39868a400) 00010000:00010000:3.0:1788263489.586654:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788263489.586657:0:17065:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788263489.586700:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ed000/0x4b1103cba6670b65 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702ed expref: 15 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.586715:0:17065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670b7a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702ed expref: 14 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263489.586723:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:3.0:1788263489.586725:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788263489.586733:0:17065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae765a00, rc 0) 00000100:00100000:3.0:1788263489.586789:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+15:15559:x1875129699272320:12345-192.168.203.26@tcp:101:bash.0 Request processed in 10222us (10669us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788263489.586798:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 37 00000100:00100000:3.0:1788263489.615511:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263489.616134:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699272576 00000100:00100000:0.0:1788263489.616150:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699272576 00000100:00100000:0.0:1788263489.616299:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 38 00000100:00100000:0.0:1788263489.616322:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6218fa09-9d3e-4029-b371-f2f7a141bebe+15:15559:x1875129699272576:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1788263489.616362:0:18294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263489.616388:0:18294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9200/0x4b1103cba6670b88 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11702f4 expref: -99 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263489.616476:0:18294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9800/0x4b1103cba6670b8f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263489.616493:0:18294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9800/0x4b1103cba6670b8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263489.616505:0:18294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9800/0x4b1103cba6670b8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263489.616631:0:18294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788263489.616636:0:18294:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788263489.616682:0:18294:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9800/0x4b1103cba6670b8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263489.616695:0:18294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9800/0x4b1103cba6670b8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263489.616724:0:18294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9200/0x4b1103cba6670b88 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702f4 expref: 17 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263489.616756:0:18294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9800/0x4b1103cba6670b8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702f4 expref: 16 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263489.616766:0:18294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:0.0:1788263489.616770:0:18294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263489.616774:0:18294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3829e9800, rc 0) 00000100:00100000:0.0:1788263489.616843:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6218fa09-9d3e-4029-b371-f2f7a141bebe+16:15559:x1875129699272576:12345-192.168.203.26@tcp:101:bash.0 Request processed in 533us (1349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263489.616851:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 38 00000100:00100000:2.0:1788263489.623059:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263489.623197:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699272832 00000100:00100000:0.0:1788263489.623211:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699272832 00000100:00100000:0.0:1788263489.623279:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:0.0:1788263489.623292:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+16:15559:x1875129699272832:12345-192.168.203.26@tcp:35:bash.0 00000100:00100000:0.0:1788263489.624318:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+17:15559:x1875129699272832:12345-192.168.203.26@tcp:35:bash.0 Request processed in 1022us (1265us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788263489.624331:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:1.0:1788263489.721505:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263489.721632:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699273088 00000100:00100000:2.0:1788263489.721642:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699273088 00000100:00100000:2.0:1788263489.721706:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 39 00000100:00100000:2.0:1788263489.721715:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+17:15569:x1875129699273088:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788263489.721738:0:17067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263489.721758:0:17067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba6670b96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d11702fb expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263489.721853:0:17067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788263489.722175:0:17067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba6670b96 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702fb expref: 19 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.722191:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff39868ac00) 00010000:00010000:2.0:1788263489.722194:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788263489.722199:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba6670b96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702fb expref: 19 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.722214:0:17067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eec200, rc 0) 00000100:00100000:2.0:1788263489.722274:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+18:15569:x1875129699273088:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 559us (778us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788263489.722281:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 39 00000100:00100000:3.0:1788263489.724447:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263489.724538:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699273344 00000100:00100000:0.0:1788263489.724546:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699273344 00000100:00100000:0.0:1788263489.724624:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:0.0:1788263489.724633:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+18:15569:x1875129699273344:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:0.0:1788263489.724829:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+19:15569:x1875129699273344:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 196us (388us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788263489.724836:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:3.0:1788263489.768186:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263489.768322:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699273600 00000100:00100000:2.0:1788263489.768331:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699273600 00000100:00100000:2.0:1788263489.768404:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 40 00000100:00100000:2.0:1788263489.768415:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+19:15572:x1875129699273600:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788263489.768440:0:17066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263489.768460:0:17066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba6670ba4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170302 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.768573:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba6670bab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.768629:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba6670bab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.768641:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba6670bab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263489.768652:0:17066:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788263489.768751:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba6670ba4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170302 expref: 22 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.768769:0:17066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba6670bab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170302 expref: 21 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.768777:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:2.0:1788263489.768781:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788263489.768784:0:17066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eedc00, rc 0) 00000100:00100000:2.0:1788263489.768848:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+21:15572:x1875129699273600:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 435us (671us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788263489.768873:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 40 00000100:00100000:2.0:1788263489.774334:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263489.774393:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263489.774421:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699273728 00000100:00100000:2.0:1788263489.774430:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699273728 00000100:00100000:2.0:1788263489.774490:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:2.0:1788263489.774499:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc225880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+21:2387:x1875129699273728:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263489.774514:0:17051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263489.774539:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba6670bab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170302 expref: 21 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263489.774558:0:17051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:2.0:1788263489.774562:0:17051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263489.774630:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc225880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+20:2387:x1875129699273728:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 131us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263489.774638:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:0.0:1788263489.775797:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699273856 00000100:00100000:0.0:1788263489.775809:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699273856 00000100:00100000:0.0:1788263489.775859:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:0.0:1788263489.775868:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+20:15572:x1875129699273856:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:0.0:1788263489.775930:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9200/0x4b1103cba6670bb9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263489.775945:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9200/0x4b1103cba6670bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263489.775956:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9200/0x4b1103cba6670bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263489.775989:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9200/0x4b1103cba6670bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263489.775996:0:17065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9200/0x4b1103cba6670bb9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263489.776004:0:17065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9200/0x4b1103cba6670bb9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263489.776009:0:17065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263489.776014:0:17065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9200/0x4b1103cba6670bb9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263489.776021:0:17065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9200/0x4b1103cba6670bb9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263489.776044:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:0.0:1788263489.776047:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788263489.776052:0:17065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9200/0x4b1103cba6670bb9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263489.776058:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9200/0x4b1103cba6670bb9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263489.776132:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+20:15572:x1875129699273856:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 264us (1806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263489.776139:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 41 00010000:00010000:0.0:1788263489.779598:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263489.780003:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263489.780130:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699274112 00000100:00100000:0.0:1788263489.780140:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699274112 00000100:00100000:0.0:1788263489.780321:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:0.0:1788263489.780333:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+20:15572:x1875129699274112:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:0.0:1788263489.780551:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+21:15572:x1875129699274112:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 221us (553us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788263489.780558:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 7 00000040:00080000:2.0:1788263489.968786:0:17817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788263490.032241:0:17101:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788263490.142442:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263490.142550:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699274368 00000100:00100000:2.0:1788263490.142560:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699274368 00000100:00100000:2.0:1788263490.142653:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:2.0:1788263490.142664:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+21:15603:x1875129699274368:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:2.0:1788263490.142688:0:17066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263490.142708:0:17066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba6670bc0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170309 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263490.142839:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba6670bc7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263490.142854:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba6670bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263490.142867:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba6670bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263490.142879:0:17066:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788263490.143196:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba6670bc0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170309 expref: 24 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263490.143214:0:17066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba6670bc7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170309 expref: 23 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263490.143222:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:2.0:1788263490.143225:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788263490.143229:0:17066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eec200, rc 0) 00000100:00100000:2.0:1788263490.143294:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+23:15603:x1875129699274368:12345-192.168.203.26@tcp:101:cat.0 Request processed in 632us (863us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788263490.143301:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:2.0:1788263490.150975:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263490.151019:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263490.151144:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699274624 00000100:00100000:1.0:1788263490.151154:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699274624 00000100:00100000:1.0:1788263490.151214:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00100000:1.0:1788263490.151224:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+23:15603:x1875129699274624:12345-192.168.203.26@tcp:35:cat.0 00000100:00100000:0.0:1788263490.151412:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699274752 00000100:00100000:0.0:1788263490.151417:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699274752 00000100:00100000:0.0:1788263490.151460:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1 00000100:00100000:0.0:1788263490.151467:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc224a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+25:2387:x1875129699274752:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263490.151492:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788263490.151519:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+25:15603:x1875129699274624:12345-192.168.203.26@tcp:35:cat.0 Request processed in 296us (553us total) trans 8589934607 rc 0/0 00010000:00010000:0.0:1788263490.151525:0:17050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec200/0x4b1103cba6670bc7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170309 expref: 25 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263490.151527:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 8 00010000:00010000:0.0:1788263490.151552:0:17050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:0.0:1788263490.151558:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263490.151607:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc224a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+23:2387:x1875129699274752:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 112us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263490.151614:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1 00000100:00100000:3.0:1788263490.254887:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263490.254985:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699275008 00000100:00100000:0.0:1788263490.254995:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699275008 00000100:00100000:0.0:1788263490.255055:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 43 00000100:00100000:0.0:1788263490.255065:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+23:15609:x1875129699275008:12345-192.168.203.26@tcp:101:dd.0 00010000:00010000:0.0:1788263490.255103:0:17065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263490.255125:0:17065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9200/0x4b1103cba6670bd5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170310 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263490.255229:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670bdc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263490.255243:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670bdc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263490.255253:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670bdc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263490.255264:0:17065:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788263490.255382:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9200/0x4b1103cba6670bd5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170310 expref: 26 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263490.255400:0:17065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670bdc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170310 expref: 25 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263490.255420:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:0.0:1788263490.255423:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788263490.255427:0:17065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3829e8400, rc 0) 00000100:00100000:0.0:1788263490.255488:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+25:15609:x1875129699275008:12345-192.168.203.26@tcp:101:dd.0 Request processed in 424us (610us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788263490.255495:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 43 00000100:00100000:1.0:1788263490.262351:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263490.262471:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699275264 00000100:00100000:3.0:1788263490.262481:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699275264 00000100:00100000:3.0:1788263490.262554:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:3.0:1788263490.262566:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+25:2386:x1875129699275264:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263490.262607:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263490.262631:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670bdc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170310 expref: 25 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.262648:0:17052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:3.0:1788263490.262652:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263490.262714:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+24:2386:x1875129699275264:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 150us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263490.262722:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:1.0:1788263490.266112:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263490.267421:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699275136 00000100:00100000:0.0:1788263490.269022:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699275136 00000100:00100000:0.0:1788263490.269189:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:0.0:1788263490.269202:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6218fa09-9d3e-4029-b371-f2f7a141bebe+24:15609:x1875129699275136:12345-192.168.203.26@tcp:101:dd.0 00010000:00010000:0.0:1788263490.269237:0:18294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263490.269259:0:18294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9200/0x4b1103cba6670bea lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170317 expref: -99 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263490.269293:0:18294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba6670bf1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263490.269307:0:18294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba6670bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263490.269318:0:18294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba6670bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263490.269443:0:18294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9200/0x4b1103cba6670bea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170317 expref: 26 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263490.269462:0:18294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba6670bf1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170317 expref: 25 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263490.269478:0:18294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:0.0:1788263490.269481:0:18294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788263490.269485:0:18294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3829e8800, rc 0) 00000100:00100000:0.0:1788263490.269562:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6218fa09-9d3e-4029-b371-f2f7a141bebe+25:15609:x1875129699275136:12345-192.168.203.26@tcp:101:dd.0 Request processed in 362us (3458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263490.269569:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:2.0:1788263490.273850:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263490.273999:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699275520 00000100:00100000:0.0:1788263490.274009:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699275520 00000100:00100000:0.0:1788263490.274073:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 45 00000100:00100000:0.0:1788263490.274090:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+25:15609:x1875129699275520:12345-192.168.203.26@tcp:36:dd.0 00010000:00010000:0.0:1788263490.274142:0:17065:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263490.274166:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9800/0x4b1103cba6670b8f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702f4 expref: 25 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263490.274185:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:0.0:1788263490.274189:0:17065:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788263490.274362:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba6670bf8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263490.274375:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba6670bf8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263490.274384:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba6670bf8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788263490.274425:0:17065:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788263490.274447:0:17065:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1b8b4f2 reply state 00000000b34e4050 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba6670bf8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263490.274470:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba6670bf8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263490.274477:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:0.0:1788263490.274479:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788263490.274482:0:17065:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788263490.274617:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+27:15609:x1875129699275520:12345-192.168.203.26@tcp:36:dd.0 Request processed in 534us (773us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788263490.274631:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 45 00000020:00080000:0.0:1788263490.274635:0:17065:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788263490.418720:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263490.419022:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699275776 00000100:00100000:3.0:1788263490.419032:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699275776 00000100:00100000:3.0:1788263490.419106:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:3.0:1788263490.419117:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2838cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+27:15609:x1875129699275776:12345-192.168.203.26@tcp:35:dd.0 00000100:00100000:3.0:1788263490.419343:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2838cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+28:15609:x1875129699275776:12345-192.168.203.26@tcp:35:dd.0 Request processed in 227us (633us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1788263490.419364:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:1.0:1788263490.672395:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263490.672476:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699275904 00000100:00100000:3.0:1788263490.672486:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699275904 00000100:00100000:3.0:1788263490.672548:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 46 00000100:00100000:3.0:1788263490.672560:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28398b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+28:15623:x1875129699275904:12345-192.168.203.26@tcp:101:stat.0 00010000:00010000:3.0:1788263490.672624:0:17066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263490.672662:0:17066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764200/0x4b1103cba6670bff lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d117031e expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.672730:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765600/0x4b1103cba6670c06 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.672743:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765600/0x4b1103cba6670c06 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.672754:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765600/0x4b1103cba6670c06 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.672765:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670c0d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.672771:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670c0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.672776:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670c0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.672860:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68200/0x4b1103cba6670c14 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.672886:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68200/0x4b1103cba6670c14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.672894:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68200/0x4b1103cba6670c14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263490.673111:0:17066:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788263490.673116:0:17066:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788263490.673153:0:17066:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68200/0x4b1103cba6670c14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.673167:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68200/0x4b1103cba6670c14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.673175:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765600/0x4b1103cba6670c06 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.673181:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765600/0x4b1103cba6670c06 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.673187:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765600/0x4b1103cba6670c06 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.673193:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263490.673196:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765600/0x4b1103cba6670c06 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.673203:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765600/0x4b1103cba6670c06 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.673215:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ff39868a100) 00010000:00010000:3.0:1788263490.673224:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263490.673229:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765600/0x4b1103cba6670c06 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.673234:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765600/0x4b1103cba6670c06 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.673249:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670c0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.673255:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670c0d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.673261:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670c0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.673266:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765c00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263490.673268:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670c0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.673274:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670c0d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.673281:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9ff39868a400) 00010000:00010000:3.0:1788263490.673284:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263490.673286:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670c0d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.673291:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670c0d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.673318:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764200/0x4b1103cba6670bff lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117031e expref: 30 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.673347:0:17066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68200/0x4b1103cba6670c14 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117031e expref: 29 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.673354:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:3.0:1788263490.673356:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263490.673359:0:17066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b68200, rc 0) 00000100:00100000:3.0:1788263490.673422:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28398b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+29:15623:x1875129699275904:12345-192.168.203.26@tcp:101:stat.0 Request processed in 864us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263490.673429:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 46 00000100:00100000:0.0:1788263490.797774:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263490.797898:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699276160 00000100:00100000:3.0:1788263490.797909:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699276160 00000100:00100000:3.0:1788263490.798066:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 47 00000100:00100000:3.0:1788263490.798086:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+29:15629:x1875129699276160:12345-192.168.203.26@tcp:36:truncate.0 00010000:00010000:3.0:1788263490.798292:0:17065:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263490.798378:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68200/0x4b1103cba6670c14 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117031e expref: 29 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.798403:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:3.0:1788263490.798407:0:17065:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263490.798635:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69200/0x4b1103cba6670c1b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.798648:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69200/0x4b1103cba6670c1b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.798666:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69200/0x4b1103cba6670c1b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788263490.798723:0:17065:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1788263490.798746:0:17065:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ffe18ec reply state 00000000fb3be2b6 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69200/0x4b1103cba6670c1b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.798758:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69200/0x4b1103cba6670c1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.798765:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:3.0:1788263490.798767:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788263490.798770:0:17065:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788263490.799060:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+31:15629:x1875129699276160:12345-192.168.203.26@tcp:36:truncate.0 Request processed in 975us (1284us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1788263490.799068:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 47 00000020:00080000:3.0:1788263490.799073:0:17065:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788263490.800243:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263490.979775:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263490.979852:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699276288 00000100:00100000:0.0:1788263490.979862:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699276288 00000100:00100000:3.0:1788263490.980018:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 48 00000100:00100000:3.0:1788263490.980029:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff398663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+31:15643:x1875129699276288:12345-192.168.203.26@tcp:101:stat.0 00010000:00010000:3.0:1788263490.980053:0:17066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263490.980073:0:17066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68200/0x4b1103cba6670c22 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170325 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980151:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670c29 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980165:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670c29 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980177:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670c29 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980327:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670c30 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980400:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670c30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980409:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670c30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980481:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670c37 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980490:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670c37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980497:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670c37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263490.980537:0:17066:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1788263490.980541:0:17066:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788263490.980559:0:17066:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670c37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980571:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670c37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980613:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670c29 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980619:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670c29 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980637:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670c29 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980643:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b68000 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263490.980648:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670c29 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980656:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670c29 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980667:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ff39868a100) 00010000:00010000:3.0:1788263490.980670:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263490.980675:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670c29 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980681:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670c29 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980694:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670c30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980700:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670c30 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980706:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670c30 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980710:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b68c00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263490.980713:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670c30 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980730:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670c30 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980739:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9ff39868a400) 00010000:00010000:3.0:1788263490.980741:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263490.980745:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670c30 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980751:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670c30 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980779:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68200/0x4b1103cba6670c22 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170325 expref: 33 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980790:0:17066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670c37 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170325 expref: 32 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263490.980796:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:3.0:1788263490.980811:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263490.980814:0:17066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b68400, rc 0) 00000100:00100000:3.0:1788263490.980877:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff398663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+32:15643:x1875129699276288:12345-192.168.203.26@tcp:101:stat.0 Request processed in 850us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263490.980885:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 48 00000100:00100000:0.0:1788263491.070566:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263491.070694:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699276544 00000100:00100000:2.0:1788263491.070704:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699276544 00000100:00100000:2.0:1788263491.070787:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00100000:2.0:1788263491.070798:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+32:15653:x1875129699276544:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788263491.070818:0:17067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263491.070838:0:17067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba6670c3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d117032c expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788263491.070997:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1788263491.071269:0:17067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788263491.071561:0:17067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba6670c3e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117032c expref: 34 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263491.071575:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff39868ac00) 00010000:00010000:2.0:1788263491.071611:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788263491.071616:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eedc00/0x4b1103cba6670c3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117032c expref: 34 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263491.071628:0:17067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eedc00, rc 0) 00000100:00100000:2.0:1788263491.071683:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+33:15653:x1875129699276544:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 888us (1125us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1788263491.071690:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00100000:0.0:1788263491.074872:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263491.075131:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699276800 00000100:00100000:3.0:1788263491.075141:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699276800 00000100:00100000:3.0:1788263491.075195:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:3.0:1788263491.075450:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc4dfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+33:15653:x1875129699276800:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1788263491.075738:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc4dfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+34:15653:x1875129699276800:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 533us (873us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788263491.075746:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:1.0:1788263491.149733:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263491.149818:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699277056 00000100:00100000:0.0:1788263491.149827:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699277056 00000100:00100000:0.0:1788263491.149879:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 50 00000100:00100000:0.0:1788263491.149888:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6218fa09-9d3e-4029-b371-f2f7a141bebe+34:15659:x1875129699277056:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1788263491.149910:0:18294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263491.149938:0:18294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670c4c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170333 expref: -99 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263491.150032:0:18294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9a00/0x4b1103cba6670c53 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263491.150046:0:18294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670b7a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d11702ed expref: 35 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263491.150068:0:18294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670c37 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170325 expref: 35 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263491.150086:0:18294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9a00/0x4b1103cba6670c53 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263491.150119:0:18294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670c37 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170325 expref: 35 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263491.150132:0:18294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670c37 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170325 expref: 35 pid: 17066 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263491.150144:0:18294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b73480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18294:1875129709841408:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788263491.150233:0:18294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670b7a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11702ed expref: 35 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263491.150251:0:18294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670b7a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11702ed expref: 35 pid: 17065 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263491.150261:0:18294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b72680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18294:1875129709841536:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788263491.150284:0:18294:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3a969c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263491.173190:0:18294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b73480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18294:1875129709841408:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788263491.173204:0:18294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b72680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18294:1875129709841536:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263491.173228:0:18294:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9a00/0x4b1103cba6670c53 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263491.176531:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263491.176562:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263491.176847:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699277312 00000100:00100000:2.0:1788263491.176847:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699277184 00000100:00100000:3.0:1788263491.176857:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699277312 00000100:00100000:2.0:1788263491.176857:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699277184 00010000:00010000:2.0:1788263491.176899:0:17052:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670c37 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170325 expref: 37 pid: 17066 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263491.176929:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:2.0:1788263491.176939:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b54b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+37:2386:x1875129699277184:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263491.176954:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263491.176974:0:17052:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670c37 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170325 expref: 37 pid: 17066 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263491.176987:0:17052:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670c37 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170325 expref: 37 pid: 17066 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263491.177010:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670c37 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170325 expref: 37 pid: 17066 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263491.177027:0:17052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:2.0:1788263491.177032:0:17052:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9a00/0x4b1103cba6670c53 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263491.177040:0:17052:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9a00/0x4b1103cba6670c53 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263491.177047:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263491.177156:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b54b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+36:2386:x1875129699277184:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 216us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263491.177164:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 17 00010000:00010000:3.0:1788263491.184598:0:17051:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670b7a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11702ed expref: 36 pid: 17065 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263491.184657:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:3.0:1788263491.184675:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+36:2387:x1875129699277312:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263491.184689:0:17051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263491.184695:0:17051:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670b7a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11702ed expref: 36 pid: 17065 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.184708:0:17051:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670b7a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11702ed expref: 36 pid: 17065 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.184729:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670b7a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d11702ed expref: 36 pid: 17065 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.184746:0:17051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:3.0:1788263491.184762:0:17051:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9a00/0x4b1103cba6670c53 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.185637:0:17051:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9a00/0x4b1103cba6670c53 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.185649:0:17051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9a00/0x4b1103cba6670c53 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.185752:0:17051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263491.185880:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+34:2387:x1875129699277312:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 1212us (9314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263491.185899:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 18 00010000:00010000:0.0:1788263491.185908:0:18294:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9a00/0x4b1103cba6670c53 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263491.185920:0:18294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9a00/0x4b1103cba6670c53 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263491.185953:0:18294:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1788263491.186090:0:18294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670c4c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170333 expref: 35 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263491.186110:0:18294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9a00/0x4b1103cba6670c53 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170333 expref: 34 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263491.186117:0:18294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:0.0:1788263491.186119:0:18294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788263491.186122:0:18294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3829e9a00, rc 0) 00000100:00100000:0.0:1788263491.186813:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6218fa09-9d3e-4029-b371-f2f7a141bebe+34:15659:x1875129699277056:12345-192.168.203.26@tcp:101:bash.0 Request processed in 36922us (37084us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1788263491.186821:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 50 00000100:00100000:1.0:1788263491.194755:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263491.194884:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699277568 00000100:00100000:0.0:1788263491.194893:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699277568 00000100:00100000:0.0:1788263491.194957:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 51 00000100:00100000:0.0:1788263491.194968:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+34:15659:x1875129699277568:12345-192.168.203.26@tcp:36:bash.0 00010000:00010000:0.0:1788263491.195186:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670c61 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263491.195201:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670c61 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263491.195210:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670c61 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788263491.195248:0:17065:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:0.0:1788263491.195284:0:17065:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037e1878e reply state 000000001be489cf transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670c61 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263491.195296:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670c61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263491.195303:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:0.0:1788263491.195305:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788263491.195309:0:17065:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788263491.195602:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+37:15659:x1875129699277568:12345-192.168.203.26@tcp:36:bash.0 Request processed in 441us (661us total) trans 8589934618 rc 0/0 00000100:00100000:0.0:1788263491.195611:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 51 00000020:00080000:0.0:1788263491.195617:0:17065:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788263491.212890:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263491.213034:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699277696 00000100:00100000:3.0:1788263491.213043:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699277696 00000100:00100000:3.0:1788263491.213113:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:3.0:1788263491.213124:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+37:15659:x1875129699277696:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1788263491.213150:0:17066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263491.213171:0:17066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68200/0x4b1103cba6670c68 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d117033a expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.213228:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68200/0x4b1103cba6670c68 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117033a expref: 38 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.213243:0:17066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68200/0x4b1103cba6670c68 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117033a expref: 38 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.213261:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:3.0:1788263491.213264:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788263491.213280:0:17066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b68200, rc 0) 00000100:00100000:3.0:1788263491.213346:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+38:15659:x1875129699277696:12345-192.168.203.26@tcp:101:bash.0 Request processed in 224us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263491.213354:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:1.0:1788263491.234474:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263491.234566:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699277824 00000100:00100000:2.0:1788263491.234575:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699277824 00000100:00100000:2.0:1788263491.234650:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:2.0:1788263491.234661:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+38:15659:x1875129699277824:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:2.0:1788263491.234680:0:17067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263491.234699:0:17067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba6670c6f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170341 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263491.234801:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba6670c76 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263491.234820:0:17067:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9a00/0x4b1103cba6670c53 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170333 expref: 39 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263491.234828:0:17067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba6670c76 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263491.234863:0:17067:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9a00/0x4b1103cba6670c53 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170333 expref: 39 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263491.234875:0:17067:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9a00/0x4b1103cba6670c53 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170333 expref: 39 pid: 18294 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263491.234889:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bc225880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17067:1875129709841664:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788263491.234961:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff38325c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788263491.251150:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263491.251249:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699277952 00000100:00100000:0.0:1788263491.251259:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699277952 00010000:00010000:0.0:1788263491.251302:0:17050:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9a00/0x4b1103cba6670c53 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170333 expref: 40 pid: 18294 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263491.251347:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:0.0:1788263491.251356:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+40:2387:x1875129699277952:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263491.251371:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263491.251377:0:17050:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9a00/0x4b1103cba6670c53 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170333 expref: 40 pid: 18294 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263491.251391:0:17050:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9a00/0x4b1103cba6670c53 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170333 expref: 40 pid: 18294 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263491.251412:0:17050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:0.0:1788263491.251418:0:17050:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba6670c76 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263491.251442:0:17050:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba6670c76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263491.251449:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba6670c76 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263491.251480:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263491.251535:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+40:2387:x1875129699277952:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 180us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263491.251542:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 19 00010000:00010000:2.0:1788263491.252744:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9a00/0x4b1103cba6670c53 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170333 expref: 39 pid: 18294 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263491.252765:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bc225880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17067:1875129709841664:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788263491.252787:0:17067:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba6670c76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263491.252796:0:17067:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba6670c76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263491.252802:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba6670c76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263491.252855:0:17067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788263491.252872:0:17067:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788263491.252894:0:17067:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba6670c76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263491.252925:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba6670c6f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170341 expref: 39 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263491.252939:0:17067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba6670c76 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170341 expref: 38 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263491.252959:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:2.0:1788263491.252962:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788263491.252965:0:17067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eec600, rc 0) 00000100:00100000:2.0:1788263491.253022:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+38:15659:x1875129699277824:12345-192.168.203.26@tcp:101:bash.0 Request processed in 18362us (18556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263491.253029:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:1.0:1788263491.256513:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263491.256660:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699278208 00000100:00100000:3.0:1788263491.256670:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699278208 00000100:00100000:3.0:1788263491.256743:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:3.0:1788263491.256754:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+38:15659:x1875129699278208:12345-192.168.203.26@tcp:103:bash.0 00010000:00010000:3.0:1788263491.256769:0:17051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788263491.256794:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68200/0x4b1103cba6670c68 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117033a expref: 38 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.256813:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec600/0x4b1103cba6670c76 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170341 expref: 37 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.256824:0:17051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:3.0:1788263491.256828:0:17051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263491.256890:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+36:15659:x1875129699278208:12345-192.168.203.26@tcp:103:bash.0 Request processed in 138us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263491.256897:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:1.0:1788263491.259972:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263491.260095:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699278336 00000100:00100000:3.0:1788263491.260105:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699278336 00000100:00100000:3.0:1788263491.260163:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:3.0:1788263491.260173:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+36:15659:x1875129699278336:12345-192.168.203.26@tcp:58:bash.0 00010000:00010000:3.0:1788263491.260288:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670c7d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.260314:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670c7d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.260339:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670c7d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788263491.261376:0:17066:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788263491.261408:0:17066:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1788263491.261548:0:17066:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1788263491.261777:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+36:15659:x1875129699278336:12345-192.168.203.26@tcp:58:bash.0 Request processed in 1602us (1811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263491.261787:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:0.0:1788263491.264648:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263491.264779:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699278464 00000100:00100000:3.0:1788263491.264788:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699278464 00000100:00100000:3.0:1788263491.264887:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:3.0:1788263491.264897:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+36:15659:x1875129699278464:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1788263491.264915:0:17065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263491.264933:0:17065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670c84 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170348 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.264980:0:17065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670c7d lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.264989:0:17065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670c84 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170348 expref: 37 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.265005:0:17065:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670c7d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.265017:0:17065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670c84 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170348 expref: 37 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.265044:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:3.0:1788263491.265047:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788263491.265051:0:17065:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670c84 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170348 expref: 37 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.265059:0:17065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b68000, rc 0) 00000100:00100000:3.0:1788263491.265124:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+37:15659:x1875129699278464:12345-192.168.203.26@tcp:101:bash.0 Request processed in 228us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263491.265130:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 55 00010000:00010000:0.0:1788263491.825064:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788263492.079782:0:17101:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788263492.079792:0:17101:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788263492.079839:0:17101:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788263492.079847:0:17101:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788263492.080365:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff28312fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17101:1875129709841792:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788263492.080539:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2810a86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263492.090706:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff28312fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17101:1875129709841792:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788263492.092883:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263492.093553:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699278592 00000100:00100000:3.0:1788263492.093563:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699278592 00000100:00100000:3.0:1788263492.093778:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:3.0:1788263492.093791:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff28312fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+37:15660:x1875129699278592:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788263492.093821:0:17066:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788263492.093947:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff28312fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+37:15660:x1875129699278592:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 158us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263492.094816:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:1.0:1788263492.098798:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263492.099291:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699278720 00000100:00100000:2.0:1788263492.099302:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699278720 00000100:00100000:2.0:1788263492.099367:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:2.0:1788263492.099379:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+37:15660:x1875129699278720:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788263492.099450:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba6670c8b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099467:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba6670c8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099491:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba6670c8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099571:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba6670c92 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099616:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba6670c92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099624:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba6670c92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099648:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba6670c99 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099657:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba6670c99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099664:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba6670c99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263492.099709:0:17067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788263492.099713:0:17067:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788263492.099725:0:17067:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba6670c99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099738:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba6670c8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099744:0:17067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba6670c8b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099751:0:17067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba6670c8b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099832:0:17067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eed200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263492.099838:0:17067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba6670c8b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099845:0:17067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba6670c8b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099857:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ff28227aa00) 00010000:00010000:2.0:1788263492.099859:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263492.099863:0:17067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba6670c8b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099870:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed200/0x4b1103cba6670c8b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099883:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba6670c92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099888:0:17067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba6670c92 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099894:0:17067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba6670c92 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099898:0:17067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eed600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263492.099901:0:17067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba6670c92 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099906:0:17067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba6670c92 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099925:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9ff28227a800) 00010000:00010000:2.0:1788263492.099927:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263492.099930:0:17067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba6670c92 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099936:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eed600/0x4b1103cba6670c92 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099949:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba6670c99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099956:0:17067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba6670c99 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099961:0:17067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba6670c99 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099966:0:17067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eece00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263492.099969:0:17067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba6670c99 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099974:0:17067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba6670c99 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099981:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:2.0:1788263492.099984:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263492.099987:0:17067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba6670c99 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.099992:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eece00/0x4b1103cba6670c99 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263492.100091:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+37:15660:x1875129699278720:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 Request processed in 713us (1315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263492.100100:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:1.0:1788263492.104458:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263492.104538:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699278976 00000100:00100000:3.0:1788263492.104548:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699278976 00000100:00100000:3.0:1788263492.104759:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00100000:3.0:1788263492.104773:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+37:15660:x1875129699278976:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788263492.104794:0:17066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263492.104813:0:17066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68200/0x4b1103cba6670ca0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d117034f expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.105354:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670ca7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.105371:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.105381:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263492.105392:0:17066:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788263492.105470:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.105478:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670ca7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.105485:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.105492:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b68400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263492.105496:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.105502:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670ca7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.105513:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:3.0:1788263492.105516:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788263492.105520:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670ca7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.105537:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670ca7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.106728:0:17066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68200/0x4b1103cba6670ca0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117034f expref: 39 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.106746:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ff28227aa00) 00010000:00010000:3.0:1788263492.106748:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788263492.106753:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68200/0x4b1103cba6670ca0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117034f expref: 39 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.106767:0:17066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b68200, rc 0) 00000100:00100000:3.0:1788263492.106836:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+38:15660:x1875129699278976:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 2067us (2387us total) trans 8589934619 rc 301/301 00000100:00100000:3.0:1788263492.106844:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00100000:1.0:1788263492.111184:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263492.111318:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699279104 00000100:00100000:2.0:1788263492.111328:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699279104 00000100:00100000:2.0:1788263492.111384:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:2.0:1788263492.111393:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+38:15660:x1875129699279104:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788263492.111428:0:17067:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788263492.111541:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+38:15660:x1875129699279104:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 149us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263492.111549:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:1.0:1788263492.120537:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263492.126024:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699279360 00000100:00100000:3.0:1788263492.126040:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699279360 00000100:00100000:3.0:1788263492.128276:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:3.0:1788263492.128298:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+38:15660:x1875129699279360:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788263492.128320:0:17065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263492.128341:0:17065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68200/0x4b1103cba6670cb5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170356 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788263492.128745:0:17065:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:3.0:1788263492.128752:0:17065:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:3.0:1788263492.128772:0:17065:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:3.0:1788263492.129103:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670cbc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.129131:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670cbc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.129142:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670cbc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.129198:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68200/0x4b1103cba6670cb5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170356 expref: 41 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.129216:0:17065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670cbc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170356 expref: 40 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.129224:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ff39868a600) 00010000:00010000:3.0:1788263492.129227:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263492.129230:0:17065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff283b68400, rc 0) 00000100:00100000:3.0:1788263492.129290:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+40:15660:x1875129699279360:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 1002us (8762us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1788263492.129298:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:1.0:1788263492.138486:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263492.138679:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699279616 00000100:00100000:3.0:1788263492.138690:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699279616 00000100:00100000:3.0:1788263492.138743:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:3.0:1788263492.138754:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+40:15660:x1875129699279616:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788263492.138808:0:17067:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263492.138834:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68400/0x4b1103cba6670cbc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170356 expref: 40 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.138853:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ff39868a600) 00010000:00010000:3.0:1788263492.138874:0:17067:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263492.138913:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670cca lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.138925:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670cca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.138935:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670cca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.138949:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764200/0x4b1103cba6670cd1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb54c3bb8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.138956:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764200/0x4b1103cba6670cd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb54c3bb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.138963:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764200/0x4b1103cba6670cd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb54c3bb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.139008:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670cca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.139015:0:17067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670cca lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.139022:0:17067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670cca lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.139028:0:17067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765a00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263492.139032:0:17067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670cca lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.139039:0:17067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670cca lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.139055:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ff39868a100) 00010000:00010000:3.0:1788263492.139058:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263492.139061:0:17067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670cca lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.139066:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670cca lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.139087:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764200/0x4b1103cba6670cd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb54c3bb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.139093:0:17067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764200/0x4b1103cba6670cd1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb54c3bb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.139098:0:17067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764200/0x4b1103cba6670cd1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb54c3bb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.139103:0:17067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae764200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263492.139107:0:17067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764200/0x4b1103cba6670cd1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb54c3bb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.139113:0:17067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764200/0x4b1103cba6670cd1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb54c3bb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.139121:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xb54c3bb8 (ffff9ff39868a000) 00010000:00010000:3.0:1788263492.139123:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263492.139126:0:17067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764200/0x4b1103cba6670cd1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb54c3bb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.139131:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764200/0x4b1103cba6670cd1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb54c3bb8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263492.139223:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+39:15660:x1875129699279616:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 471us (747us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788263492.139231:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:1.0:1788263492.141956:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263492.142045:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699279744 00000100:00100000:0.0:1788263492.142054:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699279744 00000100:00100000:0.0:1788263492.142119:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 62 00000100:00100000:0.0:1788263492.142130:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+39:15660:x1875129699279744:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788263492.142149:0:17066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263492.142171:0:17066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9a00/0x4b1103cba6670cd8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d117035d expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.142204:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9000/0x4b1103cba6670cdf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.142215:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9000/0x4b1103cba6670cdf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.142224:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9000/0x4b1103cba6670cdf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.142341:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9a00/0x4b1103cba6670cd8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117035d expref: 41 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.142360:0:17066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9000/0x4b1103cba6670cdf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117035d expref: 40 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.142368:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ff282f54e00) 00010000:00010000:0.0:1788263492.142371:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788263492.142374:0:17066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3829e9000, rc 0) 00000100:00100000:0.0:1788263492.142432:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+40:15660:x1875129699279744:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 304us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263492.142439:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 62 00000100:00100000:0.0:1788263492.144043:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709842048:0@lo:400:kworker.0 00000100:00100000:0.0:1788263492.144115:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263492.144144:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709842560:0@lo:400:kworker.0 00000100:00100000:0.0:1788263492.144168:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263492.144186:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf78b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709843072:0@lo:400:kworker.0 00000100:00100000:0.0:1788263492.144209:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263492.144231:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788263492.144237:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709842176:0@lo:400:kworker.0 00000100:00100000:0.0:1788263492.144263:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263492.144282:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709842688:0@lo:400:kworker.0 00000100:00100000:0.0:1788263492.144303:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263492.144321:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf789c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709843200:0@lo:400:kworker.0 00000100:00100000:0.0:1788263492.144360:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263492.144391:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709842048 00000100:00100000:0.0:1788263492.144398:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709842048 00000100:00100000:0.0:1788263492.144427:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709842560 00000100:00100000:0.0:1788263492.144430:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709842560 00000100:00100000:0.0:1788263492.144448:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788263492.144455:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709842048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263492.144504:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf789500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709842048:12345-0@lo:400:kworker.0 Request processed in 49us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263492.144511:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788263492.144525:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788263492.144530:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709842560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263492.144574:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf788380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709842560:12345-0@lo:400:kworker.0 Request processed in 44us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263492.144610:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788263492.144724:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fb36e90-c209-4884-91f2-1155be4ad295:3621:1875129709841920:0@lo:400:kworker.0 00000100:00100000:1.0:1788263492.144760:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263492.144789:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff398743b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875129709842432:0@lo:400:kworker.0 00000100:00100000:1.0:1788263492.144808:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263492.144824:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf78a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875129709842944:0@lo:400:kworker.0 00000100:00100000:1.0:1788263492.144841:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263492.144853:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf789f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875129709843456:0@lo:400:kworker.0 00000100:00100000:1.0:1788263492.144870:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263492.144882:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788263492.144887:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff283b70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709842304:0@lo:400:kworker.0 00000100:00100000:1.0:1788263492.144906:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263492.144921:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf78b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709842816:0@lo:400:kworker.0 00000100:00100000:1.0:1788263492.144936:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263492.144951:0:3621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf788a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875129709843328:0@lo:400:kworker.0 00000100:00100000:1.0:1788263492.144966:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263492.144984:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709841920 00000100:00100000:1.0:1788263492.144988:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709841920 00000100:00100000:1.0:1788263492.145015:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788263492.145022:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+24:3621:x1875129709841920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263492.145052:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fb36e90-c209-4884-91f2-1155be4ad295+24:3621:x1875129709841920:12345-0@lo:400:kworker.0 Request processed in 30us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263492.145058:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788263492.145102:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709842176 00000100:00100000:1.0:1788263492.145106:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709842176 00000100:00100000:1.0:1788263492.145134:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709842688 00000100:00100000:1.0:1788263492.145136:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709842688 00000100:00100000:1.0:1788263492.145147:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709842304 00000100:00100000:1.0:1788263492.145149:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709842304 00000100:00100000:1.0:1788263492.145158:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709842816 00000100:00100000:1.0:1788263492.145160:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709842816 00000100:00100000:1.0:1788263492.145171:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788263492.145177:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709842176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263492.145207:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709842176:12345-0@lo:400:kworker.0 Request processed in 30us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263492.145213:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788263492.145224:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788263492.145230:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf78aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709842688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263492.145255:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf78aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709842688:12345-0@lo:400:kworker.0 Request processed in 26us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263492.145260:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788263492.145270:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788263492.145276:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709842304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263492.145301:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875129709842304:12345-0@lo:400:kworker.0 Request processed in 26us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263492.145306:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788263492.145316:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788263492.145322:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709842816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263492.145344:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875129709842816:12345-0@lo:400:kworker.0 Request processed in 23us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263492.145360:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788263492.145379:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788263492.145383:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263492.145411:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1875129709842304:0@lo:400:kworker.0 00000100:00100000:1.0:1788263492.145421:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf78b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1875129709842816:0@lo:400:kworker.0 00000100:00100000:1.0:1788263492.145428:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fb36e90-c209-4884-91f2-1155be4ad295:3621:1875129709841920:0@lo:400:kworker.0 00000100:00100000:0.0:1788263492.145529:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709842176:0@lo:400:kworker.0 00000100:00100000:0.0:1788263492.145541:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf788700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709842688:0@lo:400:kworker.0 00000100:00100000:0.0:1788263492.145550:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff283b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709842048:0@lo:400:kworker.0 00000100:00100000:0.0:1788263492.145559:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709842560:0@lo:400:kworker.0 00000100:00100000:0.0:1788263492.145606:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709843072 00000100:00100000:0.0:1788263492.145610:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709843072 00000100:00100000:0.0:1788263492.145825:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709843200 00000100:00100000:0.0:1788263492.145829:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709843200 00000100:00100000:0.0:1788263492.145840:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709842432 00000100:00100000:0.0:1788263492.145841:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709842432 00000100:00100000:0.0:1788263492.145849:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709842944 00000100:00100000:0.0:1788263492.145858:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709842944 00000100:00100000:0.0:1788263492.145872:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709843456 00000100:00100000:0.0:1788263492.145875:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709843456 00000100:00100000:0.0:1788263492.145884:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709843328 00000100:00100000:0.0:1788263492.145886:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709843328 00000100:00100000:0.0:1788263492.145899:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788263492.145904:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf78a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709843072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263492.145945:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf78a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875129709843072:12345-0@lo:400:kworker.0 Request processed in 41us (1735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263492.145951:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788263492.145963:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788263492.145969:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf78b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709843200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263492.145996:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf78b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875129709843200:12345-0@lo:400:kworker.0 Request processed in 27us (1635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263492.146000:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788263492.146009:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788263492.146015:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875129709842432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263492.146041:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875129709842432:12345-0@lo:400:kworker.0 Request processed in 27us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263492.146046:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788263492.146057:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788263492.146062:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875129709842944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263492.146103:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875129709842944:12345-0@lo:400:kworker.0 Request processed in 41us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263492.146109:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788263492.146121:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788263492.146127:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875129709843456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263492.146161:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875129709843456:12345-0@lo:400:kworker.0 Request processed in 35us (1290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263492.146168:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788263492.146179:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788263492.146185:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875129709843328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263492.146212:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875129709843328:12345-0@lo:400:kworker.0 Request processed in 28us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263492.146217:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1788263492.146245:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf789c00 x1875129709843200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263492.146256:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf789c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1875129709843200:0@lo:400:kworker.0 00000100:00100000:0.0:1788263492.146266:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf78b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1875129709843072:0@lo:400:kworker.0 00000100:00080000:1.0:1788263492.146547:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788263492.146551:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263492.146571:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf788a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1875129709843328:0@lo:400:kworker.0 00000100:00100000:1.0:1788263492.146611:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff398743b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875129709842432:0@lo:400:kworker.0 00000100:00100000:1.0:1788263492.146738:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf78a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875129709842944:0@lo:400:kworker.0 00010000:00080000:1.0:1788263492.146749:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ff3bf789f80 x1875129709843456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263492.146758:0:3621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf789f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1875129709843456:0@lo:400:kworker.0 00000100:00100000:1.0:1788263492.148082:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263492.148226:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699280000 00000100:00100000:0.0:1788263492.148234:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699280000 00000100:00100000:0.0:1788263492.148276:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 63 00000100:00100000:0.0:1788263492.148284:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6218fa09-9d3e-4029-b371-f2f7a141bebe+40:15660:x1875129699280000:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788263492.148377:0:18294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8600/0x4b1103cba6670ce6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.148395:0:18294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8600/0x4b1103cba6670ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.148406:0:18294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8600/0x4b1103cba6670ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788263492.148564:0:18294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000100:00100000:2.0:1788263492.148806:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788263492.148821:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bc225880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709843584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263492.148866:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263492.148992:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf77f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709843840:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1788263492.149049:0:18294:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 501220469645ns, next at 502220466825ns, rc = 0 00000004:00010000:0.0:1788263492.149110:0:18294:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5ce6aca reply state 0000000077246cd3 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8600/0x4b1103cba6670ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.149123:0:18294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8600/0x4b1103cba6670ce6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.149130:0:18294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ff282f54e00) 00010000:00010000:0.0:1788263492.149133:0:18294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788263492.149137:0:18294:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788263492.153977:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263492.154098:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788263492.154114:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf77ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709843712:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788263492.154153:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263492.154185:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709843584 00000100:00100000:3.0:1788263492.154192:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709843584 00000100:00100000:3.0:1788263492.154226:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709843840 00000100:00100000:3.0:1788263492.154228:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709843840 00000100:00100000:3.0:1788263492.154243:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709843712 00000100:00100000:3.0:1788263492.154246:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709843712 00000100:00100000:3.0:1788263492.154260:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788263492.154269:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc224a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709843584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788263492.154293:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788263492.154331:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc224a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875129709843584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (5464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263492.154337:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788263492.154354:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788263492.154360:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709843840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788263492.154376:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788263492.154408:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709843840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263492.154414:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788263492.154441:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788263492.154448:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709843712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788263492.154456:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788263492.154482:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709843712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263492.154488:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788263492.154527:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf77f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709843840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788263492.154556:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf77ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709843712:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788263492.154976:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6218fa09-9d3e-4029-b371-f2f7a141bebe+42:15660:x1875129699280000:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 6689us (6906us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1788263492.154984:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 63 00000100:00100000:2.0:1788263492.155227:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bc225880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1875129709843584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263492.161549:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263492.161714:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699280128 00000100:00100000:3.0:1788263492.161724:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699280128 00000100:00100000:3.0:1788263492.161784:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:3.0:1788263492.161794:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+42:15660:x1875129699280128:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788263492.161818:0:17067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263492.161836:0:17067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764200/0x4b1103cba6670ced lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170364 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.161902:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764200/0x4b1103cba6670ced lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170364 expref: 43 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.161916:0:17067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764200/0x4b1103cba6670ced lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170364 expref: 43 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.161934:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ff282f54e00) 00010000:00010000:3.0:1788263492.161937:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788263492.161941:0:17067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae764200, rc 0) 00000100:00100000:3.0:1788263492.162034:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+43:15660:x1875129699280128:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 241us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263492.162053:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:1.0:1788263492.173574:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263492.174821:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699280256 00000100:00100000:2.0:1788263492.174834:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699280256 00000100:00100000:2.0:1788263492.174974:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:2.0:1788263492.174985:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+5:2387:x1875129699280256:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788263492.175284:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+6:2387:x1875129699280256:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 300us (1719us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788263492.175291:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00080000:1.0:1788263492.180447:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788263492.183705:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263492.183861:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699280512 00000100:00100000:2.0:1788263492.183870:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699280512 00000100:00100000:2.0:1788263492.183948:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:2.0:1788263492.183959:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+43:15660:x1875129699280512:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788263492.184187:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+44:15660:x1875129699280512:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 229us (489us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788263492.184195:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:0.0:1788263492.193757:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263492.193910:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699280768 00000100:00100000:1.0:1788263492.193919:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699280768 00000100:00100000:1.0:1788263492.193979:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:1.0:1788263492.193990:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf78b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+44:15660:x1875129699280768:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788263492.194135:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf78b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+44:15660:x1875129699280768:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 147us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263492.194143:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:1.0:1788263492.201700:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263492.201804:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699280896 00000100:00100000:3.0:1788263492.201815:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699280896 00000100:00100000:3.0:1788263492.201888:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00100000:3.0:1788263492.201899:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+44:15660:x1875129699280896:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788263492.201920:0:17067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263492.201940:0:17067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670cf4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d117036b expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.202035:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670cfb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.202050:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670cfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.202063:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670cfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263492.202117:0:17067:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788263492.202135:0:17067:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670cfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.202159:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670cf4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117036b expref: 46 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.202336:0:17067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670cfb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117036b expref: 45 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.202345:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ff282f54e00) 00010000:00010000:3.0:1788263492.202355:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788263492.202360:0:17067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3ae765c00, rc 0) 00000100:00100000:3.0:1788263492.202423:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+45:15660:x1875129699280896:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 525us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263492.202431:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00100000:2.0:1788263492.208880:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263492.208967:0:19604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699281024 00000100:00100000:0.0:1788263492.208978:0:19604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699281024 00000100:00100000:0.0:1788263492.209037:0:19604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:0.0:1788263492.209047:0:19604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6218fa09-9d3e-4029-b371-f2f7a141bebe+6:2386:x1875129699281024:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788263492.209065:0:19604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263492.209094:0:19604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044fa1725/0x4b1103cba6670d02 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170372 expref: -99 pid: 19604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788263492.209133:0:19604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96bc43, blocks: 0x0 00010000:00010000:0.0:1788263492.209152:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1788263492.209157:0:19604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788263492.209171:0:19604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044fa1725/0x4b1103cba6670d02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170372 expref: 7 pid: 19604 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.209214:0:19604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000044fa1725/0x4b1103cba6670d02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170372 expref: 7 pid: 19604 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.209227:0:19604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3829e9200, rc 0) 00000100:00100000:0.0:1788263492.209283:0:19604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6218fa09-9d3e-4029-b371-f2f7a141bebe+7:2386:x1875129699281024:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 237us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263492.209290:0:19604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:0.0:1788263492.228305:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263492.228384:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699281280 00000100:00100000:1.0:1788263492.228393:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699281280 00000100:00100000:1.0:1788263492.228444:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00100000:1.0:1788263492.228453:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+45:15660:x1875129699281280:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788263492.228694:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf789c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+45:15660:x1875129699281280:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 240us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263492.228702:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00100000:1.0:1788263492.237220:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263492.237306:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699281408 00000100:00100000:0.0:1788263492.237315:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699281408 00000100:00100000:0.0:1788263492.237371:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 68 00000100:00100000:0.0:1788263492.237381:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff282fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+45:15660:x1875129699281408:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788263492.240323:0:17045:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:0.0:1788263492.240341:0:17045:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788263492.240402:0:17045:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1788263492.240550:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff282fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+20:15660:x1875129699281408:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 Request processed in 3165us (3346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263492.240562:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 68 00000100:00100000:3.0:1788263492.241289:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788263492.241305:0:3620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf77ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709843968:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788263492.241364:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788263492.241649:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba6670b18 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.241663:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba6670b18 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.241670:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba6670b18 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.241677:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae764400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263492.241681:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba6670b18 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.241688:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba6670b18 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.241704:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ff39868a100) 00010000:00010000:1.0:1788263492.241719:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788263492.241724:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba6670b18 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.241730:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764400/0x4b1103cba6670b18 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263492.241849:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709843968 00000100:00100000:0.0:1788263492.241857:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709843968 00000100:00100000:0.0:1788263492.241918:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788263492.241927:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875129709843968:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788263492.242044:0:18572:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788263492.242048:0:18572:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788263492.242056:0:18572:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788263492.242059:0:18572:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788263491 -> 1788263491 00002000:00010000:0.0:1788263492.242061:0:18572:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788263492.242126:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3620:x1875129709843968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 200us (762us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788263492.242134:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:3.0:1788263492.242377:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ff3bf77ea00/2, rc 0, transno 8589934596 00000100:00100000:3.0:1788263492.242384:0:3620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf77ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1875129709843968:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788263492.246139:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263492.246215:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699281536 00000100:00100000:3.0:1788263492.246224:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699281536 00000100:00100000:3.0:1788263492.246263:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:3.0:1788263492.246272:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+7:2387:x1875129699281536:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788263492.246376:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+7:2387:x1875129699281536:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 Request processed in 105us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263492.246383:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 23 00010000:00010000:2.0:1788263492.248789:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765800/0x4b1103cba6670ac4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.248806:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765800/0x4b1103cba6670ac4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.248814:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765800/0x4b1103cba6670ac4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.248819:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263492.249240:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765800/0x4b1103cba6670ac4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249250:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765800/0x4b1103cba6670ac4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249269:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ff39868ad00) 00010000:00010000:2.0:1788263492.249272:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263492.249277:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765800/0x4b1103cba6670ac4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249284:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765800/0x4b1103cba6670ac4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249392:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764000/0x4b1103cba6670acb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249399:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764000/0x4b1103cba6670acb lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249405:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764000/0x4b1103cba6670acb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249410:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae764000 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263492.249413:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764000/0x4b1103cba6670acb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249419:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764000/0x4b1103cba6670acb lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249428:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ff39868a100) 00010000:00010000:2.0:1788263492.249430:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263492.249433:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764000/0x4b1103cba6670acb lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249439:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764000/0x4b1103cba6670acb lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249456:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba6670b73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249462:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba6670b73 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249468:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba6670b73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249479:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263492.249483:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba6670b73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249488:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba6670b73 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249496:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9ff39868a400) 00010000:00010000:2.0:1788263492.249499:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263492.249501:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba6670b73 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249507:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765400/0x4b1103cba6670b73 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249521:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba6670bf8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249527:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba6670bf8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249532:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba6670bf8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249536:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e9400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263492.249539:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba6670bf8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249545:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba6670bf8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249563:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:2.0:1788263492.249565:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263492.249568:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba6670bf8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249574:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba6670bf8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249714:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69200/0x4b1103cba6670c1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249721:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69200/0x4b1103cba6670c1b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249727:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69200/0x4b1103cba6670c1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249732:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b69200 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263492.249734:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69200/0x4b1103cba6670c1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249741:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69200/0x4b1103cba6670c1b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249749:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:2.0:1788263492.249751:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263492.249754:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69200/0x4b1103cba6670c1b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249759:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b69200/0x4b1103cba6670c1b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249781:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670c61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249787:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670c61 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249793:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670c61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249798:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e8400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263492.249801:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670c61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249807:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670c61 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.249815:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:2.0:1788263492.249817:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263492.249820:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670c61 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.250049:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670c61 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.250062:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8600/0x4b1103cba6670ce6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.250078:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8600/0x4b1103cba6670ce6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.250085:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8600/0x4b1103cba6670ce6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.250097:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e8600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:2.0:1788263492.250100:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8600/0x4b1103cba6670ce6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.250106:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8600/0x4b1103cba6670ce6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.250115:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ff282f54e00) 00010000:00010000:2.0:1788263492.250117:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788263492.250120:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8600/0x4b1103cba6670ce6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.250125:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8600/0x4b1103cba6670ce6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263492.262350:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263492.262452:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699281792 00000100:00100000:1.0:1788263492.262462:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699281792 00000100:00100000:1.0:1788263492.262546:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 69 00000100:00100000:1.0:1788263492.262556:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+14:15660:x1875129699281792:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788263492.262658:0:17066:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263492.262696:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670cfb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117036b expref: 14 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.262715:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ff282f54e00) 00010000:00010000:1.0:1788263492.262719:0:17066:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788263492.262748:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ec800/0x4b1103cba6670d09 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.262762:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ec800/0x4b1103cba6670d09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.262780:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ec800/0x4b1103cba6670d09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788263492.263336:0:17066:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004a2315d reply state 000000000f407927 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ec800/0x4b1103cba6670d09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.263352:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff2823ec800/0x4b1103cba6670d09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.263371:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ff282f54e00) 00010000:00010000:1.0:1788263492.263373:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788263492.263376:0:17066:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788263492.263476:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf788700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+15:15660:x1875129699281792:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 920us (1136us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1788263492.263484:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 69 00000100:00100000:1.0:1788263492.268271:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263492.271031:0:19151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699281920 00000100:00100000:2.0:1788263492.271045:0:19151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699281920 00000100:00100000:2.0:1788263492.271116:0:19151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:2.0:1788263492.271126:0:19151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff385ec5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6218fa09-9d3e-4029-b371-f2f7a141bebe+7:15660:x1875129699281920:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788263492.271145:0:19151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263492.271164:0:19151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9ea01c2/0x4b1103cba6670d10 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170379 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.271193:0:19151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000044fa1725/0x4b1103cba6670d02 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170372 expref: 8 pid: 19604 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.271202:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263492.271206:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263492.271223:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ea01c2/0x4b1103cba6670d10 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170379 expref: 8 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.271259:0:19151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000044fa1725/0x4b1103cba6670d02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170372 expref: 8 pid: 19604 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.271272:0:19151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000044fa1725/0x4b1103cba6670d02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170372 expref: 8 pid: 19604 timeout: 601 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263492.271287:0:19151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bc224000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19151:1875129709844096:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788263492.273114:0:19151:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff38325c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788263492.280322:0:19151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bc224000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19151:1875129709844096:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788263492.280363:0:19151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d9ea01c2/0x4b1103cba6670d10 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170379 expref: 8 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.280384:0:19151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eeda00, rc 0) 00000100:00100000:0.0:1788263492.280437:0:19151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff385ec5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6218fa09-9d3e-4029-b371-f2f7a141bebe+8:15660:x1875129699281920:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 9312us (12174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263492.280446:0:19151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:3.0:1788263492.283091:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263492.283175:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699282048 00000100:00100000:2.0:1788263492.283184:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699282048 00010000:00010000:2.0:1788263492.283219:0:17052:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000044fa1725/0x4b1103cba6670d02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170372 expref: 8 pid: 19604 timeout: 601 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263492.283255:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:2.0:1788263492.283263:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+8:2386:x1875129699282048:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263492.283276:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263492.283295:0:17052:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000044fa1725/0x4b1103cba6670d02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170372 expref: 8 pid: 19604 timeout: 601 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.283309:0:17052:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000044fa1725/0x4b1103cba6670d02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170372 expref: 8 pid: 19604 timeout: 601 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.283423:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044fa1725/0x4b1103cba6670d02 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170372 expref: 8 pid: 19604 timeout: 601 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.283452:0:17052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263492.283457:0:17052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263492.283464:0:17052:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9ea01c2/0x4b1103cba6670d10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170379 expref: 7 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.283475:0:17052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ea01c2/0x4b1103cba6670d10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170379 expref: 7 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.283509:0:17052:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d9ea01c2/0x4b1103cba6670d10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170379 expref: 7 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263492.283523:0:17052:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bc225c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17052:1875129709844224:192.168.203.26@tcp:105: 00000100:00100000:2.0:1788263492.283687:0:17052:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff38325c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263492.286745:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263492.286824:0:17052:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bc225c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17052:1875129709844224:192.168.203.26@tcp:105: 00010000:00010000:2.0:1788263492.286844:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263492.286936:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+7:2386:x1875129699282048:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 3672us (3852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263492.286946:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:3.0:1788263492.287051:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699282176 00000100:00100000:3.0:1788263492.287057:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699282176 00000100:00100000:3.0:1788263492.287110:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:3.0:1788263492.287119:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+7:2387:x1875129699282176:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788263492.287267:0:18574:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788263492.287271:0:18574:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788263490 00002000:00010000:3.0:1788263492.287274:0:18574:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788263488 00002000:00010000:3.0:1788263492.287276:0:18574:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788263491 -> 1788263490 00002000:00010000:3.0:1788263492.287290:0:18574:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788263492.287312:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+8:2387:x1875129699282176:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 195us (575us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788263492.287319:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:1.0:1788263492.290014:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263492.290174:0:19604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699282304 00000100:00100000:0.0:1788263492.290183:0:19604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699282304 00000100:00100000:2.0:1788263492.290289:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00100000:2.0:1788263492.290301:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+8:2387:x1875129699282304:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788263492.290349:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008f0e94c0/0x4b1103cba6670d17 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.290433:0:18572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9ea01c2/0x4b1103cba6670d10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170379 expref: 8 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.290443:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263492.290448:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788263492.290453:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f0e94c0/0x4b1103cba6670d17 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.290486:0:18572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d9ea01c2/0x4b1103cba6670d10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170379 expref: 8 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.290500:0:18572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d9ea01c2/0x4b1103cba6670d10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170379 expref: 8 pid: 19151 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263492.290513:0:18572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bc225c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18572:1875129709844352:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788263492.290656:0:18572:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff38325c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263492.293310:0:18572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bc225c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18572:1875129709844352:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788263492.293345:0:18572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008f0e94c0/0x4b1103cba6670d17 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263492.294191:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263492.294555:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699282432 00000100:00100000:0.0:1788263492.294563:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699282432 00010000:00010000:0.0:1788263492.294667:0:17050:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ea01c2/0x4b1103cba6670d10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170379 expref: 9 pid: 19151 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263492.294734:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:0.0:1788263492.294742:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+9:2387:x1875129699282432:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263492.294756:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263492.294776:0:17050:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d9ea01c2/0x4b1103cba6670d10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170379 expref: 9 pid: 19151 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.294801:0:17050:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d9ea01c2/0x4b1103cba6670d10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170379 expref: 9 pid: 19151 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.294822:0:17050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9ea01c2/0x4b1103cba6670d10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170379 expref: 9 pid: 19151 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.294837:0:17050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788263492.294841:0:17050:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788263492.294847:0:17050:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f0e94c0/0x4b1103cba6670d17 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.294856:0:17050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f0e94c0/0x4b1103cba6670d17 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.294883:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263492.294935:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+8:2387:x1875129699282432:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 193us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263492.294942:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 21 00010000:00010000:2.0:1788263492.294991:0:18572:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008f0e94c0/0x4b1103cba6670d17 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.295001:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f0e94c0/0x4b1103cba6670d17 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.295025:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008f0e94c0/0x4b1103cba6670d17 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.295033:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f0e94c0/0x4b1103cba6670d17 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.295041:0:18572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f0e94c0/0x4b1103cba6670d17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.295047:0:18572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eec000 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:2.0:1788263492.295051:0:18572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f0e94c0/0x4b1103cba6670d17 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.295059:0:18572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f0e94c0/0x4b1103cba6670d17 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.295080:0:18572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f0e94c0/0x4b1103cba6670d17 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.295088:0:18572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f0e94c0/0x4b1103cba6670d17 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263492.295127:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+7:2387:x1875129699282304:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 Request processed in 4829us (5121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263492.295151:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00100000:1.0:1788263492.297653:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263492.297749:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699282688 00000100:00100000:3.0:1788263492.297758:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699282688 00000100:00100000:3.0:1788263492.297813:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 70 00000100:00100000:3.0:1788263492.297822:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff283b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+15:15660:x1875129699282688:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788263492.297894:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670d1e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.297912:0:17067:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba6670bf1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170317 expref: 15 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.297922:0:17067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670d1e lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.297952:0:17067:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba6670bf1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170317 expref: 15 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.297965:0:17067:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba6670bf1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170317 expref: 15 pid: 18294 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263492.298040:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf77ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17067:1875129709844480:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788263492.298122:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3f9300 going to sleep for 11 seconds 00000100:00100000:3.0:1788263492.299955:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf77ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17067:1875129709844480:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263492.300323:0:17067:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670d1e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263492.300416:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263492.300525:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699282816 00000100:00100000:2.0:1788263492.300531:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699282816 00010000:00010000:2.0:1788263492.300564:0:17052:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba6670bf1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170317 expref: 16 pid: 18294 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263492.300883:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:2.0:1788263492.300897:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387617100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+16:2386:x1875129699282816:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263492.300921:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263492.300929:0:17052:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba6670bf1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170317 expref: 16 pid: 18294 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.300940:0:17052:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba6670bf1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170317 expref: 16 pid: 18294 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.300961:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba6670bf1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170317 expref: 16 pid: 18294 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.300984:0:17052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:2.0:1788263492.300990:0:17052:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670c84 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170348 expref: 15 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.301002:0:17052:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670d1e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.301010:0:17052:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670d1e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.301030:0:17052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670d1e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.301056:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263492.301105:0:17067:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670d1e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.301113:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670d1e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263492.301118:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387617100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+15:2386:x1875129699282816:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 225us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263492.301126:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 22 00010000:00010000:3.0:1788263492.301301:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765600/0x4b1103cba6670d25 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.301314:0:17067:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764200/0x4b1103cba6670ced lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170364 expref: 15 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.301551:0:17067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765600/0x4b1103cba6670d25 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.301731:0:17067:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764200/0x4b1103cba6670ced lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170364 expref: 15 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.301745:0:17067:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764200/0x4b1103cba6670ced lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170364 expref: 15 pid: 17067 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263492.301760:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf77ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17067:1875129709844608:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788263492.301822:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3f9180 going to sleep for 11 seconds 00000100:00100000:3.0:1788263492.303810:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf77ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17067:1875129709844608:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788263492.303837:0:17067:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765600/0x4b1103cba6670d25 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263492.305555:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263492.305825:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699282944 00000100:00100000:0.0:1788263492.305834:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699282944 00010000:00010000:0.0:1788263492.305870:0:17050:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764200/0x4b1103cba6670ced lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170364 expref: 16 pid: 17067 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263492.305944:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:0.0:1788263492.305954:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b54b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+16:2387:x1875129699282944:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263492.305981:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263492.305989:0:17050:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764200/0x4b1103cba6670ced lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170364 expref: 16 pid: 17067 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.306001:0:17050:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764200/0x4b1103cba6670ced lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170364 expref: 16 pid: 17067 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.306023:0:17050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae764200/0x4b1103cba6670ced lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xd405f293d1170364 expref: 16 pid: 17067 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.306045:0:17050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ff282f54e00) 00010000:00010000:0.0:1788263492.306050:0:17050:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765600/0x4b1103cba6670d25 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.306059:0:17050:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765600/0x4b1103cba6670d25 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.306075:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765600/0x4b1103cba6670d25 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.306098:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263492.306115:0:17067:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765600/0x4b1103cba6670d25 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.306128:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765600/0x4b1103cba6670d25 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263492.306155:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b54b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+15:2387:x1875129699282944:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 203us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263492.306162:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 23 00000001:00080000:3.0:1788263492.306244:0:17067:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1788263492.306378:0:17067:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:3.0:1788263492.306413:0:17067:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:3.0:1788263492.306481:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf77ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17067:1875129709844736:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788263492.306522:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263492.306554:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff3bd3f9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263492.306567:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709844736 00000100:00100000:0.0:1788263492.306571:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709844736 00000100:00100000:0.0:1788263492.306623:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788263492.306630:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17067:x1875129709844736:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788263492.306701:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17067:x1875129709844736:12345-0@lo:1000:mdt00_002.0 Request processed in 71us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263492.306714:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788263492.306905:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf77ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17067:1875129709844736:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788263492.307042:0:17067:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:1.0:1788263492.307094:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387615c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17067:1875129709844864:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788263492.307127:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263492.307187:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2810a8300 going to sleep for 11 seconds 00000100:00100000:0.0:1788263492.307259:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709844864 00000100:00100000:0.0:1788263492.307264:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709844864 00000100:00100000:0.0:1788263492.307295:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788263492.307301:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17067:x1875129709844864:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788263492.307535:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17067:x1875129709844864:12345-0@lo:1000:mdt00_002.0 Request processed in 233us (405us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788263492.307542:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788263492.307687:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387615c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17067:1875129709844864:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788263492.307717:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765600/0x4b1103cba6670d25 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.307726:0:17067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765600/0x4b1103cba6670d25 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.307731:0:17067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765600/0x4b1103cba6670d25 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.307746:0:17067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263492.307749:0:17067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765600/0x4b1103cba6670d25 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.307754:0:17067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765600/0x4b1103cba6670d25 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.307765:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ff282f54e00) 00010000:00010000:1.0:1788263492.307766:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788263492.307769:0:17067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765600/0x4b1103cba6670d25 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.307773:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765600/0x4b1103cba6670d25 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.307795:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670c7d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.307799:0:17067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670c7d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.307803:0:17067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670c7d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.307805:0:17067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff283b68c00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:1.0:1788263492.307807:0:17067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670c7d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.307810:0:17067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670c7d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.307821:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:1.0:1788263492.307823:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788263492.307827:0:17067:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670c84 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170348 expref: 18 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.307834:0:17067:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670c84 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170348 expref: 18 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.307839:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670c84 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170348 expref: 18 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.307874:0:17067:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68000/0x4b1103cba6670c84 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170348 expref: 18 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263492.307881:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387617b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17067:1875129709844992:192.168.203.26@tcp:105: 00000100:00100000:1.0:1788263492.307935:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ff2810a83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263492.311807:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387617b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17067:1875129709844992:192.168.203.26@tcp:105: 00010000:00010000:3.0:1788263492.311837:0:17067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670c7d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.311849:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff283b68c00/0x4b1103cba6670c7d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.311881:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670d2c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.311893:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670d2c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.311904:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670d2c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.311914:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670d2c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.311920:0:17067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670d2c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.311942:0:17067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670d2c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.311947:0:17067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765c00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263492.311951:0:17067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670d2c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.311958:0:17067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670d2c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.311968:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:3.0:1788263492.311971:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263492.311974:0:17067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670d2c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.311979:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765c00/0x4b1103cba6670d2c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.311988:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670d1e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.311993:0:17067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670d1e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.311998:0:17067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670d1e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.312003:0:17067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3ae765a00 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:3.0:1788263492.312006:0:17067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670d1e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263492.312121:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00010000:00010000:3.0:1788263492.312252:0:17067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670d1e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.312263:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:3.0:1788263492.312266:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788263492.312269:0:17067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670d1e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.312274:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3ae765a00/0x4b1103cba6670d1e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263492.312452:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff283b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+18:15660:x1875129699282688:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 14630us (14806us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1788263492.312463:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 70 00000020:00080000:3.0:1788263492.312468:0:17067:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788263492.312775:0:17101:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788263492.312780:0:17101:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788263492.312794:0:17101:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788263492.312801:0:17101:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788263492.313064:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699283072 00000100:00100000:2.0:1788263492.313081:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699283072 00000100:00100000:2.0:1788263492.313129:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:2.0:1788263492.313139:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+18:15659:x1875129699283072:12345-192.168.203.26@tcp:49:bash.0 00000100:00100000:2.0:1788263492.313252:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+18:15659:x1875129699283072:12345-192.168.203.26@tcp:49:bash.0 Request processed in 114us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263492.313258:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:1.0:1788263492.316005:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263492.316112:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699283328 00000100:00100000:2.0:1788263492.316122:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699283328 00000100:00100000:2.0:1788263492.316181:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:2.0:1788263492.316191:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+18:15660:x1875129699283328:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788263492.316436:0:17068:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788263492.316465:0:17068:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:2.0:1788263492.316495:0:17068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec000/0x4b1103cba6670d33 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.316511:0:17068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec000/0x4b1103cba6670d33 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.316521:0:17068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec000/0x4b1103cba6670d33 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.316542:0:17068:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec000/0x4b1103cba6670d33 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.316548:0:17068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec000/0x4b1103cba6670d33 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.316554:0:17068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec000/0x4b1103cba6670d33 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.316733:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263492.316739:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec000/0x4b1103cba6670d33 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.316745:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff398eec000 already unused, calling callback (ffffffffc0ce8230) 00010000:00010000:3.0:1788263492.316749:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec000/0x4b1103cba6670d33 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.316756:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec000/0x4b1103cba6670d33 lrc: 5/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.316768:0:17053:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ff282f54e00) 00010000:00010000:3.0:1788263492.316771:0:17053:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788263492.316775:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec000/0x4b1103cba6670d33 lrc: 3/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.316792:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263492.316794:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263492.316796:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263492.316934:0:17068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788263492.316940:0:17068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff398eec000/0x4b1103cba6670d33 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263492.317084:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+20:15660:x1875129699283328:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 892us (1085us total) trans 8589934630 rc 0/0 00000100:00100000:2.0:1788263492.317092:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 13 00000020:00080000:2.0:1788263492.317097:0:17068:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788263492.320155:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263492.321802:0:19151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699283456 00000100:00100000:2.0:1788263492.321815:0:19151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699283456 00000100:00100000:2.0:1788263492.321936:0:19151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:2.0:1788263492.321948:0:19151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6218fa09-9d3e-4029-b371-f2f7a141bebe+7:15659:x1875129699283456:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:2.0:1788263492.321966:0:19151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263492.321986:0:19151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fbcb647/0x4b1103cba6670d3a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170380 expref: -99 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788263492.322011:0:19151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a96bc42, atime: 0x6a96bc40, ctime: 0x6a96bc42, blocks: 0x0 00010000:00010000:2.0:1788263492.322031:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=501s v=(0 0) 00010000:00010000:2.0:1788263492.322036:0:19151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263492.322058:0:19151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fbcb647/0x4b1103cba6670d3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170380 expref: 8 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.322086:0:19151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002fbcb647/0x4b1103cba6670d3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170380 expref: 8 pid: 19151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263492.322100:0:19151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff398eed400, rc 0) 00000100:00100000:2.0:1788263492.322169:0:19151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf788000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6218fa09-9d3e-4029-b371-f2f7a141bebe+8:15659:x1875129699283456:12345-192.168.203.26@tcp:101:bash.0 Request processed in 219us (2017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263492.322177:0:19151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:1.0:1788263492.325675:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263492.325733:0:18294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699283584 00000100:00100000:0.0:1788263492.325742:0:18294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699283584 00000100:00100000:0.0:1788263492.325797:0:18294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 71 00000100:00100000:0.0:1788263492.325807:0:18294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6218fa09-9d3e-4029-b371-f2f7a141bebe+20:15659:x1875129699283584:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1788263492.325828:0:18294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263492.325849:0:18294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba6670d41 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d1170387 expref: -99 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.325881:0:18294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9800/0x4b1103cba6670d48 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.325895:0:18294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9800/0x4b1103cba6670d48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.326012:0:18294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9800/0x4b1103cba6670d48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18294 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.326140:0:18294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba6670d41 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170387 expref: 22 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.326171:0:18294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9800/0x4b1103cba6670d48 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d1170387 expref: 21 pid: 18294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.326181:0:18294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:0.0:1788263492.326184:0:18294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788263492.326187:0:18294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3829e9800, rc 0) 00000100:00100000:0.0:1788263492.326417:0:18294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6218fa09-9d3e-4029-b371-f2f7a141bebe+21:15659:x1875129699283584:12345-192.168.203.26@tcp:101:bash.0 Request processed in 609us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263492.326425:0:18294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 71 00000100:00100000:1.0:1788263492.334480:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263492.334683:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699283840 00000100:00100000:3.0:1788263492.334693:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699283840 00000100:00100000:0.0:1788263492.334880:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:0.0:1788263492.334891:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+21:15659:x1875129699283840:12345-192.168.203.26@tcp:35:bash.0 00000001:00080000:0.0:1788263492.335122:0:17069:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:0.0:1788263492.335206:0:17069:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:0.0:1788263492.335312:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+24:15659:x1875129699283840:12345-192.168.203.26@tcp:35:bash.0 Request processed in 420us (840us total) trans 8589934633 rc 0/0 00000100:00100000:0.0:1788263492.335319:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 14 00000020:00080000:0.0:1788263492.336460:0:17069:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788263492.424020:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263492.424094:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699284096 00000100:00100000:0.0:1788263492.424104:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699284096 00000100:00100000:0.0:1788263492.424179:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 72 00000100:00100000:0.0:1788263492.424190:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+24:15671:x1875129699284096:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788263492.424225:0:17065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263492.424249:0:17065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba6670d4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd405f293d117038e expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263492.424366:0:17065:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788263492.424488:0:17065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba6670d4f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117038e expref: 26 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.424501:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ff39868ac00) 00010000:00010000:0.0:1788263492.424505:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788263492.424509:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e9400/0x4b1103cba6670d4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0xd405f293d117038e expref: 26 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.424527:0:17065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ff3829e9400, rc 0) 00000100:00100000:0.0:1788263492.424990:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+25:15671:x1875129699284096:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 800us (986us total) trans 8589934634 rc 301/301 00000100:00100000:0.0:1788263492.424997:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 72 00000100:00100000:1.0:1788263492.426897:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788263492.426960:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699284224 00000100:00100000:0.0:1788263492.426967:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699284224 00000100:00100000:0.0:1788263492.427022:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 73 00000100:00100000:0.0:1788263492.427031:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff387617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+25:15671:x1875129699284224:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:0.0:1788263492.427114:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670d5d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427129:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670d5d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427140:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670d5d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427160:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8600/0x4b1103cba6670d64 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427180:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8600/0x4b1103cba6670d64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427188:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8600/0x4b1103cba6670d64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427414:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba6670d6b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427425:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba6670d6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427432:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba6670d6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788263492.427482:0:17066:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba6670d6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427494:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670d5d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427500:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670d5d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427506:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670d5d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427511:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e8400 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263492.427515:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670d5d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427521:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670d5d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427539:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ff39868a100) 00010000:00010000:0.0:1788263492.427542:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263492.427546:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670d5d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427552:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8400/0x4b1103cba6670d5d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427564:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8600/0x4b1103cba6670d64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427569:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8600/0x4b1103cba6670d64 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427574:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8600/0x4b1103cba6670d64 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427743:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e8600 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263492.427747:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8600/0x4b1103cba6670d64 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427753:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8600/0x4b1103cba6670d64 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427762:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9ff282f54000) 00010000:00010000:0.0:1788263492.427765:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263492.427768:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8600/0x4b1103cba6670d64 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427775:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8600/0x4b1103cba6670d64 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427800:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba6670d6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427806:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba6670d6b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427812:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba6670d6b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427817:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ff3829e8800 already unused, calling callback (ffffffffc18e04f0) 00010000:00010000:0.0:1788263492.427830:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba6670d6b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427837:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba6670d6b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427845:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ff39868af00) 00010000:00010000:0.0:1788263492.427848:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263492.427851:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba6670d6b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.427856:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ff3829e8800/0x4b1103cba6670d6b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263492.427945:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff387617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+25:15671:x1875129699284224:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 914us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263492.427953:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 73 00000100:00100000:0.0:1788263492.429726:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263492.429800:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699284480 00000100:00100000:2.0:1788263492.429809:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699284480 00000100:00100000:2.0:1788263492.429858:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00100000:2.0:1788263492.429866:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+25:15671:x1875129699284480:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:2.0:1788263492.430064:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf78aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+26:15671:x1875129699284480:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 197us (344us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1788263492.430083:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 15 00010000:00010000:0.0:1788263492.847800:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263493.167862:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff387617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709845120:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788263493.167930:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263493.168029:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709845120 00000100:00100000:0.0:1788263493.168051:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709845120 00000100:00100000:0.0:1788263493.168110:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788263493.168121:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709845120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788263493.168143:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788263493.168862:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709845120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 742us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263493.168871:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788263493.171099:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff387617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709845120:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788263493.879273:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788263493.920749:0:20242:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:3.0:1788263494.191801:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788263494.191824:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bc225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709845248:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788263494.191892:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263494.191934:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ff3bf77ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709845376:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788263494.191956:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263494.192096:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709845248 00000100:00100000:2.0:1788263494.192104:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709845248 00000100:00100000:2.0:1788263494.192141:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129709845376 00000100:00100000:2.0:1788263494.192144:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129709845376 00000100:00100000:2.0:1788263494.192159:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788263494.192166:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709845248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788263494.192196:0:17070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788263494.193959:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875129709845248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1785us (2060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263494.193988:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788263494.194022:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788263494.194032:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bf77f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709845376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788263494.194067:0:17070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788263494.194115:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bf77f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875129709845376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (2157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263494.194122:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788263494.194939:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bc225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1875129709845248:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788263494.194954:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ff3bf77ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1875129709845376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788263494.265183:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263494.265331:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263494.265362:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263494.265414:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699284992 00000100:00100000:1.0:1788263494.265437:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699284992 00000100:00100000:1.0:1788263494.265508:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:1.0:1788263494.265519:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+5:2388:x1875129699284992:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263494.265607:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+5:2388:x1875129699284992:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 90us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263494.265614:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00080000:0.0:1788263494.265776:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263494.266436:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263494.266473:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263494.266491:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788263494.266639:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699285504 00000100:00100000:1.0:1788263494.266645:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699285504 00000100:00100000:1.0:1788263494.266685:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:1.0:1788263494.266693:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+5:2388:x1875129699285504:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263494.266742:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+5:2388:x1875129699285504:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 49us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263494.266749:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:3.0:1788263494.267147:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699284736 00000100:00100000:3.0:1788263494.267152:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699284736 00000100:00100000:3.0:1788263494.267185:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699285248 00000100:00100000:3.0:1788263494.267187:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699285248 00000100:00100000:3.0:1788263494.267218:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:3.0:1788263494.267226:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+26:2388:x1875129699284736:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263494.267267:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+26:2388:x1875129699284736:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 42us (2094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263494.267273:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:3.0:1788263494.267297:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:3.0:1788263494.267302:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:2388:x1875129699285248:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263494.267324:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+6:2388:x1875129699285248:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 22us (1963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263494.267330:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:3.0:1788263494.267699:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699284608 00000100:00100000:3.0:1788263494.267704:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699284608 00000100:00100000:3.0:1788263494.267731:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 166 00000100:00100000:3.0:1788263494.267736:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3b56fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+13:2388:x1875129699284608:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263494.267764:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3b56fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9bf1ef74-3c48-413f-a47c-361d3a16ebf9+13:2388:x1875129699284608:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 27us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263494.267770:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 166 00000100:00080000:1.0:1788263494.269108:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788263494.269115:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263494.269216:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263494.269287:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263494.269305:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263494.269458:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699284864 00000100:00100000:3.0:1788263494.269465:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699284864 00000100:00100000:3.0:1788263494.269502:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699285376 00000100:00100000:3.0:1788263494.269504:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699285376 00000100:00100000:3.0:1788263494.269527:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 62 00000100:00100000:3.0:1788263494.269534:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+5:2388:x1875129699284864:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263494.269605:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6218fa09-9d3e-4029-b371-f2f7a141bebe+5:2388:x1875129699284864:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 70us (3112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263494.269612:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 62 00000100:00100000:3.0:1788263494.269624:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 63 00000100:00100000:3.0:1788263494.269630:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+5:2388:x1875129699285376:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263494.269648:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+5:2388:x1875129699285376:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 19us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263494.269668:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 63 00000100:00080000:3.0:1788263494.269755:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788263494.270663:0:19151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699285120 00000100:00100000:1.0:1788263494.270673:0:19151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699285120 00000100:00100000:3.0:1788263494.270787:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699285632 00000100:00100000:3.0:1788263494.270792:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699285632 00000100:00100000:1.0:1788263494.270981:0:19151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:1.0:1788263494.270991:0:19151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc225f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6218fa09-9d3e-4029-b371-f2f7a141bebe+8:2388:x1875129699285120:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788263494.271188:0:19151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc225f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6218fa09-9d3e-4029-b371-f2f7a141bebe+8:2388:x1875129699285120:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 198us (1973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263494.271195:0:19151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00080000:2.0:1788263494.274476:0:17061:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788263494.276968:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:3.0:1788263494.276983:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+5:2388:x1875129699285632:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788263494.277446:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6cba8b7b-8f99-4a54-a27b-6ee8a0068215+5:2388:x1875129699285632:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 464us (8136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263494.277455:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 23 00010000:00010000:1.0:1788263494.898182:0:17054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263495.285665:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788263495.285772:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788263495.285848:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699285888 00000100:00100000:3.0:1788263495.285858:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699285888 00000100:00100000:3.0:1788263495.285918:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:3.0:1788263495.285929:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff3bc225180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+8:2389:x1875129699285888:12345-192.168.203.26@tcp:16:kworker.0 00000100:00100000:3.0:1788263495.286044:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff3bc225180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6218fa09-9d3e-4029-b371-f2f7a141bebe+8:2389:x1875129699285888:12345-192.168.203.26@tcp:16:kworker.0 Request processed in 117us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263495.286061:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:3.0:1788263495.286094:0:18577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129699285760 00000100:00100000:3.0:1788263495.286099:0:18577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129699285760 00002000:00100000:3.0:1788263495.286121:0:18577:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff9ff2831f2d80 x1875129699285760/t0(0) o4->6218fa09-9d3e-4029-b371-f2f7a141bebe@192.168.203.26@tcp:706/0 lens 504/0 e 0 to 0 dl 1788263506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788263495.286131:0:18577:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ff2831f2d80 with x1875129699285760 ext(0->8) 00002000:00010000:3.0:1788263495.286137:0:18577:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ff2831f2d80 00000100:00100000:3.0:1788263495.286158:0:18577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:3.0:1788263495.286167:0:18577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ff2831f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+8:2389:x1875129699285760:12345-192.168.203.26@tcp:4:bash.0 00000100:00100000:0.0:1788263495.290038:0:18577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ff2831f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6218fa09-9d3e-4029-b371-f2f7a141bebe+10:2389:x1875129699285760:12345-192.168.203.26@tcp:4:bash.0 Request processed in 3865us (4257us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788263495.290064:0:18577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 0 00002000:00100000:0.0:1788263495.290078:0:18577:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff9ff2831f2d80 x1875129699285760/t8589934599(0) o4->6218fa09-9d3e-4029-b371-f2f7a141bebe@192.168.203.26@tcp:706/0 lens 504/448 e 0 to 0 dl 1788263506 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788263495.290088:0:18577:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ff2831f2d80 with x1875129699285760 ext(0->8) 00002000:00010000:0.0:1788263495.290094:0:18577:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ff2831f2d80 Debug log: 43194 lines, 43194 kept, 0 dropped, 0 bad.